Who's in and who's out? A case study of multimodal CLIP-filtering in DataComp

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901

Earlier work this paper cites.

Making technology masculine: men, women and modern machines in America, 1870-1945

Ruth Oldenziel. 1999 · 1945

Earlier work this paper cites.

Section 107. Limitations on exclusive rights: Fair use

Copyright Law of the United States. 1976 · 1976

Earlier work this paper cites.

When reality monitoring fails: The role of imagination in stereotype maintenance

Morgan P Slusher and Craig A Anderson. 1987 · 1987

Earlier work this paper cites.

The social construction of race

Ian F Haney Lopez. 1995 · 1995

Earlier work this paper cites.

Unpacking hetero-patriarchy: tracing the conflation of sex, gender & (and) sexual orientation to its origins

Francisco Valdes. 1996 · 1996

Earlier work this paper cites.

Breadwinner status and gender ideologies of men and women regarding family roles

Jiping Zuo and Shengming Tang. 2000 · 2000

Earlier work this paper cites.

A survey of user-centered design practice. In Proceedings of the SIGCHI conference on Human factors in computing systems . ACM, Minneapolis, MN, USA, 471–478

Karel Vredenburg, Ji-Ye Mao, Paul W Smith, and Tom Carey. 2002 · 2002

Earlier work this paper cites.

WebInSight: making web images accessible. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility . ACM, Portland, OR, USA, 181–188

Jeffrey P Bigham, Ryan S Kaminsky, Richard E Ladner, Oscar M Danielsson, and Gordon L Hempton. 2006 · 2006

Earlier work this paper cites.

Web content accessibility guidelines (WCAG) 2.0

Ben Caldwell, Michael Cooper, Loretta Guarino Reid, Gregg Vanderheiden, Wendy Chisholm, John Slatin, and Jason White. 2008 · 2008

Earlier work this paper cites.

Using the Census Bureau’s surname list to improve estimates of race/ethnicity and associated disparities

Marc N Elliott, Peter A Morrison, Allen Fremont, Daniel F McCaffrey, Philip Pantoja, and Nicole Lurie. 2009 · 2009

Earlier work this paper cites.

IP geolocation databases: Unreliable?

Ingmar Poese, Steve Uhlig, Mohamed Ali Kaafar, Benoit Donnet, and Bamba Gueye. 2011 · 2011

Earlier work this paper cites.

Fairness through awareness. In Proceedings of the 3rd Innovations in Theoretical Computer Science Conference . ACM, Cambridge, MA, USA, 214–226

Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012 · 2012

Earlier work this paper cites.

Gender as performance

Judith Butler. 2013 · 2013

Earlier work this paper cites.

O* NET: The occupational information network

Jonathan D Levine and Frederick L Oswald. 2013 · 2013

Earlier work this paper cites.

langdetect

Nakatani Shuyo. 2014 · 2014

Earlier work this paper cites.

On technological determinism: A typology, scope conditions, and a mechanism

Allan Dafoe. 2015 · 2015

Earlier work this paper cites.

The Chicago face database: A free stimulus set of faces and norming data

Debbie S Ma, Joshua Correll, and Bernd Wittenbrink. 2015 · 2015

Earlier work this paper cites.

Demographic dialectal variation in social media: A case study of African-American English

Su Lin Blodgett, Lisa Green, and Brendan O’Connor. 2016 · 2016

Earlier work this paper cites.

Is exposure to online content depicting risky behavior related to viewers’ own risky behavior offline?

Dawn Beverley Branley and Judith Covey. 2017 · 2017

Earlier work this paper cites.

Location accuracy of commercial IP address geolocation databases

Dan Komosny, Miroslav Voznak, and Saeed Ur Rehman. 2017 · 2017

Earlier work this paper cites.

Counterfactual fairness

Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017 · 2017

Earlier work this paper cites.

Economies of reputation: The case of revenge porn

Ganaele Langlois and Andrea Slane. 2017 · 2017

Earlier work this paper cites.

Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability, and Transparency . PMLR, New York, NY, USA, 77–91

Joy Buolamwini and Timnit Gebru. 2018 · 2018

Earlier work this paper cites.

Why is my classifier discriminatory?

Irene Chen, Fredrik D Johansson, and David Sontag. 2018 · 2018

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Earlier work this paper cites.

Measuring and mitigating unintended bias in text classification. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society . ACM, Santa Clara, CA, 67–73

Lucas Dixon, John Li, Jeffrey Sorensen, Nithum Thain, and Lucy Vasserman. 2018 · 2018

Earlier work this paper cites.

Caption crawler: Enabling reusable alternative text descriptions using reverse image search. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems . ACM, Montreal, QC, Canada, 1–11

Darren Guinness, Edward Cutrell, and Meredith Ringel Morris. 2018 · 2018

Earlier work this paper cites.

The Art of Cybersecurity: Defense in Depth Strategy for Robust Protection

Arif Ali Mughal. 2018 · 2018

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019

Earlier work this paper cites.

The risk of racial bias in hate speech detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . ACL, Florence, Italy, 1668–1678

Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi, and Noah A Smith. 2019 · 2019

Earlier work this paper cites.

CCNet: Extracting high quality monolingual datasets from web crawl data

Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Joulin, and Edouard Grave. 2019 · 2019

Earlier work this paper cites.

Predictive inequity in object detection

Benjamin Wilson, Judy Hoffman, and Jamie Morgenstern. 2019 · 2019

Earlier work this paper cites.

Language (technology) is power: A critical survey of" bias" in NLP

Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020 · 2020

Earlier work this paper cites.

Against scale: Provocations and resistances to scale thinking

Alex Hanna and Tina M Park. 2020 · 2020

Earlier work this paper cites.

Lessons from archives: Strategies for collecting sociocultural data in machine learning. In Proceedings of the 2020 conference on fairness, accountability, and transparency . ACM, Barcelona, Spain, 306–316

Eun Seo Jo and Timnit Gebru. 2020 · 2020

Earlier work this paper cites.

MIT takes down 80 Million Tiny Images data set due to racist and offensive content

Khari Johnson. 2020 · 2020

Earlier work this paper cites.

Detecting child sexual abuse material: A comprehensive survey

Hee-Eun Lee, Tatiana Ermakova, Vasilis Ververis, and Benjamin Fabian. 2020 · 2020

Earlier work this paper cites.

On the accuracy of country-level IP geolocation. In Proceedings of the applied networking research workshop . ACM, Online, 67–73

Ioana Livadariu, Thomas Dreibholz, Anas Saeed Al-Selwi, Haakon Bryhni, Olav Lysne, Steinar Bjørnstad, and Ahmed Elmokashfi. 2020 · 2020

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020

Earlier work this paper cites.

Diagnosing gender bias in image recognition systems

Carsten Schwemmer, Carly Knight, Emily D Bello-Pardo, Stan Oklobdzija, Martijn Schoonvelde, and Jeffrey W Lockhart. 2020 · 2020

Earlier work this paper cites.

Contrastive multiview coding. In European Conference on Computer Vision . Springer, Online, 776–794

Yonglong Tian, Dilip Krishnan, and Phillip Isola. 2020 · 2020

Earlier work this paper cites.

Fairness-Aware Instrumentation of Preprocessing˜ Pipelines for Machine Learning

Ke Yang, Biao Huang, Julia Stoyanovich, and Sebastian Schelter. 2020 · 2020

Earlier work this paper cites.

Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implications

Original

Sandhini Agarwal, Gretchen Krueger, Jack Clark, Alec Radford, Jong Wook Kim, and Miles Brundage. 2021 · 2021

Earlier work this paper cites.

“You’re so exotic looking”: An intersectional analysis of Asian American and Pacific Islander stereotypes

Sameena Azhar, Antonia RG Alvarez, Anne SJ Farina, and Susan Klumpner. 2021 · 2021

Earlier work this paper cites.

On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency . ACM, Online, 610–623

Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021 · 2021

Cited alongside, same era.

Large image datasets: A pyrrhic win for computer vision?. In 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) . IEEE, Online, 1536–1546

Abeba Birhane and Vinay Uday Prabhu. 2021 · 2021

Cited alongside, same era.

Multimodal datasets: misogyny, pornography, and malignant stereotypes

Abeba Birhane, Vinay Uday Prabhu, and Emmanuel Kahembwe. 2021 · 2021

Cited alongside, same era.

Fair preprocessing: towards understanding compositional fairness of data transformers in machine learning pipeline. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . ACM, Athens, Greece, 981–993

Sumon Biswas and Hridesh Rajan. 2021 · 2021

Cited alongside, same era.

Automated Data Cleaning Can Hurt Fairness in Machine Learning-based Decision Making. In 2023 IEEE 39th International Conference on Data Engineering (ICDE) . IEEE, Anaheim, CA, USA, 3747–3754

Shubha Guha, Falaah Arif Khan, Julia Stoyanovich, and Sebastian Schelter. 2023 · 2023

Later among the works it cites.

Foundation Models and Fair Use

Original

Peter Henderson, Xuechen Li, Dan Jurafsky, Tatsunori Hashimoto, Mark A. Lemley, and Percy Liang. 2023 · 2023

Later among the works it cites.

How AI is being abused to create child sexual abuse imagery

IWF. 2023 · 2023

Later among the works it cites.

Talkin’ ‘Bout AI Generation: Copyright and the Generative-AI Supply Chain

Katherine Lee, A. Feder Cooper, and James Grimmelmann. 2023 · 2023

Later among the works it cites.

word_cloud

Andreas Mueller. 2023 · 2023

Later among the works it cites.