2023

The Foundation Model Transparency Index

Bommasani, Rishi, Klyman, Kevin, Longpre, Shayne et al.

Understand

Foundation models have rapidly permeated society, catalyzing a wave of generative AI applications spanning enterprise and consumer-facing contexts.

While the societal impact of foundation models is growing, transparency is on the decline, mirroring the opacity that has plagued past digital technologies (e.g.
social media).
Reversing this trend is essential: transparency is a vital precondition for public accountability, scientific innovation, and effective governance.

Built on

Energy and policy considerations for deep learning in NLP
Original
Emma Strubell, Ananya Ganesh, and Andrew McCallum. 2019 · 1906
Earlier work this paper cites.
Release strategies and the social impacts of language models
Original
Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, and Jasmine Wang. 2019 · 1908
Earlier work this paper cites.
Fine-tuning language models from human preferences
Original
Daniel M. Ziegler, Nisan Stiennon, Jeff Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul Christiano, and Geoffrey Irving. 2019 · 1909
Earlier work this paper cites.
Quantifying the carbon emissions of machine learning
Original
Alexandre Lacoste, Alexandra Luccioni, Victor Schmidt, and Thomas Dandres. 2019 · 1910
Earlier work this paper cites.
The rise of the right to know: Politics and the culture of transparency, 1945-1975
Michael Schudson. 2015 · 1975
Earlier work this paper cites.
The measurement of observer agreement for categorical data
J. Richard Landis and Gary G. Koch. 1977 · 1977
Earlier work this paper cites.
Problems of monetary management: the uk experience
Charles AE Goodhart. 1984 · 1984
Earlier work this paper cites.
Human development revisited: A new undp report
Michael Hopkins. 1991 · 1991
Earlier work this paper cites.
General purpose technologies ‘engines of growth’?
Timothy F. Bresnahan and M. Trajtenberg. 1995 · 1995
Earlier work this paper cites.
Market transparency: Who wins and who loses?
Robert Bloomfield and Maureen O’Hara. 1999 · 1999
Earlier work this paper cites.
Trust and trustworthiness
Russell Hardin. 2002 · 2002
Earlier work this paper cites.
State-of-the-art report on current methodologies and practices for composite indicator development , volume 214
Michaela Saisana and Stefano Tarantola. 2002 · 2002
Earlier work this paper cites.
Toward trustworthy ai development: mechanisms for supporting verifiable claims
Original
Miles Brundage, Shahar Avin, Jasmine Wang, Haydn Belfield, Gretchen Krueger, Gillian Hadfield, Heidy Khlaaf, Jingying Yang, Helen Toner, Ruth Fong, et al. 2020 · 2004
Earlier work this paper cites.
Good governance: Rule of law, transparency, and accountability
Michael Johnston. 2006 · 2006
Earlier work this paper cites.
The right to know: transparency for an open world
Ann Florini. 2007 · 2007
Earlier work this paper cites.
Trustworthy ai inference systems: An industry research view
Original
Rosario Cammarota, Matthias Schunter, Anand Rajan, Fabian Boemer, Ágnes Kiss, Amos Treiber, Christian Weinert, Thomas Schneider, Emmanuel Stapf, Ahmad-Reza Sadeghi, et al. 2020 · 2008
Earlier work this paper cites.
Handbook on constructing composite indicators: methodology and user guide
Joint Research Centre-European Commission et al. 2008 · 2008
Earlier work this paper cites.
Handbook on Constructing Composite Indicators: Methodology and User Guide
OECD, European Union, and Joint Research Centre European Commission. 2008 · 2008
Earlier work this paper cites.
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009 · 2009
Earlier work this paper cites.
Political and social foundations for environmental sustainability
Andrew B Whitford and Karen Wong. 2009 · 2009
Earlier work this paper cites.
Open government: Collaboration, transparency, and participation in practice
Daniel Lathrop and Laurel Ruma. 2010 · 2010
Earlier work this paper cites.
Complacency and bias in human use of automation: An attentional integration
Raja Parasuraman and Dietrich H. Manzey. 2010 · 2010
Earlier work this paper cites.
Fudging the nudge: Information disclosure and restaurant grading
Daniel E. Ho. 2012 · 2012
Earlier work this paper cites.
Why nations fail: The origins of power, prosperity and poverty
James A Robinson and Daron Acemoglu. 2012 · 2012
Earlier work this paper cites.
Practical anarchism: Peer mutualism, market power, and the fallible state
Yochai Benkler. 2013 · 2013
Earlier work this paper cites.
Transparency strategy: Competing with information in a digital world
Nelson Granados and Alok Gupta. 2013 · 2013
Earlier work this paper cites.
The future of crowd work
Aniket Kittur, Jeffrey V Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013 · 2013
Earlier work this paper cites.
Auditing algorithms : Research methods for detecting discrimination on internet platforms
Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cédric Langbort. 2014 · 2014
Earlier work this paper cites.
Cookies that give you away: The surveillance implications of web tracking
Steven Englehardt, Dillon Reisman, Christian Eubank, Peter Zimmerman, Jonathan Mayer, Arvind Narayanan, and Edward W Felten. 2015 · 2015
Earlier work this paper cites.
The transparency society
Byung-Chul Han. 2015 · 2015
Earlier work this paper cites.
Transparency
Mark Eli Kalderon. 2015 · 2015
Earlier work this paper cites.
The black box society: The secret algorithms that control money and information
Frank Pasquale. 2015 · 2015
Earlier work this paper cites.
Big data’s disparate impact
Solon Barocas and Andrew D. Selbst. 2016 · 2016
Earlier work this paper cites.
Algorithmic accountability and transparency
Danah Boyd. 2016 · 2016
Earlier work this paper cites.
Can we open the black box of ai?
Davide Castelvecchi. 2016 · 2016
Earlier work this paper cites.
Online tracking: A 1-million-site measurement and analysis
Steven Englehardt and Arvind Narayanan. 2016 · 2016
Earlier work this paper cites.
Official journal of the european union 2016
EU. 2016 · 2016
Earlier work this paper cites.
Watch out for this commit! a study of influential software changes
Original
Daoyuan Li, Li Li, Dongsun Kim, Tegawendé F. Bissyandé, David Lo, and Yves Le Traon. 2016 · 2016
Earlier work this paper cites.
Privacy is an essentially contested concept: a multi-dimensional analytic for mapping privacy
Deirdre K. Mulligan, Colin Koopman, and Nick Doty. 2016 · 2016
Earlier work this paper cites.
50 years of data science
David Donoho. 2017 · 2017
Earlier work this paper cites.
The princeton web transparency and accountability project
Arvind Narayanan and Dillon Reisman. 2017 · 2017
Earlier work this paper cites.
Algorithmic labor and information asymmetries: A case study of uber’s drivers
Alex Rosenblat and Luke Stark. 2016 · 2017
Earlier work this paper cites.
Artificial intelligence’s fair use crisis
Benjamin LW Sobel. 2017 · 2017
Earlier work this paper cites.
Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability
Mike Ananny and Kate Crawford. 2018 · 2018
Earlier work this paper cites.
Gender shades: Intersectional accuracy disparities in commercial gender classification
Joy Buolamwini and Timnit Gebru. 2018 · 2018
Earlier work this paper cites.
Datasheets for datasets
Original
Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé Ill, and Kate Crawford. 2018 · 2018
Earlier work this paper cites.
How cambridge analytica sparked the great privacy awakening
Issie Lapowsky. 2018 · 2018
Earlier work this paper cites.
Model cards for model reporting
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2018 · 2018
Earlier work this paper cites.
Progressive disclosure: Designing for effective transparency
Original
Aaron Springer and Steve Whittaker. 2018 · 2018
Earlier work this paper cites.
The role of cooperation in responsible ai development
Original
Amanda Askell, Miles Brundage, and Gillian Hadfield. 2019 · 2019
Earlier work this paper cites.
On the methodological framework of composite indices: A review of the issues of weighting, aggregation, and robustness
Salvatore Greco, Alessio Ishizaka, Menelaos Tasiou, and Gianpiero Torrisi. 2019 · 2019
Earlier work this paper cites.
The transparency trap: Non-financial disclosure and the responsibility of business to respect human rights
David Hess. 2019 · 2019
Earlier work this paper cites.
The global landscape of ai ethics guidelines
Anna Jobin, Marcello Ienca, and Effy Vayena. 2019 · 2019
Earlier work this paper cites.
Troubling trends in machine learning scholarship: Some ml papers suffer from flaws that could mislead the public and stymie future research
Zachary C. Lipton and Jacob Steinhardt. 2019 · 2019
Earlier work this paper cites.
Dark patterns at scale: Findings from a crawl of 11k shopping websites
Arunesh Mathur, Gunes Acar, Michael J. Friedman, Eli Lucherini, Jonathan Mayer, Marshini Chetty, and Arvind Narayanan. 2019 · 2019
Earlier work this paper cites.
Model cards for model reporting
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019 · 2019
Earlier work this paper cites.
Principles alone cannot guarantee ethical ai
Brent Mittelstadt. 2019 · 2019
Earlier work this paper cites.
Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial ai products
Inioluwa Deborah Raji and Joy Buolamwini. 2019 · 2019
Earlier work this paper cites.
SuperGLUE: A stickier benchmark for general-purpose language understanding systems
Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R. Bowman. 2019 · 2019
Earlier work this paper cites.
Data capitalism: Redefining the logics of surveillance and privacy
Sarah Myers West. 2019 · 2019
Earlier work this paper cites.
Roles for computing in social change
Rediet Abebe, Solon Barocas, Jon Kleinberg, Karen Levy, Manish Raghavan, and David G Robinson. 2020 · 2020
Earlier work this paper cites.
Utility is in the eye of the user: A critique of NLP leaderboards
Kawin Ethayarajh and Dan Jurafsky. 2020 · 2020
Earlier work this paper cites.
Principled artificial intelligence: Mapping consensus in ethical and rights-based approaches to principles for ai
Jessica Fjeld, Nele Achten, Hannah Hilligoss, Adam Nagy, and Madhulika Srikumar. 2020 · 2020
Earlier work this paper cites.
The ethics of ai ethics: An evaluation of guidelines
Thilo Hagendorff. 2020 · 2020
Earlier work this paper cites.
Automatic android deprecated-api usage update by learning from single updated example
Original
Stefanus Agus Haryono, Ferdian Thung, Hong Jin Kang, Lucas Serrano, Gilles Muller, Julia Lawall, David Lo, and Lingxiao Jiang. 2020 · 2020
Earlier work this paper cites.
Towards the systematic reporting of the energy and carbon footprints of machine learning
Peter Henderson, Jieru Hu, Joshua Romoff, Emma Brunskill, Dan Jurafsky, and Joelle Pineau. 2020 · 2020
Earlier work this paper cites.
Understanding Transparency in Algorithmic Accountability , Cambridge Law Handbooks, page 121–138. Cambridge University Press
Margot E. Kaminski. 2020 · 2020
Earlier work this paper cites.
Redesigning data privacy: Reimagining notice and consent for human technology interaction
Jen King. 2020 · 2020
Earlier work this paper cites.
Trustworthy ai in the age of pervasive computing and big data
Abhishek Kumar, Tristan Braud, Sasu Tarkoma, and Pan Hui. 2020 · 2020
Earlier work this paper cites.
Putting the semantics into semantic versioning
Patrick Lam, Jens Dietrich, and David J. Pearce. 2020 · 2020
Earlier work this paper cites.
Fair learning
Mark A Lemley and Bryan Casey. 2020 · 2020
Earlier work this paper cites.

Similar

Decolonial ai: Decolonial theory as sociotechnical foresight in artificial intelligence
Shakir Mohamed, Marie-Therese Png, and William Isaac. 2020 · 2020
Cited alongside, same era.
2020 ranking digital rights corporate accountability index
RDR. 2020 · 2020
Cited alongside, same era.
Mlperf inference benchmark
Vijay Janapa Reddi, Christine Cheng, David Kanter, Peter Mattson, Guenther Schmuelling, Carole-Jean Wu, Brian Anderson, Maximilien Breughe, Mark Charlebois, William Chou, et al. 2020 · 2020
Cited alongside, same era.
Beyond accuracy: Behavioral testing of NLP models with CheckList
Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, and Sameer Singh. 2020 · 2020
Cited alongside, same era.
Green ai
Roy Schwartz, Jesse Dodge, Noah A Smith, and Oren Etzioni. 2020 · 2020
Cited alongside, same era.
Bridging the gap between ethics and practice: Guidelines for reliable, safe, and trustworthy human-centered ai systems
Ben Shneiderman. 2020 · 2020
Cited alongside, same era.
Persistent anti-muslim bias in large language models
Original
Abubakar Abid, Maheen Farooqi, and James Zou. 2021 · 2021
Cited alongside, same era.
Addressing" documentation debt" in machine learning research: A retrospective datasheet for bookcorpus
Original
Jack Bandy and Nicholas Vincent. 2021 · 2021
Cited alongside, same era.
On the dangers of stochastic parrots: Can language models be too big?
Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021 · 2021
Cited alongside, same era.
Radical secrecy: The ends of transparency in datafied America , volume 60
Clare Birchall. 2021 · 2021
Cited alongside, same era.
On the opportunities and risks of foundation models
Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dorottya Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2021 · 2021
Cited alongside, same era.
The productivity j-curve: How intangibles complement general purpose technologies
Erik Brynjolfsson, Daniel Rock, and Chad Syverson. 2021 · 2021
Cited alongside, same era.

Then

Corruption perception index 2022
Transparency International. 2023 · 2022
Later among the works it cites.
Taxonomy of risks posed by language models
Laura Weidinger, Jonathan Uesato, Maribeth Rauh, Conor Griffin, Po-Sen Huang, John Mellor, Amelia Glaese, Myra Cheng, Borja Balle, Atoosa Kasirzadeh, Courtney Biles, Sasha Brown, Zac Kenton, Will Hawkins, Tom Stepleton, Abeba Birhane, Lisa Anne Hendricks, Laura Rimell, William Isaac, Julia Haas, Sean Legassick, Geoffrey Irving, and Iason Gabriel. 2022 · 2022
Later among the works it cites.
The ai index 2022 annual report. ai index steering committee
Daniel Zhang, Nestor Maslej, Erik Brynjolfsson, John Etchemendy, Terah Lyons, James Manyika, Helen Ngo, Juan Carlos Niebles, Michael Sellitto, Ellie Sakhaee, et al. 2022a · 2022
Later among the works it cites.
Socially meaningful transparency in data-based systems: reflections and proposals from practice
J. Bates, H. Kennedy, and I. et al. Medina Perea. 2023 · 2023
Closest in time.
The Quest for AI Sovereignty, Transparency and Accountability
Luca Belli and Walter Gaspar. 2023 · 2023
Closest in time.
Evaluation for change
Rishi Bommasani. 2023 · 2023
Closest in time.
Expert explainer: Allocating accountability in ai supply chains
Ian Brown. 2023 · 2023
Closest in time.
Open problems and fundamental limitations of reinforcement learning from human feedback
Original
Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Rachel Freedman, Tomasz Korbak, David Lindner, Pedro Freire, Tony Wang, Samuel Marks, Charbel-Raphaël Segerie, Micah Carroll, Andi Peng, Phillip Christoffersen, Mehul Damani, Stewart Slocum, Usman Anwar, Anand Siththaranjan, Max Nadeau, Eric J. Michaud, Jacob Pfau, Dmitrii Krasheninnikov, Xin Chen, Lauro Langosco, Peter Hase, Erdem Bıyık, Anca Dragan, David Krueger, Dorsa Sadigh, and Dylan Hadfield-Menell. 2023 · 2023
Closest in time.
Ai supply chains and why they matter
Sarah H. Cen, Aspen Hopkins, Andrew Ilyas, Aleksander Madry, Isabella Struckman, and Luis Videgaray. 2023 · 2023
Closest in time.
Understanding accountability in algorithmic supply chains
Jennifer Cobbe, Michael Veale, and Jatinder Singh. 2023 · 2023
Closest in time.
Ftc finalizes order requiring fortnite maker epic games to pay 245 million for tricking users into making unwanted charges
Federal Trade Commission. 2023 · 2023
Closest in time.
Machine learning and artificial intelligence: Legal concepts
A. Feder Cooper, David Mimno, Madiha Choksi, and Katherine Lee. 2023 · 2023
Closest in time.
Interrogating the t in facct
Eric Corbett and Emily Denton. 2023 · 2023
Closest in time.
Ai is a lot of work: As the technology becomes ubiquitous, a vast tasker underclass is emerging — and not going anywhere
Josh Dzieza. 2023 · 2023
Closest in time.
Gpts are gpts: An early look at the labor market impact potential of large language models
Original
Tyna Eloundou, Sam Manning, Pamela Mishkin, and Daniel Rock. 2023 · 2023
Closest in time.
A comprehensive and distributed approach to ai regulation
Alex Engler. 2023 · 2023
Closest in time.
Smart corruption: Satirical strategies for gaming accountability
Ritwick Ghosh and Hilary Oliva Faxon. 2023 · 2023
Closest in time.
The need for transparency in artificial intelligence
Sam Gregory. 2023 · 2023
Closest in time.
Regulating chatgpt and other large generative ai models
Philipp Hacker, Andreas Engel, and Marco Mauer. 2023 · 2023
Closest in time.
Cleaning up chatgpt takes heavy toll on human workers
Karen Hao and Deepa Seetharaman. 2023 · 2023
Closest in time.
Oversight of a.i.: Legislating on artificial intelligence
Woodrow Hartzog. 2023 · 2023
Closest in time.
Version control for ml models: Why you need it, what it is, how to implement it
Ahmed Hashesh. 2023 · 2023
Closest in time.
It’s high time for more ai transparency
Melissa Heikkilä. 2023 · 2023
Closest in time.
Foundation models and fair use
Original
Peter Henderson, Xuechen Li, Dan Jurafsky, Tatsunori Hashimoto, Mark A Lemley, and Percy Liang. 2023 · 2023
Closest in time.
Catastrophic jailbreak of open-source llms via exploiting generation
Original
Yangsibo Huang, Samyak Gupta, Mengzhou Xia, Kai Li, and Danqi Chen. 2023 · 2023
Closest in time.
Explainer: What is a foundation model?
Elliot Jones. 2023 · 2023
Closest in time.
Reforms: Reporting standards for machine learning based science
Original
Sayash Kapoor, Emily Cantrell, Kenny Peng, Thanh Hien Pham, Christopher A. Bail, Odd Erik Gundersen, Jake M. Hofman, Jessica Hullman, Michael A. Lones, Momin M. Malik, Priyanka Nanayakkara, Russell A. Poldrack, Inioluwa Deborah Raji, Michael Roberts, Matthew J. Salganik, Marta Serra-Garcia, Brandon M. Stewart, Gilles Vandewiele, and Arvind Narayanan. 2023 · 2023
Closest in time.
Leakage and the reproducibility crisis in machine-learning-based science
Sayash Kapoor and Arvind Narayanan. 2023 · 2023
Closest in time.
Propile: Probing privacy leakage in large language models
Original
Siwon Kim, Sangdoo Yun, Hwaran Lee, Martin Gubri, Sungroh Yoon, and Seong Joon Oh. 2023 · 2023
Closest in time.
A watermark for large language models
John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, and Tom Goldstein. 2023 · 2023
Closest in time.
How to promote responsible open foundation models
Kevin Klyman. 2023 · 2023
Closest in time.
Robust distortion-free watermarks for language models
Original
Rohith Kuditipudi, John Thickstun, Tatsunori Hashimoto, and Percy Liang. 2023 · 2023
Closest in time.
Geo-bench: Toward foundation models for earth monitoring
Original
Alexandre Lacoste, Nils Lehmann, Pau Rodríguez López, Evan D. Sherwin, Hannah Rae Kerner, Bjorn Lutjens, Jeremy A. Irvin, David Dao, Hamed Alemohammad, Alexandre Drouin, Mehmet Gunturkun, Gabriel Huang, David Vázquez, Dava Newman, Yoshua Bengio, Stefano Ermon, and Xiao Xiang Zhu. 2023 · 2023
Closest in time.
Towards a transparent ai future: The call for less regulatory hurdles on open-source ai in europe
LAION. 2023 · 2023
Closest in time.
Holistic evaluation of language models
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Alexander Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew Arad Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue WANG, Keshav Santhanam, Laurel Orr, Lucia Zheng, Mert Yuksekgonul, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Andrew Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, and Yuta Koreeda. 2023 · 2023
Closest in time.
Ai transparency in the age of llms: A human-centered research roadmap
Original
Qingzi Vera Liao and Jennifer Wortman Vaughan. 2023 · 2023
Closest in time.
Opening up chatgpt: Tracking openness, transparency, and accountability in instruction-tuned text generators
Andreas Liesenfeld, Alianda Lopez, and Mark Dingemanse. 2023 · 2023
Closest in time.
Evolutionary-scale prediction of atomic-level protein structure with a language model
Zeming Lin, Halil Akin, Roshan Rao, Brian Hie, Zhongkai Zhu, Wenting Lu, Nikita Smetanin, Robert Verkuil, Ori Kabeli, Yaniv Shmueli, Allan dos Santos Costa, Maryam Fazel-Zarandi, Tom Sercu, Salvatore Candido, and Alexander Rives. 2023 · 2023
Closest in time.
Building a competitive advantage based on transparency: When and why does transparency matter for corporate social responsibility?
Yeyi Liu, Martin Heinberg, Xuan Huang, and Andreas B. Eisingerich. 2023 · 2023
Closest in time.
A pretrainer’s guide to training data: Measuring the effects of data age, domain coverage, quality, & toxicity
Original
Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, et al. 2023 · 2023
Closest in time.
Counting carbon: A survey of factors influencing the emissions of machine learning
Original
Alexandra Sasha Luccioni and Alex Hernández-García. 2023 · 2023
Closest in time.
Analyzing leakage of personally identifiable information in language models
Original
Nils Lukas, Ahmed Salem, Robert Sim, Shruti Tople, Lukas Wutschitz, and Santiago Zanella-Béguelin. 2023 · 2023
Closest in time.
The ai index 2023 annual report
Nestor Maslej, Loredana Fattorini, Erik Brynjolfsson, John Etchemendy, Katrina Ligett, Terah Lyons, James Manyika, Helen Ngo, Juan Carlos Niebles, Vanessa Parli, et al. 2023 · 2023
Closest in time.
Meta platform terms
Meta. 2023 · 2023
Closest in time.
Generative ai companies must publish transparency reports
Arvind Narayanan and Sayash Kapoor. 2023 · 2023
Closest in time.
Cheaply evaluating inference efficiency metrics for autoregressive transformer APIs
Deepak Narayanan, Keshav Santhanam, Peter Henderson, Rishi Bommasani, Tony Lee, and Percy Liang. 2023 · 2023
Closest in time.
Astrollama: Towards specialized foundation models in astronomy
Original
Tuan Dung Nguyen, Yuan-Sen Ting, Ioana Ciucă, Charlie O’Neill, Ze-Chang Sun, Maja Jablo’nska, Sandor Kruk, Ernest Perkowski, Jack W. Miller, Jason Li, Josh Peek, Kartheik Iyer, Tomasz R’o.za’nski, Pranav Khetarpal, Sharaf Zaman, David Brodrick, Sergio J. Rodr’iguez M’endez, Thang Bui, Alyssa Goodman, Alberto Accomazzi, Jill P. Naiman, Jesse Cranney, Kevin Schawinski, and UniverseTBD. 2023 · 2023
Closest in time.
Open X-Embodiment: Robotic learning datasets and RT-X models
Open X-Embodiment Collaboration, Abhishek Padalkar, Acorn Pooley, Ajinkya Jain, Alex Bewley, Alex Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anikait Singh, Anthony Brohan, Antonin Raffin, Ayzaan Wahid, Ben Burgess-Limerick, Beomjoon Kim, Bernhard Schölkopf, Brian Ichter, Cewu Lu, Charles Xu, Chelsea Finn, Chenfeng Xu, Cheng Chi, Chenguang Huang, Christine Chan, Chuer Pan, Chuyuan Fu, Coline Devin, Danny Driess, Deepak Pathak, Dhruv Shah, Dieter Büchler, Dmitry Kalashnikov, Dorsa Sadigh, Edward Johns, Federico Ceola, Fei Xia, Freek Stulp, Gaoyue Zhou, Gaurav S. Sukhatme, Gautam Salhotra, Ge Yan, Giulio Schiavi, Hao Su, Hao-Shu Fang, Haochen Shi, Heni Ben Amor, Henrik I Christensen, Hiroki Furuta, Homer Walke, Hongjie Fang, Igor Mordatch, Ilija Radosavovic, Isabel Leal, Jacky Liang, Jaehyung Kim, Jan Schneider, Jasmine Hsu, Jeannette Bohg, Jeffrey Bingham, Jiajun Wu, Jialin Wu, Jianlan Luo, Jiayuan Gu, Jie Tan, Jihoon Oh, Jitendra Malik, Jonathan Tompson, Jonathan Yang, Joseph J. Lim, João Silvério, Junhyek Han, Kanishka Rao, Karl Pertsch, Karol Hausman, Keegan Go, Keerthana Gopalakrishnan, Ken Goldberg, Kendra Byrne, Kenneth Oslund, Kento Kawaharazuka, Kevin Zhang, Keyvan Majd, Krishan Rana, Krishnan Srinivasan, Lawrence Yunliang Chen, Lerrel Pinto, Liam Tan, Lionel Ott, Lisa Lee, Masayoshi Tomizuka, Maximilian Du, Michael Ahn, Mingtong Zhang, Mingyu Ding, Mohan Kumar Srirama, Mohit Sharma, Moo Jin Kim, Naoaki Kanazawa, Nicklas Hansen, Nicolas Heess, Nikhil J Joshi, Niko Suenderhauf, Norman Di Palo, Nur Muhammad Mahi Shafiullah, Oier Mees, Oliver Kroemer, Pannag R Sanketi, Paul Wohlhart, Peng Xu, Pierre Sermanet, Priya Sundaresan, Quan Vuong, Rafael Rafailov, Ran Tian, Ria Doshi, Roberto Martín-Martín, Russell Mendonca, Rutav Shah, Ryan Hoque, Ryan Julian, Samuel Bustamante, Sean Kirmani, Sergey Levine, Sherry Moore, Shikhar Bahl, Shivin Dass, Shuran Song, Sichun Xu, Siddhant Haldar, Simeon Adebola, Simon Guist, Soroush Nasiriany, Stefan Schaal, Stefan Welker, Stephen Tian, Sudeep Dasari, Suneel Belkhale, Takayuki Osa, Tatsuya Harada, Tatsuya Matsushima, Ted Xiao, Tianhe Yu, Tianli Ding, Todor Davchev, Tony Z. Zhao, Travis Armstrong, Trevor Darrell, Vidhi Jain, Vincent Vanhoucke, Wei Zhan, Wenxuan Zhou, Wolfram Burgard, Xi Chen, Xiaolong Wang, Xinghao Zhu, Xuanlin Li, Yao Lu, Yevgen Chebotar, Yifan Zhou, Yifeng Zhu, Ying Xu, Yixuan Wang, Yonatan Bisk, Yoonyoung Cho, Youngwoon Lee, Yuchen Cui, Yueh hua Wu, Yujin Tang, Yuke Zhu, Yunzhu Li, Yusuke Iwasawa, Yutaka Matsuo, Zhuo Xu, and Zichen Jeff Cui. 2023 · 2023
Closest in time.
Gpt-4 technical report
Original
OpenAI. 2023 · 2023
Closest in time.
The roots search tool: Data transparency for llms
Original
Aleksandra Piktus, Christopher Akiki, Paulo Villegas, Hugo Laurençon, Gérard Dupont, Alexandra Sasha Luccioni, Yacine Jernite, and Anna Rogers. 2023 · 2023
Closest in time.
Stronger together: on the articulation of ethical charters, legal tools, and technical documentation in ML
Giada Pistilli, Carlos Muñoz Ferrandis, Yacine Jernite, and Margaret Mitchell. 2023 · 2023
Closest in time.
Fine-tuning aligned language models compromises safety, even when users do not intend to!
Original
Xiangyu Qi, Yi Zeng, Tinghao Xie, Pin-Yu Chen, Ruoxi Jia, Prateek Mittal, and Peter Henderson. 2023 · 2023
Closest in time.
I’m afraid i can’t do that: Predicting prompt refusal in black-box generative language models
Original
Max Reuter and William Schulze. 2023 · 2023
Closest in time.
Paul tremblay, mona awad vs. openai, inc., et al
Joseph R. Saveri, Cadio Zirpoli, Christopher K.L. Young, and Kathleen J. McMahon. 2023 · 2023
Closest in time.
Open-Sourcing Highly Capable Foundation Models: An Evaluation of Risks, Benefits, and Alternative Methods for Pursuing Open-Source Objectives
Elizabeth Seger, Noemi Dreksler, Richard Moulange, Emily Dardaman, Jonas Schuett, K. Wei, Christoph Winter, Mackenzie Arnold, Seán Ó hÉigeartaigh, Anton Korinek, Markus Anderljung, Ben Bucknall, Alan Chan, Eoghan Stafford, Leonie Koessler, Aviv Ovadya, Ben Garfinkel, Emma Bluemke, Michael Aird, Patrick Levermore, Julian Hazell, and Abhishek Gupta. 2023 · 2023
Closest in time.
Eleutherai’s thoughts on the eu ai act
Aviya Skowron and Stella Biderman. 2023 · 2023
Closest in time.
The gradient of generative ai release: Methods and considerations
Irene Solaiman. 2023 · 2023
Closest in time.
Evaluating the social impact of generative ai systems in systems and society
Original
Irene Solaiman, Zeerak Talat, William Agnew, Lama Ahmad, Dylan Baker, Su Lin Blodgett, Hal Daumé III au2, Jesse Dodge, Ellie Evans, Sara Hooker, Yacine Jernite, Alexandra Sasha Luccioni, Alberto Lusoli, Margaret Mitchell, Jessica Newman, Marie-Therese Png, Andrew Strait, and Apostol Vassilev. 2023 · 2023
Closest in time.
Llama: Open and efficient foundation language models
Original
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023 · 2023
Closest in time.
Market concentration implications of foundation models: The invisible hand of chatgpt
Jai Vipra and Anton Korinek. 2023 · 2023
Closest in time.
Computational power and ai
Jai Vipra and Sarah Myers West. 2023 · 2023
Closest in time.
Comments on the business practices of cloud computing providers
Jai Vipra and Sarah Myers West. 2023 · 2023
Closest in time.
Designing responsible ai: Adaptations of ux practice to meet responsible ai challenges
Qiaosi Wang, Michael Madaio, Shaun Kane, Shivani Kapania, Michael Terry, and Lauren Wilcox. 2023b · 2023
Closest in time.
The presidio recommendations on responsible generative ai
WEF. 2023 · 2023
Closest in time.
Sociotechnical safety evaluation of generative ai systems
Original
Laura Weidinger, Maribeth Rauh, Nahema Marchal, Arianna Manzini, Lisa Anne Hendricks, Juan Mateos-Garcia, Stevie Bergman, Jackie Kay, Conor Griffin, Ben Bariach, Iason Gabriel, Verena Rieser, and William S. Isaac. 2023 · 2023
Closest in time.
Open (for business): Big tech, concentrated power, and the political economy of open ai
David Gray Widder, Sarah West, and Meredith Whittaker. 2023 · 2023
Closest in time.
Thinking upstream: Ethics and policy opportunities in ai supply chains
Original
David Gray Widder and Richmond Wong. 2023 · 2023
Closest in time.
Loose-lipped large language modells spill your secrets: The privacy implications of large language models
Amy Winograd. 2023 · 2023
Closest in time.
How data protection authorities are de facto regulating generative ai
Gabriela Zanfir-Fortuna. 2023 · 2023
Closest in time.
Representation engineering: A top-down approach to ai transparency
Original
Andy Zou, Long Phan, Sarah Chen, James Campbell, Phillip Guo, Richard Ren, Alexander Pan, Xuwang Yin, Mantas Mazeika, Ann-Kathrin Dombrowski, Shashwat Goel, Nathaniel Li, Michael J. Byun, Zifan Wang, Alex Mallen, Steven Basart, Sanmi Koyejo, Dawn Song, Matt Fredrikson, J. Zico Kolter, and Dan Hendrycks. 2023 · 2023
Closest in time.
Privacy as contextual integrity
Helen Nissenbaum. 2024 · 2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…