Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Models

Generative adversarial nets

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014

Earlier work this paper cites.

Model inversion attacks that exploit confidence information and basic countermeasures

Matt Fredrikson, Somesh Jha, and Thomas Ristenpart · 2015

Earlier work this paper cites.

Explaining and harnessing adversarial examples

Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy · 2015

Earlier work this paper cites.

ZOO: zeroth order optimization based black-box attacks to deep neural networks without training substitute models

Pin-Yu Chen, Huan Zhang, Yash Sharma, Jinfeng Yi, and Cho-Jui Hsieh · 2017

Earlier work this paper cites.

Badnets: Identifying vulnerabilities in the machine learning model supply chain

Original

Tianyu Gu, Brendan Dolan-Gavitt, and Siddharth Garg · 2017

Earlier work this paper cites.

Practical black-box attacks against machine learning

Nicolas Papernot, Patrick McDaniel, Ian Goodfellow, Somesh Jha, Z. Berkay Celik, and Ananthram Swami · 2017

Earlier work this paper cites.

Membership inference attacks against machine learning models

Reza Shokri, Marco Stronati, Congzheng Song, and Vitaly Shmatikov · 2017

Earlier work this paper cites.

Decision-based adversarial attacks: Reliable attacks against black-box machine learning models

Wieland Brendel, Jonas Rauber, and Matthias Bethge · 2018

Earlier work this paper cites.

Towards deep learning models resistant to adversarial attacks

Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu · 2018

Earlier work this paper cites.

Privacy risk in machine learning: Analyzing the connection to overfitting

Samuel Yeom, Irene Giacomelli, Matt Fredrikson, and Somesh Jha · 2018

Earlier work this paper cites.

The secret sharer: Evaluating and testing unintended memorization in neural networks

Nicholas Carlini, Chang Liu, Úlfar Erlingsson, Jernej Kos, and Dawn Song · 2019

Earlier work this paper cites.

Adversarial examples are not bugs, they are features

Andrew Ilyas, Shibani Santurkar, Dimitris Tsipras, Logan Engstrom, Brandon Tran, and Aleksander Madry · 2019

Earlier work this paper cites.

A style-based generator architecture for generative adversarial networks

Tero Karras, Samuli Laine, and Timo Aila · 2019

Earlier work this paper cites.

Ml-leaks: Model and data independent membership inference attacks and defenses on machine learning models

Ahmed Salem, Yang Zhang, Mathias Humbert, Pascal Berrang, Mario Fritz, and Michael Backes · 2019

Earlier work this paper cites.

Latent backdoor attacks on deep neural networks

Yuanshun Yao, Huiying Li, Haitao Zheng, and Ben Y. Zhao · 2019

Earlier work this paper cites.

Language models are few-shot learners

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei · 2020

Earlier work this paper cites.

Hopskipjumpattack: A query-efficient decision-based attack

Jianbo Chen, Michael I. Jordan, and Martin J. Wainwright · 2020

Earlier work this paper cites.

Hidden trigger backdoor attacks

Aniruddha Saha, Akshayvarun Subramanya, and Hamed Pirsiavash · 2020

Earlier work this paper cites.

The secret revealer: Generative model-inversion attacks against deep neural networks

Yuheng Zhang, Ruoxi Jia, Hengzhi Pei, Wenxiao Wang, Bo Li, and Dawn Song · 2020

Cited alongside, same era.

Machine unlearning

Lucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia, Adelin Travers, Baiwu Zhang, David Lie, and Nicolas Papernot · 2021

Cited alongside, same era.

Extracting training data from large language models

Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom B. Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, and Colin Raffel · 2021

Cited alongside, same era.

Knowledge-enriched distributional model inversion attacks

Si Chen, Mostafa Kahla, Ruoxi Jia, and Guo-Jun Qi · 2021

Cited alongside, same era.

Label-only membership inference attacks

Christopher A. Choquette-Choo, Florian Tramèr, Nicholas Carlini, and Nicolas Papernot · 2021

Cited alongside, same era.

Adversarial deepfakes: Evaluating vulnerability of deepfake detectors to adversarial examples

Backdoor attacks on self-supervised learning

Aniruddha Saha, Ajinkya Tejankar, Soroush Abbasi Koohpayegani, and Hamed Pirsiavash · 2022

Later among the works it cites.

BLOOM: A 176b-parameter open-access multilingual language model

Original

Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilic, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major, Iz Beltagy, Huu Nguyen, Lucile Saulnier, Samson Tan, Pedro Ortiz Suarez, Victor Sanh, Hugo Laurençon, Yacine Jernite, Julien Launay, Margaret Mitchell, Colin Raffel, Aaron Gokaslan, Adi Simhi, Aitor Soroa, Alham Fikri Aji, Amit Alfassy, Anna Rogers, Ariel Kreisberg Nitzav, Canwen Xu, Chenghao Mou, Chris Emezue, Christopher Klamm, Colin Leong, Daniel van Strien, David Ifeoluwa Adelani, and et al · 2022

Later among the works it cites.

Back to the drawing board: A critical evaluation of poisoning attacks on production federated learning

Virat Shejwalkar, Amir Houmansadr, Peter Kairouz, and Daniel Ramage · 2022

Later among the works it cites.

Lamda: Language models for dialog applications

Original

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Kathleen S. Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Agüera y Arcas, Claire Cui, Marian Croak, Ed H. Chi, and Quoc Le · 2022