LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models

Huggingface’s transformers: State-of-the-art natural language processing

Original

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019 · 1910

Earlier work this paper cites.

Understanding the difficulty of training deep feedforward neural networks

Xavier Glorot and Yoshua Bengio. 2010 · 2010

Earlier work this paper cites.

DeCAF: A deep convolutional activation feature for generic visual recognition

Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2014 · 2014

Earlier work this paper cites.

Delving deep into rectifiers: Surpassing human-level performance on imagenet classification

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015 · 2015

Earlier work this paper cites.

Decoupled weight decay regularization

Original

Ilya Loshchilov and Frank Hutter. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Parameter-efficient transfer learning for NLP

Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019 · 2019

Earlier work this paper cites.

Cross-attention is all you need: Adapting pretrained transformers for machine translation

Original

Mozhdeh Gheini, Xiang Ren, and Jonathan May. 2021 · 2021

Earlier work this paper cites.

Towards a unified view of parameter-efficient transfer learning

Original

Junxian He, Chunting Zhou, Xuezhe Ma, Taylor Berg-Kirkpatrick, and Graham Neubig. 2021 · 2021

Earlier work this paper cites.

LoRA: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

The power of scale for parameter-efficient prompt tuning

Original

Brian Lester, Rami Al-Rfou, and Noah Constant. 2021 · 2021

Earlier work this paper cites.

Datasets: A community library for natural language processing

Original

Quentin Lhoest, Albert Villanova del Moral, Yacine Jernite, Abhishek Thakur, Patrick von Platen, Suraj Patil, Julien Chaumond, Mariama Drame, Julien Plu, Lewis Tunstall, et al. 2021 · 2021

Earlier work this paper cites.

What’s in the box? a preliminary analysis of undesirable content in the Common Crawl Corpus

Original

Alexandra Sasha Luccioni and Joseph D Viviano. 2021 · 2021

Earlier work this paper cites.

Finetuned language models are zero-shot learners

Original

Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. 2021 · 2021

Earlier work this paper cites.

Red teaming language models to reduce harms: Methods, scaling behaviors, and lessons learned

Original

Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, et al. 2022 · 2022

Earlier work this paper cites.

Accelerate: Training and inference at scale made simple, efficient and adaptable

Sylvain Gugger, Lysandre Debut, Thomas Wolf, Philipp Schmid, Zachary Mueller, Sourab Mangrulkar, Marc Sun, and Benjamin Bossan. 2022 · 2022

Earlier work this paper cites.

Peft: State-of-the-art parameter-efficient fine-tuning methods

Sourab Mangrulkar, Sylvain Gugger, Lysandre Debut, Younes Belkada, Sayak Paul, and Benjamin Bossan. 2022 · 2022

Earlier work this paper cites.

Jailbreaking ChatGPT on release day

Zvi Mowshowitz. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022

Earlier work this paper cites.

Ignore previous prompt: Attack techniques for language models

Original

Fábio Perez and Ian Ribeiro. 2022 · 2022

Earlier work this paper cites.

LST: Ladder side-tuning for parameter and memory efficient transfer learning

Yi-Lin Sung, Jaemin Cho, and Mohit Bansal. 2022 · 2022

Earlier work this paper cites.

DAN is my new friend

walkerspider. 2022 · 2022

Earlier work this paper cites.

Thread of known chatgpt jailbreaks

Zack Witten. 2022 · 2022

Earlier work this paper cites.

GPT-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Detecting language model attacks with perplexity

Original

Gabriel Alon and Michael Kamfonas. 2023 · 2023

Earlier work this paper cites.

Another jailbreak for GPT4: Talk to it in Morse code

Boaz Barak. 2023 · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J Pappas, and Eric Wong. 2023 · 2023

Cited alongside, same era.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Cited alongside, same era.

A two sentence jailbreak for GPT-4 and Claude & why nobody knows how to fix it

Alexey Guzey. 2023 · 2023

Cited alongside, same era.

LLM self defense: By self examination, LLMs know they are being tricked

Original

Alec Helbling, Mansi Phute, Matthew Hull, and Duen Horng Chau. 2023 · 2023

Cited alongside, same era.

Llama Guard: LLM-based input-output safeguard for Human-AI conversations

Original

Defending ChatGPT against jailbreak attack via self-reminders

Yueqi Xie, Jingwei Yi, Jiawei Shao, Justin Curl, Lingjuan Lyu, Qifeng Chen, Xing Xie, and Fangzhao Wu. 2023 · 2023

Later among the works it cites.

Low-resource languages jailbreak GPT-4

Original

Zheng-Xin Yong, Cristina Menghini, and Stephen H Bach. 2023 · 2023

Later among the works it cites.

GPTFUZZER: Red teaming large language models with auto-generated jailbreak prompts

Original

Jiahao Yu, Xingwei Lin, and Xinyu Xing. 2023 · 2023

Later among the works it cites.

GPT-4 is too smart to be safe: Stealthy chat with LLMs via cipher

Original

Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Pinjia He, Shuming Shi, and Zhaopeng Tu. 2023 · 2023

Later among the works it cites.

AutoDAN: Automatic and interpretable adversarial attacks on large language models