Fetching the paper…
Reading the bibliography…
While most research on controllable text generation has focused on steering base Language Models, the emerging instruction-tuning and prompting paradigm offers an alternate approach to controllability.
Oxford english dictionary
Oxford English Dictionary · 1989
Earlier work this paper cites.
Natural language processing: a historical review
Karen Sparck Jones · 1994
Earlier work this paper cites.
Nltk: The natural language toolkit
Edward Loper and Steven Bird · 2002
Earlier work this paper cites.
When training and test sets are different: characterizing learning transfer
Amos Storkey et al · 2009
Earlier work this paper cites.
Learning word vectors for sentiment analysis
Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng, and Christopher Potts · 2011
Earlier work this paper cites.
Teaching machines to read and comprehend
Karl Moritz Hermann, Tomás Kociský, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom · 2015
Earlier work this paper cites.
Character-level convolutional networks for text classification
Xiang Zhang, Junbo Jake Zhao, and Yann LeCun · 2015
Earlier work this paper cites.
Energy-based generative adversarial network
Junbo Jake Zhao, Michaël Mathieu, and Yann LeCun · 2016
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam M. Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Hierarchical neural story generation
Angela Fan, Mike Lewis, and Yann Dauphin · 2018
Earlier work this paper cites.
Improving language understanding with unsupervised learning
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever · 2018
Earlier work this paper cites.
Diverse beam search for improved description of complex scenes
Ashwin K. Vijayakumar, Michael Cogswell, Ramprasaath R. Selvaraju, Qing Sun, Stefan Lee, David J. Crandall, and Dhruv Batra · 2018
Earlier work this paper cites.
Jigsaw unintended bias in toxicity classification, 2019
CJ Adams, Daniel Borkan, inversion, Jeffrey Sorensen, Lucas Dixon, Lucy Vasserman, and nithum · 2019
Earlier work this paper cites.
Incorporating structured commonsense knowledge in story completion
Jiaao Chen, Jianshu Chen, and Zhou Yu · 2019
Earlier work this paper cites.
Openwebtext corpus
Aaron Gokaslan and Vanya Cohen · 2019
Earlier work this paper cites.
The curious case of neural text degeneration
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi · 2019
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov · 2019
Earlier work this paper cites.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 2020
Earlier work this paper cites.
Natural language processing
KR1442 Chowdhary and KR Chowdhary · 2020
Earlier work this paper cites.
Plug and play language models: A simple approach to controlled text generation
Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu · 2020
Earlier work this paper cites.
Realtoxicityprompts: Evaluating neural toxic degeneration in language models
Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A Smith · 2020
Cited alongside, same era.
A beginner’s guide and best practices for using crowdsourcing platforms for survey research: The case of amazon mechanical turk (mturk)
Cihan Cobanoglu, Muhittin Cavusoglu, and Gozde Turktarhan · 2021
Cited alongside, same era.
A survey of nlp-related crowdsourcing hits: what works and what does not
Jessica Huynh, Jeffrey Bigham, and Maxine Eskenazi · 2021
Cited alongside, same era.
Gedi: Generative discriminator guided sequence generation
Ben Krause, Akhilesh Deepak Gotmare, Bryan McCann, Nitish Shirish Keskar, Shafiq Joty, Richard Socher, and Nazneen Fatema Rajani · 2021
Cited alongside, same era.
Emergent abilities of large language models
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al · 2022
Later among the works it cites.
Discup: Discriminator cooperative unlikelihood prompt-tuning for controllable text generation
Hanqing Zhang and Dawei Song · 2022
Later among the works it cites.
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023
Later among the works it cites.
Falcon-40b: an open large language model with state-of-the-art performance
Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Merouane Debbah, Etienne Goffinet, Daniel Heslow, Julien Launay, Quentin Malartic, et al · 2023
Later among the works it cites.
Defending against alignment-breaking attacks via robustly aligned llm
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Brian Lester, Rami Al-Rfou, and Noah Constant · 2021
Cited alongside, same era.
Prefix-tuning: Optimizing continuous prompts for generation
Xiang Lisa Li and Percy Liang · 2021
Cited alongside, same era.
Dexperts: Decoding-time controlled text generation with experts and anti-experts
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A Smith, and Yejin Choi · 2021
Cited alongside, same era.
Naturalproofs: Mathematical theorem proving in natural language
Sean Welleck, Jiacheng Liu, Ronan Le Bras, Hannaneh Hajishirzi, Yejin Choi, and Kyunghyun Cho · 2021
Cited alongside, same era.
Fudge: Controlled text generation with future discriminators
Kevin Yang and Dan Klein · 2021
Cited alongside, same era.
Cognac: Controllable text generation with language constraints
Howard Chen, Huihan Li, Danqi Chen, and Karthik Narasimhan · 2022
Cited alongside, same era.
Improving controllable text generation with position-aware weighted decoding
Yuxuan Gu, Xiaocheng Feng, Sicheng Ma, Jiaming Wu, Heng Gong, and Bing Qin · 2022
Cited alongside, same era.
Critic-guided decoding for controlled text generation
Minbeom Kim, Hwanhee Lee, Kang Min Yoo, Joonsuk Park, Hwaran Lee, and Kyomin Jung · 2022
Cited alongside, same era.
Bochuan Cao, Yuanpu Cao, Lu Lin, and Jinghui Chen · 2023
Later among the works it cites.
Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al · 2023
Later among the works it cites.
Grace: Discriminator-guided chain-of-thought reasoning
Muhammad Khalifa, Lajanugen Logeswaran, Moontae Lee, Honglak Lee, and Lu Wang · 2023
Later among the works it cites.
Bolt: Fast energy-based controlled text generation with tunable biases
Xin Liu, Muhammad Khalifa, and Lu Wang · 2023
Later among the works it cites.
Inference-time policy adapters (ipa): Tailoring extreme-scale lms without fine-tuning
Ximing Lu, Faeze Brahman, Peter West, Jaehun Jang, Khyathi Chandu, Abhilasha Ravichander, Lianhui Qin, Prithviraj Ammanabrolu, Liwei Jiang, Sahana Ramnath, et al · 2023
Later among the works it cites.
Focused prefix tuning for controllable text generation
Congda Ma, Tianyu Zhao, Makoto Shing, Kei Sawada, and Manabu Okumura · 2023
Later among the works it cites.
Evaluating large language models on controlled generation tasks
Jiao Sun, Yufei Tian, Wangchunshu Zhou, Nan Xu, Qian Hu, Rahul Gupta, John Frederick Wieting, Nanyun Peng, and Xuezhe Ma · 2023
Later among the works it cites.
Introducing mpt-7b: a new standard for open-source, commercially usable llms, 2023
MN Team et al · 2023
Later among the works it cites.
Grace: gradient-guided controllable retrieval for augmenting attribute-based text generation
Zhihua Wen, Zhiliang Tian, Zhen Huang, Yuxin Yang, Zexin Jian, Changjian Wang, and Dongsheng Li · 2023
Later among the works it cites.
Collie: Systematic construction of constrained text generation tasks
Shunyu Yao, Howard Chen, Austin W Hanjie, Runzhe Yang, and Karthik Narasimhan · 2023
Later among the works it cites.
Why johnny can’t prompt: how non-ai experts try (and fail) to design llm prompts
JD Zamfirescu-Pereira, Richmond Y Wong, Bjoern Hartmann, and Qian Yang · 2023
Later among the works it cites.
Click: Controllable text generation with sequence likelihood contrastive learning
Chujie Zheng, Pei Ke, Zheng Zhang, and Minlie Huang · 2023
Later among the works it cites.
Air-decoding: Attribute distribution reconstruction for decoding-time controllable text generation
Tianqi Zhong, Quan Wang, Jingxuan Han, Yongdong Zhang, and Zhendong Mao · 2023
Later among the works it cites.
Controlled text generation with natural language instructions
Wangchunshu Zhou, Yuchen Eleanor Jiang, Ethan Wilcox, Ryan Cotterell, and Mrinmaya Sachan · 2023
Later among the works it cites.
Chatgpt vs gemini vs llama on multilingual sentiment analysis
Alessio Buscemi and Daniele Proverbio · 2024
Closest in time.