Fetching the paper…
Reading the bibliography…
As large language models (LLMs) are increasingly used across various applications, there is a growing need to control text generation to satisfy specific constraints or requirements.
CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning
Bill Yuchen Lin, Wangchunshu Zhou, Ming Shen, Pei Zhou, Chandra Bhagavatula, Yejin Choi, and Xiang Ren · 1911
Earlier work this paper cites.
Equation of state calculations by fast computing machines
Nicholas Metropolis, Arianna W Rosenbluth, Marshall N Rosenbluth, Augusta H Teller, and Edward Teller · 1953
Earlier work this paper cites.
Finite-state transducers in language and speech processing
Mehryar Mohri · 1997
Earlier work this paper cites.
Information theory and statistics: A tutorial
Imre Csiszár and Paul C. Shields · 2004
Earlier work this paper cites.
Monte Carlo Strategies in Scientific Computing
Jun S. Liu · 2004
Earlier work this paper cites.
Monte Carlo Statistical Methods
Christian P. Robert and George Casella · 2004
Earlier work this paper cites.
A tutorial on energy-based learning
Yann LeCun, Sumit Chopra, Raia Hadsell, M Ranzato, Fujie Huang, et al · 2006
Earlier work this paper cites.
Reducibility among combinatorial problems
Richard M Karp · 2010
Earlier work this paper cites.
Limitations of autoregressive models and their alternatives
Chu-Cheng Lin, Aaron Jaech, Xin Li, Matthew R Gormley, and Jason Eisner · 2010
Earlier work this paper cites.
A corpus and cloze evaluation for deeper understanding of commonsense stories
Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, and James F. Allen · 2016
Earlier work this paper cites.
Proximal policy optimization algorithms
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017
Earlier work this paper cites.
Umap: Uniform manifold approximation and projection for dimension reduction
Leland McInnes, John Healy, and James Melville · 2018
Earlier work this paper cites.
Texygen: A benchmarking platform for text generation models
Yaoming Zhu, Sidi Lu, Lei Zheng, Jiaxian Guo, Weinan Zhang, Jun Wang, and Yong Yu · 2018
Earlier work this paper cites.
Plug and play language models: A simple approach to controlled text generation
Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu · 2019
Earlier work this paper cites.
Distributional reinforcement learning for energy-based sequential models
Tetiana Parshakova, Jean-Marc Andreoli, and Marc Dymetman · 2019
Earlier work this paper cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019
Earlier work this paper cites.
Distilbert, a distilled version of BERT: smaller, faster, cheaper and lighter
Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf · 2019
Earlier work this paper cites.
Gedi: Generative discriminator guided sequence generation
Ben Krause, Akhilesh Deepak Gotmare, Bryan McCann, Nitish Shirish Keskar, Shafiq Joty, Richard Socher, and Nazneen Fatema Rajani · 2020
Cited alongside, same era.
Flow network based generative models for non-iterative diverse candidate generation
Emmanuel Bengio, Moksh Jain, Maksym Korablyov, Doina Precup, and Yoshua Bengio · 2021
Cited alongside, same era.
A distributional approach to controlled text generation
Muhammad Khalifa, Hady Elsahar, and Marc Dymetman · 2021
Cited alongside, same era.
Dexperts: Decoding-time controlled text generation with experts and anti-experts
Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A Smith, and Yejin Choi · 2021
Cited alongside, same era.
FUDGE: Controlled text generation with future discriminators
Kevin Yang and Dan Klein · 2021
Cited alongside, same era.
Critic-guided decoding for controlled text generation
Minbeom Kim, Hwanhee Lee, Kang Min Yoo, Joonsuk Park, Hwaran Lee, and Kyomin Jung · 2023
Later among the works it cites.
disco: a toolkit for distributional control of generative models
Germán Kruszewski, Jos Rozen, and Marc Dymetman · 2023
Later among the works it cites.
Performance of chatgpt on usmle: Potential for ai-assisted medical education using large language models
Tiffany H Kung, Morgan Cheatham, Arielle Medenilla, Czarina Sillos, Lorie De Leon, Camille Elepaño, Maria Madriaga, Rimel Aggabao, Giezel Diaz-Candido, James Maningo, et al · 2023
Later among the works it cites.
Controlled decoding from language models
Sidharth Mudgal, Jong Lee, Harish Ganapathy, YaGuang Li, Tao Wang, Yanping Huang, Zhifeng Chen, Heng-Tze Cheng, Michael Collins, Trevor Strohman, et al · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
An approximate sampler for energy-based models with divergence diagnostics
Bryan Eikema, Germán Kruszewski, Christopher R Dance, Hady Elsahar, and Marc Dymetman · 2022
Cited alongside, same era.
Emotion english distilroberta-base
Jochen Hartmann · 2022
Cited alongside, same era.
Neurologic a*esque decoding: Constrained text generation with lookahead heuristics
Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, et al · 2022
Cited alongside, same era.
Controllable text generation with neurally-decomposed oracle
Tao Meng, Sidi Lu, Nanyun Peng, and Kai-Wei Chang · 2022
Cited alongside, same era.
Mix and match: Learning-free controllable text generation using energy language models
Fatemehsadat Mireshghallah, Kartik Goyal, and Taylor Berg-Kirkpatrick · 2022
Cited alongside, same era.
Training language models to follow instructions with human feedback
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022
Cited alongside, same era.
Discup: Discriminator cooperative unlikelihood prompt-tuning for controllable text generation
Hanqing Zhang and Dawei Song · 2022
Cited alongside, same era.
OpenAI · 2023
Later among the works it cites.
Information Theory: From Coding to Learning
Yury Polyanskiy and Yihong Wu · 2023
Later among the works it cites.
Direct preference optimization: Your language model is secretly a reward model
Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn · 2023
Later among the works it cites.
Efficient Guided Generation for Large Language Models
Brandon T. Willard and Rémi Louf · 2023
Later among the works it cites.
Tailor: A soft-prompt-based approach to attribute-based controlled text generation
Kexin Yang, Dayiheng Liu, Wenqiang Lei, Baosong Yang, Mingfeng Xue, Boxing Chen, and Jun Xie · 2023
Later among the works it cites.
Ines Zelch, Matthias Hagen, and Martin Potthast · 2023
Later among the works it cites.
Tractable control for autoregressive language generation
Honghua Zhang, Meihua Dang, Nanyun Peng, and Guy Van den Broeck · 2023
Later among the works it cites.
Transfer q star: Principled decoding for llm alignment
Souradip Chakraborty, Soumya Suvra Ghosal, Ming Yin, Dinesh Manocha, Mengdi Wang, Amrit Singh Bedi, and Furong Huang · 2024
Closest in time.
Amortizing intractable inference in large language models
Edward J Hu, Moksh Jain, Eric Elmoznino, Younesse Kaddar, Guillaume Lajoie, Yoshua Bengio, and Nikolay Malkin · 2024
Closest in time.
Minbeom Kim, Hwanhee Lee, Joonsuk Park, Hwaran Lee, and Kyomin Jung · 2024
Closest in time.
Gemma 2: Improving open language models at a practical size
Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, et al · 2024
Closest in time.
Kang Min Yoo, Jaegeun Han, Sookyo In, Heewon Jeon, Jisu Jeong, Jaewook Kang, Hyunwook Kim, Kyung-Min Kim, Munhyong Kim, Sungju Kim, et al · 2024
Closest in time.