Fetching the paper…
Reading the bibliography…
Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design.
HuggingFace’s transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R’emi Louf, Morgan Funtowicz, and Jamie Brew. 2019 · 1910
Earlier work this paper cites.
Looking for a few good metrics: ROUGE and its evaluation
Chin-yew Lin and Marina Rey. 2004 · 2004
Earlier work this paper cites.
Language models are few-shot learners
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2005
Earlier work this paper cites.
Poetry of the crowd: A human computation algorithm to convert prose into rhyming verse
Quanze Chen, Chenyang Lei, Wei Xu, Ellie Pavlick, and Chris Callison-Burch. 2014 · 2014
Earlier work this paper cites.
Creative help: A story writing assistant
Melissa Roemmele and Andrew S. Gordon. 2015 · 2015
Earlier work this paper cites.
Generating topical poetry
Marjan Ghazvininejad, Xing Shi, Yejin Choi, and Kevin Knight. 2016 · 2016
Earlier work this paper cites.
Yake! collection-independent automatic keyword extractor
Ricardo Campos, Vítor Mangaravite, Arian Pasquali, Alípio Mário Jorge, Célia Nunes, and Adam Jatowt. 2018 · 2018
Earlier work this paper cites.
Creative writing with a machine in the loop: Case studies on slogans and stories
Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018 · 2018
Earlier work this paper cites.
Hierarchical neural story generation
Angela Fan, Mike Lewis, and Yann Dauphin. 2018 · 2018
Earlier work this paper cites.
The gutenberg english poetry corpus: exemplary quantitative narrative analyses
Arthur M Jacobs. 2018 · 2018
Earlier work this paper cites.
Do massively pretrained language models make better storytellers?
Abigail See, Aneesh Pappu, Rohun Saxena, Akhila Yerukola, and Christopher D. Manning. 2019 · 2019
Earlier work this paper cites.
First steps towards collaborative poetry generation
David Uthus, Maria Voitovich, RJ Mical, and Ray Kurzweil. 2019 · 2019
Earlier work this paper cites.
STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generation
Nader Akoury, Shufan Wang, Josh Whiting, Stephen Hood, Nanyun Peng, and Mohit Iyyer. 2020 · 2020
Earlier work this paper cites.
Gpt-3 creative fiction
Gwern Branwen. 2020 · 2020
Earlier work this paper cites.
Yake! keyword extraction from single documents using multiple local features
Ricardo Campos, Vítor Mangaravite, Arian Pasquali, Alípio Jorge, Célia Nunes, and Adam Jatowt. 2020 · 2020
Earlier work this paper cites.
Enabling language models to fill in the blanks
Chris Donahue, Mina Lee, and Percy Liang. 2020 · 2020
Cited alongside, same era.
Can gpt-3 pass a writer’s turing test?
Katherine Elkins and Jon Chun. 2020 · 2020
Cited alongside, same era.
The curious case of neural text degeneration
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020 · 2020
Cited alongside, same era.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020
Cited alongside, same era.
Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters
Jeff Rasley, Samyam Rajbhandari, Olatunji Ruwase, and Yuxiong He. 2020 · 2020
Cited alongside, same era.
Automatic poetry generation from prosaic text
Tim Van de Cruys. 2020 · 2020
Coauthor: Designing a human-ai collaborative writing dataset for exploring language model capabilities
Mina Lee, Percy Liang, and Qian Yang. 2022 · 2022
Closest in time.
Piotr Mirowski, Kory W Mathewson, Jaylen Pittman, and Richard Evans. 2022 · 2022
Closest in time.
Cross-task generalization via natural language crowdsourcing instructions
Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi. 2022 · 2022
Closest in time.
Help me think: A simple prompting strategy for non-experts to create customized content with models
Swaroop Mishra and Elnaz Nouri. 2022 · 2022
Closest in time.
Poelm: A meter-and rhyme-controllable language model for unsupervised poetry generation
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Ext5: Towards extreme multi-task scaling for transfer learning
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q Tran, Dara Bahri, Jianmo Ni, et al. 2021 · 2021
Cited alongside, same era.
Don’t go far off: An empirical study on neural poetry translation
Tuhin Chakrabarty, Arkadiy Saakyan, and Smaranda Muresan. 2021 · 2021
Cited alongside, same era.
Wordcraft: a human-ai collaborative editor for story writing
Andy Coenen, Luke Davis, Daphne Ippolito, Emily Reif, and Ann Yuan. 2021 · 2021
Cited alongside, same era.
Cross-task generalization via natural language crowdsourcing instructions
Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi. 2021 · 2021
Cited alongside, same era.
Multitask prompted training enables zero-shot task generalization
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Fevry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, and Alexander M. Rush. 2021 · 2021
Cited alongside, same era.
Story centaur: Large language model few shot learning as a creative writing tool
Ben Swanson, Kory Mathewson, Ben Pietrzak, Sherol Chen, and Monica Dinalescu. 2021 · 2021
Cited alongside, same era.
Aitor Ormazabal, Mikel Artetxe, Manex Agirrezabal, Aitor Soroa, and Eneko Agirre. 2022 · 2022
Closest in time.
Training language models to follow instructions with human feedback
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022 · 2022
Closest in time.
Machine-in-the-loop rewriting for creative image captioning
Vishakh Padmakumar and He He. 2022 · 2022
Closest in time.
Exploring the role of task transferability in large-scale multi-task learning
Vishakh Padmakumar, Leonard Lausen, Miguel Ballesteros, Sheng Zha, He He, and George Karypis. 2022 · 2022
Closest in time.
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022 · 2022
Closest in time.
A recipe for arbitrary text style transfer with large language models
Emily Reif, Daphne Ippolito, Ann Yuan, Andy Coenen, Chris Callison-Burch, and Jason Wei. 2022 · 2022
Closest in time.
Zero-shot sonnet generation with discourse-level planning and aesthetics features
Yufei Tian and Nanyun Peng. 2022 · 2022
Closest in time.
Augmenting poetry composition with Verse by Verse
David Uthus, Maria Voitovich, and R.J. Mical. 2022 · 2022
Closest in time.
Benchmarking generalization via in-context instructions on 1,600+ language tasks
Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi, Yeganeh Kordi, Amirreza Mirzaei, Anjana Arunkumar, Arjun Ashok, Arut Selvan Dhanasekaran, Atharva Naik, David Stap, et al. 2022 · 2022
Closest in time.
Emergent abilities of large language models
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. 2022 · 2022
Closest in time.
Re3: Generating longer stories with recursive reprompting and revision
Kevin Yang, Nanyun Peng, Yuandong Tian, and Dan Klein. 2022 · 2022
Closest in time.