Fetching the paper…
Reading the bibliography…
Despite recent progress of pre-trained language models on generating fluent text, existing methods still suffer from incoherence problems in long-form text generation tasks that require proper content control and planning to form a coherent high-level logical flow.
The curious case of neural text degeneration
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2019 · 1904
Earlier work this paper cites.
Ctrl: A conditional transformer language model for controllable generation
Nitish Shirish Keskar, Bryan McCann, Lav R Varshney, Caiming Xiong, and Richard Socher. 2019 · 1909
Earlier work this paper cites.
Discourse strategies for generating natural-language text
Kathleen R McKeown. 1985 · 1985
Earlier work this paper cites.
Pragmatics and natural language generation
Eduard H Hovy. 1990 · 1990
Earlier work this paper cites.
Building applied natural language generation systems
Ehud Reiter and Robert Dale. 1997 · 1997
Earlier work this paper cites.
The automated acquisition of topic signatures for text summarization
Chin-Yew Lin and Eduard Hovy. 2000 · 2000
Earlier work this paper cites.
Paraphrase generation with latent bag of words
Yao Fu, Yansong Feng, and John P Cunningham. 2020 · 2001
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
ROUGE: A package for automatic evaluation of summaries
Chin-Yew Lin. 2004 · 2004
Earlier work this paper cites.
A controllable model of grounded response generation
Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, et al. 2020 · 2005
Earlier work this paper cites.
Generating and evaluating evaluative arguments
Giuseppe Carenini and Johanna D. Moore. 2006 · 2006
Earlier work this paper cites.
The new york times annotated corpus
Evan Sandhaus. 2008 · 2008
Earlier work this paper cites.
Ctrlsum: Towards generic controllable text summarization
Junxian He, Wojciech Kryściński, Bryan McCann, Nazneen Rajani, and Caiming Xiong. 2020 · 2012
Earlier work this paper cites.
Learning phrase representations using RNN encoder–decoder for statistical machine translation
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Meteor universal: Language specific translation evaluation for any target language
Michael Denkowski and Alon Lavie. 2014 · 2014
Earlier work this paper cites.
A diversity-promoting objective function for neural conversation models
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016 · 2016
Earlier work this paper cites.
Toward controlled generation of text
Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, and Eric P. Xing. 2017 · 2017
Earlier work this paper cites.
Neural net models of open-domain discourse coherence
Jiwei Li and Dan Jurafsky. 2017 · 2017
Earlier work this paper cites.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter. 2017 · 2017
Cited alongside, same era.
Discourse-aware neural rewards for coherent text generation
Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, and Yejin Choi. 2018 · 2018
Cited alongside, same era.
ArgumenText: Searching for arguments in heterogeneous sources
Christian Stab, Johannes Daxenberger, Chris Stahlhut, Tristan Miller, Benjamin Schiller, Christopher Tauchmann, Steffen Eger, and Iryna Gurevych. 2018 · 2018
Cited alongside, same era.
Neural data-to-text generation: A comparison between pipeline and end-to-end architectures
Thiago Castro Ferreira, Chris van der Lee, Emiel van Miltenburg, and Emiel Krahmer. 2019 · 2019
Cited alongside, same era.
Controllable paraphrase generation with a syntactic exemplar
Mingda Chen, Qingming Tang, Sam Wiseman, and Kevin Gimpel. 2019 · 2019
Cited alongside, same era.
BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020
Later among the works it cites.
Exploring controllable text generation techniques
Shrimai Prabhumoye, Alan W Black, and Ruslan Salakhutdinov. 2020 · 2020
Later among the works it cites.
PlotMachines: Outline-conditioned generation with dynamic plot state tracking
Hannah Rashkin, Asli Celikyilmaz, Yejin Choi, and Jianfeng Gao. 2020 · 2020
Later among the works it cites.
MEGATRON-CNTRL: Controllable story generation with external knowledge using large-scale language models
Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Raul Puri, Pascale Fung, Anima Anandkumar, and Bryan Catanzaro. 2020 · 2020
Later among the works it cites.
Scarecrow: A framework for scrutinizing machine text
Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A Smith, and Yejin Choi. 2021 · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Strategies for structuring story generation
Angela Fan, Mike Lewis, and Yann Dauphin. 2019 · 2019
Cited alongside, same era.
Structuring latent spaces for stylized response generation
Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2019 · 2019
Cited alongside, same era.
Argument generation with retrieval, planning, and realization
Xinyu Hua, Zhe Hu, and Lu Wang. 2019 · 2019
Cited alongside, same era.
Step-by-step: Separating planning from realization in neural data-to-text generation
Amit Moryossef, Yoav Goldberg, and Ido Dagan. 2019 · 2019
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019
Cited alongside, same era.
An entity-driven framework for abstractive summarization
Eva Sharma, Luyang Huang, Zhe Hu, and Lu Wang. 2019 · 2019
Cited alongside, same era.
Later among the works it cites.
SideControl: Controlled open-domain dialogue generation via additive side networks
Wanyu Du and Yangfeng Ji. 2021 · 2021
Later among the works it cites.
Long text generation by modeling sentence-level and discourse-level coherence
Jian Guan, Xiaoxi Mao, Changjie Fan, Zitao Liu, Wenbiao Ding, and Minlie Huang. 2021 · 2021
Later among the works it cites.
Zhe Hu, Zhiwei Cao, Hou Pong Chan, Jiachen Liu, Xinyan Xiao, Jinsong Su, and Hua Wu. 2021 · 2021
Later among the works it cites.
DYPLOC: Dynamic planning of content using mixed language models for text generation
Xinyu Hua, Ashwin Sreevatsa, and Lu Wang. 2021 · 2021
Later among the works it cites.
DiscoDVT: Generating long text with discourse-aware discrete variational transformer
Haozhe Ji and Minlie Huang. 2021 · 2021
Later among the works it cites.
Enriching transformers with structured tensor-product representations for abstractive summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, and Jianfeng Gao. 2021 · 2021
Later among the works it cites.
Stylized story generation with style-guided planning
Xiangzhe Kong, Jialiang Huang, Ziquan Tung, Jian Guan, and Minlie Huang. 2021 · 2021
Later among the works it cites.
Conversations are not flat: Modeling the dynamic information flow across dialogue utterances
Zekang Li, Jinchao Zhang, Zhengcong Fei, Yang Feng, and Jie Zhou. 2021 · 2021
Later among the works it cites.
Aspect-controlled neural argument generation
Benjamin Schiller, Johannes Daxenberger, and Iryna Gurevych. 2021 · 2021
Later among the works it cites.
Progressive generation of long text with pretrained language models
Bowen Tan, Zichao Yang, Maruan Al-Shedivat, Eric Xing, and Zhiting Hu. 2021 · 2021
Later among the works it cites.
Improving unsupervised dialogue topic segmentation with utterance-pair coherence scoring
Linzi Xing and Giuseppe Carenini. 2021 · 2021
Later among the works it cites.
Beyond goldfish memory: Long-term open-domain conversation
Jing Xu, Arthur Szlam, and Jason Weston. 2021 · 2021
Later among the works it cites.
Towards generating long and coherent text with multi-level latent variable models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, and Lawrence Carin. 2019 · 2089
Closest in time.