Fetching the paper…
Reading the bibliography…
Most research on lifelong learning applies to images or games, but not language.
Catastrophic interference in connectionist networks: The sequential learning problem
Michael McCloskey and Neal J Cohen · 1989
Earlier work this paper cites.
Character-level convolutional networks for text classification
Yann LeCun Xiang Zhang, Junbo Zhao · 2015
Earlier work this paper cites.
Lifelong Machine Learning
Zhiyuan Chen and Bing Liu · 2016
Earlier work this paper cites.
Squad: 100,000+ questions for machine comprehension of text
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang · 2016
Earlier work this paper cites.
Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell · 2016
Earlier work this paper cites.
A network-based end-to-end trainable task-oriented dialogue system
Tsung-Hsien Wen, David Vandyke, Nikola Mrksic, Milica Gasic, Lina M Rojas-Barahona, Pei-Hao Su, Stefan Ultes, and Steve Young · 2016
Earlier work this paper cites.
Pathnet: Evolution channels gradient descent in super neural networks
Chrisantha Fernando, Dylan Banarse, Charles Blundell, Yori Zwols, David Ha, Andrei A Rusu, Alexander Pritzel, and Daan Wierstra · 2017
Earlier work this paper cites.
Continual learning with deep generative replay
Jaehong Kim Hanul Shin, Jung Kwon Lee and Jiwon Kim · 2017
Earlier work this paper cites.
Deep semantic role labeling: What works and what’s next
Luheng He, Kenton Lee, Mike Lewis, and Luke Zettlemoyer · 2017
Earlier work this paper cites.
Fearnet: Brain-inspired model for incremental learning
Ronald Kemker and Christopher Kanan · 2017
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al · 2017
Cited alongside, same era.
Overcoming catastrophic forgetting by incremental moment matching
Sang-Woo Lee, Jin-Hwa Kim, Jaehyun Jun, Jung-Woo Ha, and Byoung-Tak Zhang · 2017
Cited alongside, same era.
Toward continual learning for conversational agents
Sungjin Lee · 2017
Cited alongside, same era.
Learning without forgetting
Zhizhong Li and Derek Hoiem · 2017
Cited alongside, same era.
Gradient episodic memory for continual learning
David Lopez-Paz et al · 2017
Cited alongside, same era.
Learning to generate reviews and discovering sentiment
Alec Radford, Rafal Jozefowicz, and Ilya Sutskever · 2017
Efficient lifelong learning with a-gem
Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, and Mohamed Elhoseiny · 2018
Later among the works it cites.
Exploring the challenges towards lifelong fact learning
Mohamed Elhoseiny, Francesca Babiloni, Rahaf Aljundi, Marcus Rohrbach, Manohar Paluri, and Tinne Tuytelaars · 2018
Later among the works it cites.
Packnet: Adding multiple tasks to a single network by iterative pruning
Arun Mallya and Svetlana Lazebnik · 2018
Later among the works it cites.
Progress & compress: A scalable framework for continual learning
Jonathan Schwarz, Jelena Luketina, Wojciech M Czarnecki, Agnieszka Grabska-Barwinska, Yee Whye Teh, Razvan Pascanu, and Raia Hadsell · 2018
Later among the works it cites.
On training recurrent neural networks for lifelong learning
Shagun Sodhani, Sarath Chandar, and Yoshua Bengio · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Distantly supervised lifelong learning for large-scale social media sentiment analysis
R. Xia, J. Jiang, and H. He · 2017
Cited alongside, same era.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Cited alongside, same era.
Memory aware synapses: Learning what (not) to forget
Rahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny, Marcus Rohrbach, and Tinne Tuytelaars · 2018
Cited alongside, same era.
The natural language decathlon: Multitask learning as question answering
Caiming Xiong Bryan McCann, Nitish Shirish Keskar and Richard Socher · 2018
Cited alongside, same era.
Net2net: Accelerating learning via knowledge transfer
Tianqi Chen, Ian Goodfellow, and Jonathon Shlens
Cited in the paper.
Lifelong learning for sentiment classification
Zhiyuan Chen, Nianzu Ma, and Bing Liu
Cited in the paper.
Later among the works it cites.
Lifelong domain word embedding via meta-learning
Hu Xu, Bing Liu, Lei Shu, and Philip S. Yu · 2018
Later among the works it cites.
Seq2sql: Generating structured queries from natural language using reinforcement learning
Victor Zhong, Caiming Xiong, and Richard Socher · 2018
Later among the works it cites.
Episodic memory in lifelong language learning
Cyprien de Masson d’Autume, Sebastian Ruder, Lingpeng Kong, and Dani Yogatama · 2019
Closest in time.
Continual learning for sentence representations using conceptors
Tianlin Liu, Lyle Ungar, and João Sedoc · 2019
Closest in time.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever · 2019
Closest in time.