Fetching the paper…
Reading the bibliography…
Real-life multilingual systems should be able to efficiently incorporate new languages as data distributions fed to the system evolve and shift over time.
Catastrophic interference in connectionist networks: The sequential learning problem
Michael McCloskey and Neal J Cohen. 1989 · 1989
Earlier work this paper cites.
Exploring fine-tuning techniques for pre-trained cross-lingual models via continual learning
Zihan Liu, Genta Indra Winata, Andrea Madotto, and Pascale Fung. 2020 · 2004
Earlier work this paper cites.
Evaluation of incremental learning algorithms for hmm in the recognition of alphanumeric characters
Paulo R Cavalin, Robert Sabourin, Ching Y Suen, and Alceu S Britto Jr. 2009 · 2009
Earlier work this paper cites.
A survey of techniques for incremental learning of hmm parameters
Wael Khreich, Eric Granger, Ali Miri, and Robert Sabourin. 2012 · 2012
Earlier work this paper cites.
Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell. 2016 · 2016
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017 · 2017
Earlier work this paper cites.
Gradient episodic memory for continual learning
David Lopez-Paz and Marc’Aurelio Ranzato. 2017 · 2017
Earlier work this paper cites.
Efficient lifelong learning with a-gem
Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, and Mohamed Elhoseiny. 2018 · 2018
Earlier work this paper cites.
Ethnologue: Languages of the world
Eberhard David, Gary Simons, and Charles Fennig. 2019 · 2019
Cited alongside, same era.
Episodic memory in lifelong language learning
Cyprien de Masson D’Autume, Sebastian Ruder, Lingpeng Kong, and Dani Yogatama. 2019 · 2019
Cited alongside, same era.
Simons, and charles d. fennig (eds.). 2019
David M Eberhard and F Gary. 2019 · 2019
Cited alongside, same era.
The step decay schedule: A near optimal, geometrically decaying learning rate procedure for least squares
Rong Ge, Sham M Kakade, Rahul Kidambi, and Praneeth Netrapalli. 2019 · 2019
Cited alongside, same era.
Massively multilingual transfer for ner
Afshin Rahimi, Yuan Li, and Trevor Cohn. 2019 · 2019
Cited alongside, same era.
Experience replay for continual learning
David Rolnick, Arun Ahuja, Jonathan Schwarz, Timothy Lillicrap, and Gregory Wayne. 2019 · 2019
Cited alongside, same era.
Preserving cross-linguality of pre-trained models via continual learning
Zihan Liu, Genta Indra Winata, Andrea Madotto, and Pascale Fung. 2021 · 2021
Later among the works it cites.
Continual learning in task-oriented dialogue systems
Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul A Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Pascale Fung, and Zhiguang Wang. 2021 · 2021
Later among the works it cites.
Continual learning for named entity recognition
Natawut Monaikul, Giuseppe Castellucci, Simone Filice, and Oleg Rokhlenko. 2021 · 2021
Later among the works it cites.
Pretrained language model in continual learning: A comparative study
Tongtong Wu, Massimo Caccia, Zhuang Li, Yuan-Fang Li, Guilin Qi, and Gholamreza Haffari. 2021 · 2021
Later among the works it cites.
Jack FitzGerald, Christopher Hench, Charith Peris, Scott Mackie, Kay Rottmann, Ana Sanchez, Aaron Nash, Liam Urbach, Vishesh Kakarala, Richa Singh, et al. 2022 · 2022
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Unsupervised cross-lingual representation learning at scale
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Édouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020 · 2020
Cited alongside, same era.
Learn continually, generalize rapidly: Lifelong knowledge accumulation for few-shot learning
Xisen Jin, Bill Yuchen Lin, Mohammad Rostami, and Xiang Ren. 2021 · 2021
Cited alongside, same era.
Continual lifelong learning in natural language processing: A survey
Magdalena Biesialska, Katarzyna Biesialska, and Marta R Costa-jussà. 2020a
Cited in the paper.
Continual lifelong learning in natural language processing: A survey
Magdalena Biesialska, Katarzyna Biesialska, and Marta R. Costa-jussà. 2020b
Cited in the paper.
Later among the works it cites.
Cross-lingual lifelong learning
Meryem M’hamdi, Xiang Ren, and Jonathan May. 2022 · 2022
Later among the works it cites.
Average is not enough: Caveats of multilingual evaluation
Matúš Pikuliak and Marian Simko. 2022 · 2022
Later among the works it cites.