Fetching the paper…
Reading the bibliography…
Recently, domain-specific PLMs have been proposed to boost the task performance of specific domains (e.g., biomedical and computer science) by continuing to pre-train general PLMs with domain-specific corpora.
Clinicalbert: Modeling clinical notes and predicting hospital readmission
Kexin Huang, Jaan Altosaar, and Rajesh Ranganath. 2019 · 1904
Earlier work this paper cites.
Roberta: A robustly optimized BERT pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019b · 1907
Earlier work this paper cites.
Catastrophic interference in connectionist networks: The sequential learning problem
Michael Mccloskey and Neil J. Cohen. 1989 · 1989
Earlier work this paper cites.
A fast and elitist multiobjective genetic algorithm: NSGA-II
Kalyanmoy Deb, Samir Agrawal, Amrit Pratap, and T. Meyarivan. 2002 · 2002
Earlier work this paper cites.
Large scale many-objective optimization driven by distributional adversarial networks
Zhenyu Liang, Yunfan Li, and Zhongwei Wan. 2020a · 2003
Earlier work this paper cites.
Many-objective estimation of distribution optimization algorithm based on wgan-gp
Zhenyu Liang, Yunfan Li, and Zhongwei Wan. 2020b · 2003
Earlier work this paper cites.
Introduction to the conll-2003 shared task: Language-independent named entity recognition
Erik Tjong Kim Sang and Fien De Meulder. 2003 · 2003
Earlier work this paper cites.
Learning word vectors for sentiment analysis
Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, A. Ng, and Christopher Potts. 2011 · 2011
Earlier work this paper cites.
Ncbi disease corpus: A resource for disease name recognition and concept normalization
Rezarta Islamaj Dogan, Robert Leaman, and Zhiyong Lu. 2014 · 2014
Earlier work this paper cites.
An empirical investigation of catastrophic forgeting in gradient-based neural networks
Ian J. Goodfellow, Mehdi Mirza, Xia Da, Aaron C. Courville, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Image-based recommendations on styles and substitutes
Julian McAuley, Christopher Targett, Qinfeng Shi, and Anton van den Hengel. 2015 · 2015
Earlier work this paper cites.
Character-level convolutional networks for text classification
Xiang Zhang, Junbo Jake Zhao, and Yann LeCun. 2015 · 2015
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil C. Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell. 2016 · 2016
Earlier work this paper cites.
Chemprot-3.0: a global chemical biology diseases mapping
Jens Kringelum, Sonny Kim Kjærulff, Søren Brunak, Ole Lund, Tudor I. Oprea, and Olivier Taboureau. 2016 · 2016
Earlier work this paper cites.
Zhizhong Li and Derek Hoiem. 2016 · 2016
Earlier work this paper cites.
Fine-tuning for neural machine translation with limited degradation across in-and out-of-domain data
Praveen Dakwale and Christof Monz. 2017 · 2017
Earlier work this paper cites.
Pubmed 200k rct: a dataset for sequential sentence classification in medical abstracts
Franck Dernoncourt and Ji Young Lee. 2017 · 2017
Earlier work this paper cites.
Newsqa: A machine comprehension dataset
Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, and Kaheer Suleman. 2017 · 2017
Earlier work this paper cites.
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Measuring the evolution of a scientific field through citation frames
David Jurgens, Srijan Kumar, Raine Hoover, Daniel A. McFarland, and Dan Jurafsky. 2018 · 2018
Cited alongside, same era.
Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction
Yi Luan, Luheng He, Mari Ostendorf, and Hannaneh Hajishirzi. 2018 · 2018
Cited alongside, same era.
emrqa: A large corpus for question answering on electronic medical records
Anusri Pampari, Preethi Raghavan, Jennifer J. Liang, and Jian Peng. 2018 · 2018
Cited alongside, same era.
Efficient neural architecture search via parameter sharing
Hieu Pham, Melody Y. Guan, Barret Zoph, Quoc V. Le, and Jeff Dean. 2018 · 2018
Cited alongside, same era.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018 · 2018
Cited alongside, same era.
Training verifiers to solve math word problems
Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021
Later among the works it cites.
Flattening sharpness for dynamic gradient projection memory benefits continual learning
Danruo Deng, Guangyong Chen, Jianye Hao, Qiong Wang, and Pheng-Ann Heng. 2021 · 2021
Later among the works it cites.
Back-translated task adaptive pretraining: Improving accuracy and robustness on text classification
Junghoon Lee, Jounghee Kim, and Pilsung Kang. 2021 · 2021
Later among the works it cites.
Align before fuse: Vision and language representation learning with momentum distillation
Junnan Li, Ramprasaath R. Selvaraju, Akhilesh Gotmare, Shafiq R. Joty, Caiming Xiong, and Steven Chu-Hong Hoi. 2021 · 2021
Later among the works it cites.
Task-adaptive pre-training of language models with word embedding regularization
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Iz Beltagy, Kyle Lo, and Arman Cohan. 2019 · 2019
Cited alongside, same era.
BERT: pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Semeval-2019 task 4: Hyperpartisan news detection
Johannes Kiesel, Maria Mestre, Rishabh Shukla, Emmanuel Vincent, Payam Adineh, D. Corney, Benno Stein, and Martin Potthast. 2019 · 2019
Cited alongside, same era.
Efficientnet: Rethinking model scaling for convolutional neural networks
Mingxing Tan and Quoc V. Le. 2019 · 2019
Cited alongside, same era.
Overcoming catastrophic forgetting during domain adaptation of neural machine translation
Brian Thompson, Jeremy Gwinnup, Huda Khayrallah, Kevin Duh, and Philipp Koehn. 2019 · 2019
Cited alongside, same era.
Recall and learn: Fine-tuning deep pretrained language models with less forgetting
Sanyuan Chen, Yutai Hou, Yiming Cui, Wanxiang Che, Ting Liu, and Xiangzhan Yu. 2020 · 2020
Cited alongside, same era.
Improved schemes for episodic memory-based lifelong learning
Yunhui Guo, Mingrui Liu, Tianbao Yang, and Tajana Rosing. 2020 · 2020
Cited alongside, same era.
Kosuke Nishida, Kyosuke Nishida, and Sen Yoshida. 2021 · 2021
Later among the works it cites.
Fine-tuned transformers show clusters of similar representations across layers
Jason Phang, Haokun Liu, and Samuel R. Bowman. 2021 · 2021
Later among the works it cites.
Gradient projection memory for continual learning
Gobinda Saha, Isha Garg, and Kaushik Roy. 2021 · 2021
Later among the works it cites.
Importance-based neuron allocation for multilingual neural machine translation
Wanying Xie, Yang Feng, Shuhao Gu, and Dong Yu. 2021 · 2021
Later among the works it cites.
Multi-grained vision language pre-training: Aligning texts with visual concepts
Yan Zeng, Xinsong Zhang, and Hang Li. 2021 · 2021
Later among the works it cites.
KALA: knowledge-augmented language model adaptation
Minki Kang, Jinheon Baek, and Sung Ju Hwang. 2022 · 2022
Closest in time.
Standing on the shoulders of giant frozen language models
Yoav Levine, Itay Dalmedigos, Ori Ram, Yoel Zeldes, Daniel Jannai, Dor Muhlgay, Yoni Osin, Opher Lieber, Barak Lenz, Shai Shalev-Shwartz, Amnon Shashua, Kevin Leyton-Brown, and Yoav Shoham. 2022 · 2022
Closest in time.
Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, and Michael Zeng. 2022 · 2022
Closest in time.
Yuhuai Wu, Markus N. Rabe, DeLesley Hutchins, and Christian Szegedy. 2022 · 2022
Closest in time.
Self-consistent reasoning for solving math word problems
Jing Xiong, Zhongwei Wan, Xiping Hu, Min Yang, and Chengming Li. 2022 · 2022
Closest in time.
Etp: Learning transferable ecg representations via ecg-text pre-training
Che Liu, Zhongwei Wan, Sibo Cheng, Mi Zhang, and Rossella Arcucci. 2023 · 2023
Closest in time.
Text classification: A perspective of deep learning methods
Zhongwei Wan. 2023 · 2023
Closest in time.
Med-unic: Unifying cross-lingual medical vision-language pre-training by diminishing bias
Zhongwei Wan, Che Liu, Mi Zhang, Jie Fu, Benyou Wang, Sibo Cheng, Lei Ma, César Quilodrán-Casas, and Rossella Arcucci. 2024 · 2024
Closest in time.
Iot in the era of generative ai: Vision and challenges
Xin Wang, Zhongwei Wan, Arvin Hekmati, Mingyu Zong, Samiul Alam, Mi Zhang, and Bhaskar Krishnamachari. 2024 · 2024
Closest in time.