Fetching the paper…
Reading the bibliography…
Recent work has demonstrated that pre-training in-domain language models can boost performance when adapting to a new domain.
A Theory of the Allocation of Time
Gary S Becker. 1965 · 1965
Earlier work this paper cites.
A New Approach to Consumer Theory
Kelvin J Lancaster. 1966 · 1966
Earlier work this paper cites.
Combining Labeled and Unlabeled Data with Co-training
Avrim Blum and Tom Mitchell. 1998 · 1998
Earlier work this paper cites.
Domain Adaptation with Structural Correspondence Learning
John Blitzer, Ryan McDonald, and Fernando Pereira. 2006 · 2006
Earlier work this paper cites.
Domain Adaptation for Statistical Classifiers
Hal Daume III and Daniel Marcu. 2006 · 2006
Earlier work this paper cites.
Frustratingly Easy Domain Adaptation
Hal Daumé III. 2007 · 2007
Earlier work this paper cites.
Extraction of Chemical Structures and Reactions from the Literature
Daniel M. Lowe. 2012 · 2012
Earlier work this paper cites.
Adam: A Method for Stochastic Optimization
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
Globally Coherent Text Generation with Neural Checklist Models
Chloé Kiddon, Luke Zettlemoyer, and Yejin Choi. 2016 · 2016
Earlier work this paper cites.
Frustratingly Easy Neural Domain Adaptation
Young-Bum Kim, Karl Stratos, and Ruhi Sarikaya. 2016 · 2016
Earlier work this paper cites.
Experiment Segmentation in Scientific Discourse as Clause-level Structured Prediction using Recurrent Neural Networks
Pradeep Dasigi, G. Burns, E. Hovy, and A. D. Waard. 2017 · 2017
Earlier work this paper cites.
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei A Efros, and Trevor Darrell. 2018 · 2018
Earlier work this paper cites.
SciBERT: A Pretrained Language Model for Scientific Text
Iz Beltagy, Kyle Lo, and Arman Cohan. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Effective Use of Transformer Networks for Entity Tracking
Aditya Gupta and Greg Durrett. 2019 · 2019
Cited alongside, same era.
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
Xiaochuang Han and Jacob Eisenstein. 2019 · 2019
Cited alongside, same era.
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, M. Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 2019
Cited alongside, same era.
Knowledge Enhanced Contextual Word Representations
Matthew E. Peters, Mark Neumann, Robert Logan, Roy Schwartz, Vidur Joshi, Sameer Singh, and Noah A. Smith. 2019 · 2019
Green AI
Roy Schwartz, Jesse Dodge, N. A. Smith, and Oren Etzioni. 2020 · 2020
Later among the works it cites.
mgsohrab at WNUT 2020 Shared Task-1: Neural Exhaustive Approach for Entity and Relation Recognition Over Wet Lab Protocols
Mohammad Golam Sohrab, Anh-Khoa Duong Nguyen, Makoto Miwa, and Hiroya Takamura. 2020 · 2020
Later among the works it cites.
WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols
Jeniya Tabassum, Wei Xu, and Alan Ritter. 2020 · 2020
Later among the works it cites.
Melaxtech: A Report for CLEF 2020 - ChEMU Task of Chemical Reaction Extraction from Patent
Jingqi Wang, Yuankai Ren, Zhi Zhang, and Yaoyun Zhang. 2020 · 2020
Later among the works it cites.
Transformer Based Multi-Source Domain Adaptation
Dustin Wright and Isabelle Augenstein. 2020 · 2020
Later among the works it cites.
A Frustratingly Easy Approach for Joint Entity and Relation Extraction
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Energy and Policy Considerations for Deep Learning in NLP
Emma Strubell, Ananya Ganesh, and Andrew McCallum. 2019 · 2019
Cited alongside, same era.
MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification
Jiaao Chen, Zichao Yang, and Diyi Yang. 2020 · 2020
Cited alongside, same era.
Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks
Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020 · 2020
Cited alongside, same era.
BiTeM at WNUT 2020 Shared Task-1: Named Entity Recognition over Wet Lab Protocols using an Ensemble of Contextual Language Models
Julien Knafou, Nona Naderi, Jenny Copara, Douglas Teodoro, and Patrick Ruch. 2020 · 2020
Cited alongside, same era.
ChEMU: Named Entity Recognition and Event Extraction of Chemical Reactions from Patents
Dat Quoc Nguyen, Zenan Zhai, Hiyori Yoshikawa, Biaoyan Fang, Christian Druckenbrodt, Camilo Thorne, Ralph Hoessel, S. Akhondi, Trevor Cohn, Timothy Baldwin, and K. Verspoor. 2020 · 2020
Cited alongside, same era.
Zexuan Zhong and Danqi Chen. 2020 · 2020
Later among the works it cites.
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021 · 2021
Closest in time.
How to Train BERT with an Academic Budget
Peter Izsak, Moshe Berchansky, and Omer Levy. 2021 · 2021
Closest in time.
Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images
Javier Marín, A. Biswas, Ferda Ofli, Nick Hynes, A. Salvador, Yusuf Aytar, Ingmar Weber, and A. Torralba. 2021 · 2021
Closest in time.
Carbon Emissions and Large Neural Network Training
David Patterson, Joseph Gonzalez, Quoc Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David So, Maud Texier, and Jeff Dean. 2021 · 2021
Closest in time.
Process-Level Representation of Scientific Protocols with Interactive Annotation
Ronen Tamari, Fan Bai, Alan Ritter, and Gabriel Stanovsky. 2021 · 2021
Closest in time.