Toward Zero-Shot Instruction Following

Language Models are Few-shot Learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

A Study of the Effect of Resolving Negation and Sentiment Analysis in Recognizing Text Entailment for Arabic

Original

Fatima T. AL-Khawaldeh. 2019 · 1907

Earlier work this paper cites.

RoBERTa: A Robustly Optimized Bert Pretraining Approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Contributions of transformer attention heads in multi-and cross-lingual tasks

Weicheng Ma, Kai Zhang, Renze Lou, Lili Wang, and Soroush Vosoughi. 2021b · 1966

Earlier work this paper cites.

Long Short-Term Memory

Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997

Earlier work this paper cites.

Policy Gradient Methods for Reinforcement Learning with Function Approximation

Richard S Sutton, David McAllester, Satinder Singh, and Yishay Mansour. 1999 · 1999

Earlier work this paper cites.

Rouge: A Package for Automatic Evaluation of Summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Adam: A Method for Stochastic Optimization

Original

Diederik P Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

Pointer Networks

Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015 · 2015

Earlier work this paper cites.

The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables

Original

Chris J Maddison, Andriy Mnih, and Yee Whye Teh. 2016 · 2016

Earlier work this paper cites.

SQuAD: 100,000+ Questions for Machine Comprehension of Text

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

SQuAD: 100,000+ Questions for Machine Comprehension of Text

Original

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

Get To The Point: Summarization with Pointer-Generator Networks

Abigail See, Peter J Liu, and Christopher D Manning. 2017 · 2017

Earlier work this paper cites.

Attention is All You Need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient

Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. 2017 · 2017

Earlier work this paper cites.

Language Models are Unsupervised Multitask Learners

Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Earlier work this paper cites.

Ranked List Loss for Deep Metric Learning

Xinshao Wang, Yang Hua, Elyor Kodirov, Guosheng Hu, Romain Garnier, and Neil M Robertson. 2019 · 2019

Cited alongside, same era.

Exploring the Limits of Transfer Learning with a Unified Text-To-Text Transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu, et al. 2020 · 2020

Cited alongside, same era.

Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models

Mengnan Du, Varun Manjunatha, Rajiv Jain, Ruchi Deshpande, Franck Dernoncourt, Jiuxiang Gu, Tong Sun, and Xia Hu. 2021 · 2021

Cited alongside, same era.

Improving Empathetic Response Generation by Recognizing Emotion Cause in Conversations

Jun Gao, Yuhan Liu, Haolin Deng, Wei Wang, Yu Cao, Jiachen Du, and Ruifeng Xu. 2021 · 2021

Cited alongside, same era.

Gradts: A gradient-based automatic auxiliary task selection method based on transformer networks

Weicheng Ma, Renze Lou, Kai Zhang, Lili Wang, and Soroush Vosoughi. 2021a · 2021

Cited alongside, same era.

MetaICL: Learning to Learn In Context

Sewon Min, Mike Lewis, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2022b · 2022

Later among the works it cites.

Cross-Task Generalization via Natural Language Crowdsourcing Instructions

Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi. 2022 · 2022

Later among the works it cites.

Improving English-Arabic transliteration with phonemic memories

Yuanhe Tian, Renze Lou, Xiangyu Pang, Lianxi Wang, Shengyi Jiang, and Yan Song. 2022 · 2022

Later among the works it cites.

Super-NaturalInstructions: Generalization via declarative instructions on 1600+ NLP tasks

Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi, Yeganeh Kordi, Amirreza Mirzaei, Atharva Naik, Arjun Ashok, Arut Selvan Dhanasekaran, Anjana Arunkumar, David Stap, Eshaan Pathak, Giannis Karamanolakis, Haizhi Lai, Ishan Purohit, Ishani Mondal, Jacob Anderson, Kirby Kuznia, Krima Doshi, Kuntal Kumar Pal, Maitreya Patel, Mehrad Moradshahi, Mihir Parmar, Mirali Purohit, Neeraj Varshney, Phani Rohitha Kaza, Pulkit Verma, Ravsehaj Singh Puri, Rushang Karia, Savan Doshi, Shailaja Keyur Sampat, Siddhartha Mishra, Sujan Reddy A, Sumanta Patro, Tanay Dixit, and Xudong Shen. 2022b · 2022

Later among the works it cites.

Do Prompt-based Models Really Understand the Meaning of Their Prompts?