A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting)

M. Ranzato, S. Chopra, M. Auli, and W. Zaremba, “Sequence level training with recurrent neural networks,” CoRR , vol. abs/1511.06732, 2015. [Online]. Available: https://api.semanticscholar.org/CorpusID:7147309

Original

2015

Earlier work this paper cites.

S. Bengio, O. Vinyals, N. Jaitly, and N. M. Shazeer, “Scheduled sampling for sequence prediction with recurrent neural networks,” ArXiv , vol. abs/1506.03099, 2015. [Online]. Available: https://api.semanticscholar.org/CorpusID:1820089

Original

2015

Earlier work this paper cites.

T. Chakraborty, G. Badie, and B. Rudder, “Reducing gender bias in word embeddings,” 2016. [Online]. Available: https://api.semanticscholar.org/CorpusID:12616116

2016

Earlier work this paper cites.

A. Vaswani, N. M. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” in NIPS , 2017. [Online]. Available: https://api.semanticscholar.org/CorpusID:13756489

2017

Earlier work this paper cites.

R. Paulus, C. Xiong, and R. Socher, “A deep reinforced model for abstractive summarization,” ArXiv , vol. abs/1705.04304, 2017. [Online]. Available: https://api.semanticscholar.org/CorpusID:21850704

Original

2017

Earlier work this paper cites.

P. F. Christiano, J. Leike, T. B. Brown, M. Martic, S. Legg, and D. Amodei, “Deep reinforcement learning from human preferences,” ArXiv , vol. abs/1706.03741, 2017. [Online]. Available: https://api.semanticscholar.org/CorpusID:4787508

Original

2017

Earlier work this paper cites.

B. Liu, G. Tür, D. Z. Hakkani-Tür, P. Shah, and L. Heck, “Dialogue learning with human teaching and feedback in end-to-end trainable task-oriented dialogue systems,” in North American Chapter of the Association for Computational Linguistics , 2018. [Online]. Available: https://api.semanticscholar.org/CorpusID:4938015

2018

Earlier work this paper cites.

B. Zhang, B. Lemoine, and M. Mitchell, “Mitigating unwanted biases with adversarial learning,” Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society , 2018. [Online]. Available: https://api.semanticscholar.org/CorpusID:9424845

2018

Earlier work this paper cites.

J. Howard and S. Ruder, “Universal language model fine-tuning for text classification,” in Annual Meeting of the Association for Computational Linguistics , 2018. [Online]. Available: https://api.semanticscholar.org/CorpusID:40100965

2018

Earlier work this paper cites.

M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, “Deep contextualized word representations,” in North American Chapter of the Association for Computational Linguistics , 2018. [Online]. Available: https://api.semanticscholar.org/CorpusID:3626819

2018

Cited alongside, same era.

J. Luketina, N. Nardelli, G. Farquhar, J. N. Foerster, J. Andreas, E. Grefenstette, S. Whiteson, and T. Rocktäschel, “A survey of reinforcement learning informed by natural language,” ArXiv , vol. abs/1906.03926, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:182952502

Original

2019

Cited alongside, same era.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” ArXiv , vol. abs/1810.04805, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:52967399

Original

2019

Cited alongside, same era.

Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi, D. Chen, O. Levy, M. Lewis, L. Zettlemoyer, and V. Stoyanov, “Roberta: A robustly optimized bert pretraining approach,” ArXiv , vol. abs/1907.11692, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:198953378

D. M. Ziegler, N. Stiennon, J. Wu, T. B. Brown, A. Radford, D. Amodei, P. Christiano, and G. Irving, “Fine-tuning language models from human preferences,” ArXiv , vol. abs/1909.08593, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:202660943

Original

2019

Later among the works it cites.

S. Jain and B. C. Wallace, “Attention is not explanation,” in North American Chapter of the Association for Computational Linguistics , 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:67855860

2019

Later among the works it cites.

A. Rahimi, Y. Li, and T. Cohn, “Massively multilingual transfer for ner,” in Annual Meeting of the Association for Computational Linguistics , 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:153313061

2019

Later among the works it cites.

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. J. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, “Language models are few-shot learners,” ArXiv , vol. abs/2005.14165, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:218971783