Fetching the paper…
Reading the bibliography…
Pre-trained Language Models (PLMs) have achieved remarkable performance for various language understanding tasks in IR systems, which require the fine-tuning process based on labeled training data.
Mining and summarizing customer reviews. In SIGKDD . 168–177
Minqing Hu and Bing Liu. 2004 · 2004
Earlier work this paper cites.
A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts. In ACL . 271–278
Bo Pang and Lillian Lee. 2004 · 2004
Earlier work this paper cites.
Automatically Constructing a Corpus of Sentential Paraphrases. In IWP@IJCNLP
William B. Dolan and Chris Brockett. 2005 · 2005
Earlier work this paper cites.
Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales. In ACL . 115–124
Bo Pang and Lillian Lee. 2005 · 2005
Earlier work this paper cites.
Visualizing Data using t-SNE
Laurens van der Maaten and Geoffrey Hinton. 2008 · 2008
Earlier work this paper cites.
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank. In EMNLP . 1631–1642
Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. 2013 · 2013
Earlier work this paper cites.
Benchmarking Applied Semantic Inference: The PASCAL Recognising Textual Entailment Challenges. In Language, Culture, Computation. Computing - Theory and Technology , Vol. 8001. 409–424
Roy Bar-Haim, Ido Dagan, and Idan Szpektor. 2014 · 2014
Earlier work this paper cites.
Adam: A Method for Stochastic Optimization. In ICLR
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
FaceNet: A unified embedding for face recognition and clustering. In CVPR . 815–823
Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015 · 2015
Earlier work this paper cites.
SQuAD: 100, 000+ Questions for Machine Comprehension of Text. In EMNLP . 2383–2392
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016
Earlier work this paper cites.
Improved Deep Metric Learning with Multi-class N-pair Loss Objective. In NIPS . 1849–1857
Kihyuk Sohn. 2016 · 2016
Earlier work this paper cites.
Prototypical Networks for Few-shot Learning. In NIPS . 4077–4087
Jake Snell, Kevin Swersky, and Richard S. Zemel. 2017 · 2017
Earlier work this paper cites.
Deep Contextualized Word Representations. In NAACL-HLT . 2227–2237
Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018
Earlier work this paper cites.
Representation Learning with Contrastive Predictive Coding
Aäron van den Oord, Yazhe Li, and Oriol Vinyals. 2018 · 2018
Earlier work this paper cites.
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context. In ACL . 2978–2988
Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G. Carbonell, Quoc Viet Le, and Ruslan Salakhutdinov. 2019 · 2019
Earlier work this paper cites.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL . 4171–4186
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 2019
Cited alongside, same era.
Self-Supervised Learning for Contextualized Extractive Summarization. In ACL . 2221–2227
Hong Wang, Xin Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang, and William Yang Wang. 2019 · 2019
Cited alongside, same era.
Language Models are Few-Shot Learners. In NeurIPS
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2020
Cited alongside, same era.
Big Bird: Transformers for Longer Sequences. In NeurIPS
Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontañón, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, and Amr Ahmed. 2020 · 2020
Later among the works it cites.
SimCSE: Simple Contrastive Learning of Sentence Embeddings
Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021b · 2021
Later among the works it cites.
WARP: Word-level Adversarial ReProgramming. In ACL/IJCNLP . 4921–4933
Karen Hambardzumyan, Hrant Khachatrian, and Jonathan May. 2021 · 2021
Later among the works it cites.
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification
Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Juanzi Li, and Maosong Sun. 2021 · 2021
Later among the works it cites.
Self-Guided Contrastive Learning for BERT Sentence Representations. In ACL/IJCNLP . 2528–2540
Taeuk Kim, Kang Min Yoo, and Sang-goo Lee. 2021 · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ashish Jaiswal, Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Debapriya Banerjee, and Fillia Makedon. 2020 · 2020
Cited alongside, same era.
Improved prototypical networks for few-Shot learning
Zhong Ji, Xingliang Chai, Yunlong Yu, Yanwei Pang, and Zhongfei Zhang. 2020 · 2020
Cited alongside, same era.
How Can We Know What Language Models Know
Zhengbao Jiang, Frank F. Xu, Jun Araki, and Graham Neubig. 2020 · 2020
Cited alongside, same era.
Supervised Contrastive Learning. In NeurIPS
Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. 2020 · 2020
Cited alongside, same era.
Contrastive Self-Supervised Learning for Commonsense Reasoning. In ACL . 7517–7523
Tassilo Klein and Moin Nabi. 2020 · 2020
Cited alongside, same era.
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. In ICLR
Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2020 · 2020
Cited alongside, same era.
Pre-trained Models for Natural Language Processing: A Survey
Xipeng Qiu, Tianxiang Sun, Yige Xu, Yunfan Shao, Ning Dai, and Xuanjing Huang. 2020 · 2020
Cited alongside, same era.
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020
Cited alongside, same era.
Later among the works it cites.
Prefix-Tuning: Optimizing Continuous Prompts for Generation. In ACL/IJCNLP . 4582–4597
Xiang Lisa Li and Percy Liang. 2021 · 2021
Later among the works it cites.
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2021b · 2021
Later among the works it cites.
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
Xiao Liu, Kaixuan Ji, Yicheng Fu, Zhengxiao Du, Zhilin Yang, and Jie Tang. 2021a · 2021
Later among the works it cites.
Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, and Jie Tang. 2021c · 2021
Later among the works it cites.
IR From Bag-of-words to BERT and Beyond through Practical Experiments. In CIKM . 4861
Craig Macdonald, Nicola Tonellotto, and Sean MacAvaney. 2021 · 2021
Later among the works it cites.
Noisy Channel Language Model Prompting for Few-Shot Text Classification
Sewon Min, Mike Lewis, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2021 · 2021
Later among the works it cites.
How many data points is a prompt worth?. In NAACL . 2627–2636
Teven Le Scao and Alexander M. Rush. 2021 · 2021
Later among the works it cites.
A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection. In AAAI . 13815–13824
Tian Shi, Liuqing Li, Ping Wang, and Chandan K. Reddy. 2021 · 2021
Later among the works it cites.
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
Yu Sun, Shuohuan Wang, Shikun Feng, Siyu Ding, Chao Pang, Junyuan Shang, Jiaxiang Liu, Xuyi Chen, Yanbin Zhao, Yuxiang Lu, Weixin Liu, Zhihua Wu, Weibao Gong, Jianzhong Liang, Zhizhou Shang, Peng Sun, Wei Liu, Xuan Ouyang, Dianhai Yu, Hao Tian, Hua Wu, and Haifeng Wang. 2021 · 2021
Later among the works it cites.