Understand
Linguistic ambiguity is and has always been one of the main challenges in Natural Language Processing (NLP) systems.
- Modern Transformer architectures like BERT, T5 or more recently InstructGPT have achieved some impressive improvements in many NLP fields, but there is still plenty of work to do.
- Motivated by the uproar caused by ChatGPT, in this paper we provide an introduction to linguistic ambiguity, its varieties and their relevance in modern NLP, and perform an extensive empiric analysis.
- ChatGPT strengths and weaknesses are revealed, as well as strategies to get the most of this model.
Built on
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D. Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, and Amanda Askell. 2020 · 1901
Earlier work this paper cites.
A study on NLP appliactions and ambiguity problems
Shaidah Jusoh. 2018 · 1992
Earlier work this paper cites.
A survey on contextual embeddings
Qi Liu, Matt J Kusner, and Phil Blunsom. 2020 · 2003
Earlier work this paper cites.
Language (technology) is power: A critical survey of" bias" in nlp
Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020 · 2005
Earlier work this paper cites.
Similar
Efficient estimation of word representations in vector space
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013 · 2013
Cited alongside, same era.
Addressing the challenges of requirements ambiguity: A review of empirical literature
Muneera Bano. 2015 · 2015
Cited alongside, same era.
Gender bias in coreference resolution: Evaluation and debiasing methods
Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2018 · 2018
Cited alongside, same era.
Speech and language processing (3rd draft ed.)
Dan Jurafsky and James H. Martin. 2020 · 2020
Cited alongside, same era.
Then
Deep learning enabled semantic communication systems
Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li, and Biing-Hwang Juang. 2021 · 2021
Later among the works it cites.
Training language models to follow instructions with human feedback
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, and Alex Ray. 2022 · 2022
Later among the works it cites.
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava et al. 2022 · 2022
Later among the works it cites.
Beyond the bibliography
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…