Fetching the paper…
Reading the bibliography…
This paper discusses the current critique against neural network-based Natural Language Understanding (NLU) solutions known as language models.
Wenpeng Yin, J.H., Roth, D.: Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach · 1909
Earlier work this paper cites.
Basil Blackwell, Oxford (1953)
Wittgenstein, L.: Philosophical Investigations · 1953
Earlier work this paper cites.
Behavioral and Brain Sciences 3
Searle, J.R.: Minds, brains, and programs · 1980
Earlier work this paper cites.
The MIT Press, Cambridge, MA (1987)
Dennett, D.C.: The Intentional Stance · 1987
Earlier work this paper cites.
Little, Brown (1991)
Dennett, D.: Consciousness Explained · 1991
Earlier work this paper cites.
In: Brainchildren: Essays on Designing Minds. The MIT Press (1998)
Dennett, D.: The unimagined preposterousness of zombies · 1998
Earlier work this paper cites.
MIT Press (2004)
Ludlow, P., Nagasawa, Y., Stoljar, D.: There’s Something About Mary: Essays on Phenomenal Consciousness and Frank Jackson’s Knowledge Argument · 2004
Earlier work this paper cites.
In: Proceedings of the 25th International Conference on Machine Learning, ICML ’08, p. 160–167. Association for Computing Machinery, New York, NY, USA (2008)
Collobert, R., Weston, J.: A unified architecture for natural language processing: Deep neural networks with multitask learning · 2008
Earlier work this paper cites.
Italian Journal of Linguistics 20
Sahlgren, M.: The distributional hypothesis · 2008
Earlier work this paper cites.
In: Proc. of NAACL (2018)
Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., Zettlemoyer, L.: Deep contextualized word representations · 2018
Earlier work this paper cites.
In: Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pp. 353–355. Association for Computational Linguistics, Brussels, Belgium (2018)
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., Bowman, S.: GLUE: A multi-task benchmark and analysis platform for natural language understanding · 2018
Earlier work this paper cites.
In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics, Minneapolis, Minnesota (2019)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: Pre-training of deep bidirectional transformers for language understanding · 2019
Cited alongside, same era.
In: NeurIPS (2019)
Herdade, S., Kappeler, A., Boakye, K., Soares, J.: Image captioning: Transforming objects into words · 2019
Cited alongside, same era.
In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 3651–3657. Association for Computational Linguistics, Florence, Italy (2019)
Jawahar, G., Sagot, B., Seddah, D.: What does BERT learn about the structure of language? · 2019
Cited alongside, same era.
In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (2019)
Li, G., Zhu, L., Liu, P., Yang, Y.: Entangled transformer for image captioning · 2019
Cited alongside, same era.
Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D.M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., Amodei, D.: Language models are few-shot learners (2020)
2020
Later among the works it cites.
Transactions of the Association for Computational Linguistics 8
Ettinger, A.: What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models · 2020
Later among the works it cites.
Philosophy & Technology (2020)
Gastaldi, J.L.: Why can computers understand natural language? the structuralist image of language behind word embeddings · 2020
Later among the works it cites.
URL https://www.forbes.com/sites/bernardmarr/2020/10/05/what-is-gpt-3-and-why-is-it-revolutionizing-artificial-intelligence
Marr, B.: What is gpt-3 and why is it revolutionizing artificial intelligence? (2020) · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 1073–1094. Association for Computational Linguistics, Minneapolis, Minnesota (2019)
Liu, N.F., Gardner, M., Belinkov, Y., Peters, M.E., Smith, N.A.: Linguistic knowledge and transferability of contextual representations · 2019
Cited alongside, same era.
In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 3428–3448. Association for Computational Linguistics, Florence, Italy (2019)
McCoy, T., Pavlick, E., Linzen, T.: Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference · 2019
Cited alongside, same era.
In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 4658–4664. Association for Computational Linguistics, Florence, Italy (2019)
Niven, T., Kao, H.Y.: Probing neural network comprehension of natural language arguments · 2019
Cited alongside, same era.
In: International Conference on Learning Representations (2019)
Tenney, I., Xia, P., Chen, B., Wang, A., Poliak, A., McCoy, R.T., Kim, N., Durme, B.V., Bowman, S., Das, D., Pavlick, E.: What do you learn from context? probing for sentence structure in contextualized word representations · 2019
Cited alongside, same era.
In: H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché Buc, E. Fox, R. Garnett (eds.) Advances in Neural Information Processing Systems, vol. 32, pp. 3266–3280. Curran Associates, Inc. (2019)
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., Bowman, S.: Superglue: A stickier benchmark for general-purpose language understanding systems · 2019
Cited alongside, same era.
In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5185–5198. Association for Computational Linguistics, Online (2020)
Bender, E.M., Koller, A.: Climbing towards NLU: On meaning, form, and understanding in the age of data · 2020
Cited alongside, same era.
Bisk, Y., Holtzman, A., Thomason, J., Andreas, J., Bengio, Y., Chai, J., Lapata, M., Lazaridou, A., May, J., Nisnevich, A., Pinto, N., Turian, J.: Experience grounds language (2020)
2020
Cited alongside, same era.
In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 4885–4901. Association for Computational Linguistics, Online (2020)
Nie, Y., Williams, A., Dinan, E., Bansal, M., Weston, J., Kiela, D.: Adversarial NLI: A new benchmark for natural language understanding · 2020
Later among the works it cites.
Pitchstone Publishing (2020)
Pluckrose, H., Lindsay, J.: Cynical Theories: How Activist Scholarship Made Everything about Race, Gender, and Identity–And Why This Harms Everybody · 2020
Later among the works it cites.
In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 4902–4912. Association for Computational Linguistics, Online (2020)
Ribeiro, M.T., Wu, T., Guestrin, C., Singh, S.: Beyond accuracy: Behavioral testing of NLP models with CheckList · 2020
Later among the works it cites.
Transactions of the Association for Computational Linguistics 8
Rogers, A., Kovaleva, O., Rumshisky, A.: A primer in BERTology: What we know about how BERT works · 2020
Later among the works it cites.
In: International Conference on Learning Representations (2020)
Su, W., Zhu, X., Cao, Y., Li, B., Lu, L., Wei, F., Dai, J.: Vl-bert: Pre-training of generic visual-linguistic representations · 2020
Later among the works it cites.
URL https://www.ft.com/content/512cef1d-233b-4dd8-96a4-0af07bb9ff60
Thornhill, J.: Is AI finally closing in on human intelligence? (2020) · 2020
Later among the works it cites.
URL https://openai.com/blog/dall-e/
Ramesh, A., Pavlov, M., Goh, G., Gray, S., Chen, M., Child, R., Misra, V., Mishkin, P., Krueger, G., Agarwal, S., Sutskever, I.: Dall·e: Creating images from text (2021) · 2021
Closest in time.