A Complete Survey on LLM-based AI Chatbots · Around

Fetching the paper…

A Complete Survey on LLM-based AI Chatbots · Around

Built on

W. H. Kruskal and W. A. Wallis, “Use of ranks in one-criterion variance analysis,” Journal of the American statistical Association , vol. 47, no. 260, pp. 583–621, 1952
1952
Earlier work this paper cites.
J. Weizenbaum, “Eliza—a computer program for the study of natural language communication between man and machine,” Communications of the ACM , vol. 9, no. 1, pp. 36–45, 1966
1966
Earlier work this paper cites.
K. M. Colby, S. Weber, and F. D. Hilf, “Artificial paranoia,” Artificial intelligence , vol. 2, no. 1, pp. 1–25, 1971
1971
Earlier work this paper cites.
K. M. Colby, “Modeling a paranoid mind,” Behavioral and Brain Sciences , vol. 4, no. 4, pp. 515–534, 1981
1981
Earlier work this paper cites.
D. Weininger, “Smiles, a chemical language and information system. 1. introduction to methodology and encoding rules,” Journal of chemical information and computer sciences , vol. 28, no. 1, pp. 31–36, 1988
1988
Earlier work this paper cites.
A. Kerlyl, P. Hall, and S. Bull, “Bringing chatbots into education: Towards natural language negotiation of open learner models,” in International conference on innovative techniques and applications of artificial intelligence . Springer, 2006, pp. 179–192
2006
Earlier work this paper cites.
B. A. Shawar and E. Atwell, “Fostering language learner autonomy through adaptive conversation tutors,” in Proceedings of the The fourth Corpus Linguistics conference , vol. 3, 2007, pp. 186–193
2007
Earlier work this paper cites.
A. M. Turing, Computing machinery and intelligence . Springer, 2009
2009
Earlier work this paper cites.
R. S. Wallace, The anatomy of ALICE . Springer, 2009
2009
Earlier work this paper cites.
O. Deryugina, “Chatterbots,” Scientific and Technical Information Processing , vol. 37, pp. 143–147, 2010
2010
Earlier work this paper cites.
J. Aron, “How innovative is apple’s new voice assistant, siri?” 2011
2011
Earlier work this paper cites.
L. Bradeško and D. Mladenić, “A survey of chatbot systems through a loebner prize competition,” in Proceedings of Slovenian language technologies society eighth conference of language technologies , vol. 2. sn, 2012, pp. 34–37
2012
Earlier work this paper cites.
R. High, “The era of cognitive systems: An inside look at ibm watson and how it works,” IBM Corporation, Redbooks , vol. 1, p. 16, 2012
2012
Earlier work this paper cites.
G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531 , 2015
Original
2015
Earlier work this paper cites.
Y. Chen, J. E. Argentinis, and G. Weber, “Ibm watson: how cognitive computing can be applied to big data challenges in life sciences research,” Clinical therapeutics , vol. 38, no. 4, pp. 688–701, 2016
2016
Earlier work this paper cites.
R. Kirk, S. Simpson Matthew, M. Voorhees Ellen, and R. Hersh William, “Overview of the trec 2016 clinical decision support track,” in Proceedings of the 15th Text Retrieval Conference , 2016
2016
Earlier work this paper cites.
H. Harkous, K. Fawaz, K. G. Shin, and K. Aberer, “ { \{ PriBots } \} : Conversational privacy with chatbots,” in Twelfth Symposium on Usable Privacy and Security (SOUPS 2016) , 2016
2016
Earlier work this paper cites.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017
2017
Earlier work this paper cites.
Y. Cheng, D. Wang, P. Zhou, and T. Zhang, “A survey of model compression and acceleration for deep neural networks,” arXiv preprint arXiv:1710.09282 , 2017
Original
2017
Earlier work this paper cites.
H.-Y. Shum, X.-d. He, and D. Li, “From eliza to xiaoice: challenges and opportunities with social chatbots,” Frontiers of Information Technology & Electronic Engineering , vol. 19, pp. 10–26, 2018
2018
Earlier work this paper cites.
M. B. Hoy, “Alexa, siri, cortana, and more: an introduction to voice assistants,” Medical reference services quarterly , vol. 37, no. 1, pp. 81–88, 2018
2018
Earlier work this paper cites.
V. Kepuska and G. Bohouta, “Next-generation of virtual personal assistants (microsoft cortana, apple siri, amazon alexa and google home),” in 2018 IEEE 8th annual computing and communication workshop and conference (CCWC) . IEEE, 2018, pp. 99–103
2018
Earlier work this paper cites.
A. Radford, K. Narasimhan, T. Salimans, I. Sutskever et al. , “Improving language understanding by generative pre-training,” 2018
2018
Earlier work this paper cites.
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018
Original
2018
Earlier work this paper cites.
P. Sharma, N. Ding, S. Goodman, and R. Soricut, “Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2018, pp. 2556–2565
2018
Earlier work this paper cites.
M. T. Zemčík, “A brief history of chatbots,” DEStech Transactions on Computer Science and Engineering , vol. 10, 2019
2019
Earlier work this paper cites.
A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al. , “Language models are unsupervised multitask learners,” OpenAI blog , vol. 1, no. 8, p. 9, 2019
2019
Earlier work this paper cites.
L. Dong, N. Yang, W. Wang, F. Wei, X. Liu, Y. Wang, J. Gao, M. Zhou, and H.-W. Hon, “Unified language model pre-training for natural language understanding and generation,” Advances in neural information processing systems , vol. 32, 2019
2019
Earlier work this paper cites.
C. Rudin, “Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead,” Nature machine intelligence , vol. 1, no. 5, pp. 206–215, 2019
2019
Earlier work this paper cites.
M. Phillips, H. Marsden, W. Jaffe, R. N. Matin, G. N. Wali, J. Greenhalgh, E. McGrath, R. James, E. Ladoyanni, A. Bewley et al. , “Assessment of accuracy of an artificial intelligence algorithm to detect melanoma in images of skin lesions,” JAMA network open , vol. 2, no. 10, pp. e1 913 436–e1 913 436, 2019
2019
Earlier work this paper cites.
X. Jiao, Y. Yin, L. Shang, X. Jiang, X. Chen, L. Li, F. Wang, and Q. Liu, “Tinybert: Distilling bert for natural language understanding,” arXiv preprint arXiv:1909.10351 , 2019
Original
2019
Earlier work this paper cites.
T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020
2020
Earlier work this paper cites.
S. Ayanouz, B. A. Abdelhakim, and M. Benhmed, “A smart chatbot architecture based nlp and machine learning for health care assistance,” in Proceedings of the 3rd international conference on networking, information systems & security , 2020, pp. 1–6
2020
Earlier work this paper cites.
L. Athota, V. K. Shukla, N. Pandey, and A. Rana, “Chatbot for healthcare system using artificial intelligence,” in 2020 8th International conference on reliability, infocom technologies and optimization (trends and future directions)(ICRITO) . IEEE, 2020, pp. 619–622
2020
Earlier work this paper cites.
S. Singh and H. K. Thakur, “Survey of various ai chatbots based on technology used,” in 2020 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions)(ICRITO) . IEEE, 2020, pp. 1074–1079
2020
Earlier work this paper cites.
E. Adamopoulou and L. Moussiades, “Chatbots: History, technology, and applications,” Machine Learning with Applications , vol. 2, p. 100006, 2020
2020
Earlier work this paper cites.
L. Zhou, J. Gao, D. Li, and H.-Y. Shum, “The design and implementation of xiaoice, an empathetic social chatbot,” Computational Linguistics , vol. 46, no. 1, pp. 53–93, 2020
2020
Earlier work this paper cites.
T. Wolf, L. Debut, V. Sanh, J. Chaumond, C. Delangue, A. Moi, P. Cistac, T. Rault, R. Louf, M. Funtowicz et al. , “Transformers: State-of-the-art natural language processing,” in Proceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations , 2020, pp. 38–45
2020
Earlier work this paper cites.
J. Kaplan, S. McCandlish, T. Henighan, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei, “Scaling laws for neural language models,” arXiv preprint arXiv:2001.08361 , 2020
Original
2020
Earlier work this paper cites.
D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt, “Measuring massive multitask language understanding,” arXiv preprint arXiv:2009.03300 , 2020
Original
2020
Earlier work this paper cites.
Z. Sun, H. Yu, X. Song, R. Liu, Y. Yang, and D. Zhou, “Mobilebert: a compact task-agnostic bert for resource-limited devices,” arXiv preprint arXiv:2004.02984 , 2020
Original
2020
Earlier work this paper cites.
M. A. Gordon, K. Duh, and N. Andrews, “Compressing bert: Studying the effects of weight pruning on transfer learning,” arXiv preprint arXiv:2002.08307 , 2020
Original
2020
Earlier work this paper cites.
T. Chen, J. Frankle, S. Chang, S. Liu, Y. Zhang, Z. Wang, and M. Carbin, “The lottery ticket hypothesis for pre-trained bert networks,” Advances in neural information processing systems , vol. 33, pp. 15 834–15 846, 2020
2020
Earlier work this paper cites.
S. Shen, Z. Dong, J. Ye, L. Ma, Z. Yao, A. Gholami, M. W. Mahoney, and K. Keutzer, “Q-bert: Hessian based ultra low precision quantization of bert,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 34, no. 05, 2020, pp. 8815–8821
2020
Earlier work this paper cites.
H. Bai, W. Zhang, L. Hou, L. Shang, J. Jin, X. Jiang, Q. Liu, M. Lyu, and I. King, “Binarybert: Pushing the limit of bert quantization,” arXiv preprint arXiv:2012.15701 , 2020
Original
2020
Earlier work this paper cites.
R. Schwartz, J. Dodge, N. A. Smith, and O. Etzioni, “Green ai,” Communications of the ACM , vol. 63, no. 12, pp. 54–63, 2020
2020
Earlier work this paper cites.
T. Bolton, T. Dargahi, S. Belguith, M. S. Al-Rakhami, and A. H. Sodhro, “On the security and privacy challenges of virtual assistants,” Sensors , vol. 21, no. 7, p. 2312, 2021
2021
Earlier work this paper cites.
J. Wei, M. Bosma, V. Y. Zhao, K. Guu, A. W. Yu, B. Lester, N. Du, A. M. Dai, and Q. V. Le, “Finetuned language models are zero-shot learners,” arXiv preprint arXiv:2109.01652 , 2021
Original
2021
Earlier work this paper cites.
V. Sanh, A. Webson, C. Raffel, S. H. Bach, L. Sutawika, Z. Alyafeai, A. Chaffin, A. Stiegler, T. L. Scao, A. Raja et al. , “Multitask prompted training enables zero-shot task generalization,” arXiv preprint arXiv:2110.08207 , 2021
Original
2021
Earlier work this paper cites.
D. Dai, L. Dong, Y. Hao, Z. Sui, B. Chang, and F. Wei, “Knowledge neurons in pretrained transformers,” arXiv preprint arXiv:2104.08696 , 2021
Original
2021
Earlier work this paper cites.
E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, “On the dangers of stochastic parrots: Can language models be too big?” in Proceedings of the 2021 ACM conference on fairness, accountability, and transparency , 2021, pp. 610–623
2021
Earlier work this paper cites.
M. Hasal, J. Nowaková, K. Ahmed Saghair, H. Abdulla, V. Snášel, and L. Ogiela, “Chatbots: Security, privacy, data protection, and social aspects,” Concurrency and Computation: Practice and Experience , vol. 33, no. 19, p. e6426, 2021
2021
Earlier work this paper cites.
D. Song, E. Y. Oh, and H. Hong, “The impact of teaching simulation using student chatbots with different attitudes on preservice teachers’ efficacy,” Educational Technology & Society , vol. 25, no. 3, pp. 46–59, 2022
2022
Earlier work this paper cites.
D. Lee and S. Yeo, “Developing an ai-based chatbot for practicing responsive teaching in mathematics,” Computers & Education , vol. 191, p. 104646, 2022
2022
Earlier work this paper cites.
A. Chowdhery, S. Narang, J. Devlin, M. Bosma, G. Mishra, A. Roberts, P. Barham, H. W. Chung, C. Sutton, S. Gehrmann et al. , “Palm: Scaling language modeling with pathways,” arXiv preprint arXiv:2204.02311 , 2022
Original
2022
Earlier work this paper cites.
B. Zhang, B. Ghorbani, A. Bapna, Y. Cheng, X. Garcia, J. Shen, and O. Firat, “Examining scaling and transfer of language model architectures for machine translation,” in International Conference on Machine Learning . PMLR, 2022, pp. 26 176–26 192
2022
Earlier work this paper cites.
L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray et al. , “Training language models to follow instructions with human feedback,” Advances in Neural Information Processing Systems , vol. 35, pp. 27 730–27 744, 2022
2022
Earlier work this paper cites.
J. Wei, X. Wang, D. Schuurmans, M. Bosma, E. Chi, Q. Le, and D. Zhou, “Chain of thought prompting elicits reasoning in large language models,” arXiv preprint arXiv:2201.11903 , 2022
Original
2022
Earlier work this paper cites.
R. Ali, O. Y. Tang, I. D. Connolly, J. S. Fridley, J. H. Shin, P. L. Z. Sullivan, D. Cielo, A. A. Oyelese, C. E. Doberstein, A. E. Telfeian et al. , “Performance of chatgpt, gpt-4, and google bard on a neurosurgery oral boards preparation question bank,” Neurosurgery , pp. 10–1227, 2022
2022
Earlier work this paper cites.
Y. Bai, S. Kadavath, S. Kundu, A. Askell, J. Kernion, A. Jones, A. Chen, A. Goldie, A. Mirhoseini, C. McKinnon et al. , “Constitutional ai: Harmlessness from ai feedback,” arXiv preprint arXiv:2212.08073 , 2022
Original
2022
Earlier work this paper cites.
Y. Bai, A. Jones, K. Ndousse, A. Askell, A. Chen, N. DasSarma, D. Drain, S. Fort, D. Ganguli, T. Henighan et al. , “Training a helpful and harmless assistant with reinforcement learning from human feedback,” arXiv preprint arXiv:2204.05862 , 2022
Original
2022
Earlier work this paper cites.
O. Topsakal and E. Topsakal, “Framework for a foreign language teaching software for children utilizing ar, voicebots and chatgpt (large language models),” The Journal of Cognitive Systems , vol. 7, no. 2, pp. 33–38, 2022
2022
Earlier work this paper cites.
Ö. Aydın and E. Karaarslan, “Openai chatgpt generated literature review: Digital twin in healthcare,” Available at SSRN 4308687 , 2022
2022
Earlier work this paper cites.
K. Meng, D. Bau, A. Andonian, and Y. Belinkov, “Locating and editing factual associations in gpt,” Advances in Neural Information Processing Systems , vol. 35, pp. 17 359–17 372, 2022
2022
Earlier work this paper cites.
P. Villalobos, J. Sevilla, L. Heim, T. Besiroglu, M. Hobbhahn, and A. Ho, “Will we run out of data? an analysis of the limits of scaling datasets in machine learning,” arXiv preprint arXiv:2211.04325 , 2022
Original
2022
Earlier work this paper cites.
P. Schramowski, C. Turan, N. Andersen, C. A. Rothkopf, and K. Kersting, “Large pre-trained language models contain human-like biases of what is right and wrong to do,” Nature Machine Intelligence , vol. 4, no. 3, pp. 258–268, 2022
2022
Earlier work this paper cites.
T. Susnjak, “Chatgpt: The end of online exam integrity?” arXiv preprint arXiv:2212.09292 , 2022
Original
2022
Earlier work this paper cites.
M. D. Abràmoff, B. Cunningham, B. Patel, M. B. Eydelman, T. Leng, T. Sakamoto, B. Blodi, S. M. Grenon, R. M. Wolf, A. K. Manrai et al. , “Foundational considerations for artificial intelligence using ophthalmic images,” Ophthalmology , vol. 129, no. 2, pp. e14–e32, 2022
2022
Earlier work this paper cites.
J. Wei, Y. Tay, R. Bommasani, C. Raffel, B. Zoph, S. Borgeaud, D. Yogatama, M. Bosma, D. Zhou, D. Metzler et al. , “Emergent abilities of large language models,” arXiv preprint arXiv:2206.07682 , 2022
Original
2022
Earlier work this paper cites.
A. Ahmed, N. Ali, M. Alzubaidi, W. Zaghouani, A. A. Abd-alrazaq, and M. Househ, “Freely available arabic corpora: A scoping review,” Computer Methods and Programs in Biomedicine Update , vol. 2, p. 100049, 2022
2022
Earlier work this paper cites.
A. Ahmed, N. Ali, M. Alzubaidi, W. Zaghouani, A. Abd-alrazaq, and M. Househ, “Arabic chatbot technologies: A scoping review,” Computer Methods and Programs in Biomedicine Update , vol. 2, p. 100057, 2022
2022
Earlier work this paper cites.
H. Beattie, L. Watkins, W. H. Robinson, A. Rubin, and S. Watkins, “Measuring and mitigating bias in ai-chatbots,” in 2022 IEEE International Conference on Assured Autonomy (ICAA) . IEEE, 2022, pp. 117–123
2022
Earlier work this paper cites.
X. Yang, A. Chen, N. PourNejatian, H. C. Shin, K. E. Smith, C. Parisien, C. Compas, C. Martin, A. B. Costa, M. G. Flores et al. , “A large language model for electronic health records,” NPJ Digital Medicine , vol. 5, no. 1, p. 194, 2022
2022
Earlier work this paper cites.
W. X. Zhao, K. Zhou, J. Li, T. Tang, X. Wang, Y. Hou, Y. Min, B. Zhang, J. Zhang, Z. Dong et al. , “A survey of large language models,” arXiv preprint arXiv:2303.18223 , 2023
Original
2023
Earlier work this paper cites.

Similar

C. Kooli, “Chatbots in education and research: A critical examination of ethical implications and solutions,” Sustainability , vol. 15, no. 7, p. 5614, 2023
2023
Cited alongside, same era.
A. Tlili, B. Shehata, M. A. Adarkwah, A. Bozkurt, D. T. Hickey, R. Huang, and B. Agyemang, “What if the devil is my guardian angel: Chatgpt as a case study of using chatbots in education,” Smart Learning Environments , vol. 10, no. 1, p. 15, 2023
2023
Cited alongside, same era.
A. Koubaa, W. Boulila, L. Ghouti, A. Alzahem, and S. Latif, “Exploring chatgpt capabilities and limitations: A critical review of the nlp game changer,” 2023
2023
Cited alongside, same era.
M. Sallam, “Chatgpt utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns,” in Healthcare , vol. 11, no. 6. MDPI, 2023, p. 887
2023
Cited alongside, same era.

Then

R. W. McGee, “Is chat gpt biased against conservatives? an empirical study,” An Empirical Study (February 15, 2023) , 2023
2023
Later among the works it cites.
J. Hartmann, J. Schwenzow, and M. Witte, “The political ideology of conversational ai: Converging evidence on chatgpt’s pro-environmental, left-libertarian orientation,” arXiv preprint arXiv:2301.01768 , 2023
Original
2023
Later among the works it cites.
S. McCallum, “Chatgpt banned in italy over privacy concerns,” BBC News , 2023
2023
Later among the works it cites.
M. Liebrenz, R. Schleifer, A. Buadze, D. Bhugra, and A. Smith, “Generating scholarly content with chatgpt: ethical challenges for medical publishing,” The Lancet Digital Health , vol. 5, no. 3, pp. e105–e106, 2023
2023
Later among the works it cites.
A. Shiri, “Chatgpt and academic integrity,” Information Matters , vol. 3, no. 2, 2023
2023

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…