Fetching the paper…
Reading the bibliography…
This research compares large language model (LLM) fine-tuning methods, including Quantized Low Rank Adapter (QLoRA), Retrieval Augmented fine-tuning (RAFT), and Reinforcement Learning from Human Feedback (RLHF), and additionally compared LLM evaluation methods including End to End (E2E) benchmark method of "Golden Answers", traditional natural language processing (NLP) metrics, RAG Assessment (Ragas), OpenAI GPT-4 evaluation metrics, and human evaluation, using the travel chatbot use case.
C.-Y. Lin, “Rouge: A package for automatic evaluation of summaries,” ACL Anthology , Jul 2004. [Online]. Available: https://aclanthology.org/W04-1013
2004
Earlier work this paper cites.
2017
Earlier work this paper cites.
2018. [Online]. Available: https://www.reddit.com/dev/api/
2018
Earlier work this paper cites.
W. Maroengsit, T. Piyakulpinyo, K. Phonyiam, S. Pongnumkul, P. Chaovalit, and T. Theeramunkong, “A survey on evaluation methods for chatbots,” ICIET 2019: Proceedings of the 2019 7th International Conference on Information and Education Technology , 2019
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-t. Yih, T. Rocktäschel et al. , “Retrieval-augmented generation for knowledge-intensive nlp tasks,” Advances in Neural Information Processing Systems , vol. 33, pp. 9459–9474, 2020
2020
Earlier work this paper cites.
2020
Earlier work this paper cites.
J. Nayak, M. Mishra, B. Naik, H. Swapnarekha, K. Cengiz, and V. Shanmuganathan, “An impact study of covid-19 on six different industries: Automobile,” Expert Systems , vol. 39, no. 3, p. e12677, Mar 2022
2022
Earlier work this paper cites.
Y. Y. Nguwi, Ed., Tourism Analytics Before and After COVID-19 . Springer, 2022
2022
Earlier work this paper cites.
G. Caldarini, S. Jaf, and K. McGarry, “A literature survey of recent advances in chatbots,” Information , vol. 13, no. 1, 2022. [Online]. Available: https://doi.org/10.3390/info13010041
2022
Earlier work this paper cites.
2022
Earlier work this paper cites.
2022
Earlier work this paper cites.
U. Binggeli, Z. Chen, S. Köpke, and J. Yu. (2023, August) The future of tourism: Bridging the labor gap, enhancing customer experience. Accessed: 2023-09-15. [Online]. Available: https://www.mckinsey.com/industries/travel-logistics-and-infrastructure/our-insights/future-of-tourism-bridging-the-labor-gap-enhancing-customer-experience
2023
Earlier work this paper cites.
P. Peranzo. (2019) Ai assistant: The future of travel industry with the increase of artificial intelligence. Accessed: 2023-10-08. [Online]. Available: https://imaginovation.net/blog/the-future-of-travel-with-the-increase-of-ai/
2023
Earlier work this paper cites.
S. Pahune and M. Chandrasekharan, “Several categories of large language models (llms): A short survey,” International Journal for Research in Applied Science & Engineering Technology (IJRASET) , vol. 11, no. VII, Jul 2023, accessed: 2023-10-08. [Online]. Available: https://www.ijraset.com/
2023
Earlier work this paper cites.
2023
Earlier work this paper cites.
2023
Cited alongside, same era.
V. Iyer and M. Politi, “Rlhf training pipeline for llms,” https://vijayasriiyer.medium.com/rlhf-training-pipeline-for-llms-using-huggingface-821b76fc45c4 , Nov 2023, medium. [Online]. Available: https://vijayasriiyer.medium.com/rlhf-training-pipeline-for-llms-using-huggingface-821b76fc45c4
2023
Cited alongside, same era.
2023
Cited alongside, same era.
2023
2023
Later among the works it cites.
Unknown, “Praw documentation,” https://praw.readthedocs.io/en/stable/ , accessed: 2023-11-16
2023
Later among the works it cites.
2023. [Online]. Available: https://www.reddit.com/r/travel/comments/100t75r/passport_questions_issues_megathread_2023/?sort=top
2023
Later among the works it cites.
K. Luzniak, “6 main differences between llama 2, gpt-3.5 & gpt-4,” Sep 2023. [Online]. Available: https://neoteric.eu/blog/6-main-differences-between-llama2-gpt35-and-gpt4/
2023
Later among the works it cites.
M. Ai, “Mistral 7b,” Oct 2023. [Online]. Available: https://mistral.ai/news/announcing-mistral-7b/
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
2023
Cited alongside, same era.
C. Zhou, P. Liu, P. Xu, S. Iyer, J. Sun, Y. Mao, X. Ma, A. Efrat, P. Yu, L. Yu, S. Zhang, G. Ghosh, M. Lewis, L. Zettlemoyer, and O. Levy, “LIMA: Less Is More for Alignment,” 2023
2023
Cited alongside, same era.
2023
Cited alongside, same era.
D. Banerjee, P. Singh, A. Avadhanam, and S. Srivastava, “Benchmarking llm powered chatbots: Methods and metrics,” arXiv.org , 2023
2023
Cited alongside, same era.
E. Svikhnushina and P. Pu, “Approximating online human evaluation of social chatbots with prompting,” 2023
2023
Cited alongside, same era.
2023
Cited alongside, same era.
I. A. Wong, Q. L. Lian, and D. Sun, “Autonomous travel decision-making: An early glimpse into chatgpt and generative ai,” Journal of Hospitality and Tourism Management , vol. 56, pp. 253–263, 2023
2023
Cited alongside, same era.
H.-C. Kang, K.-B. Kang, D.-H. Kim, M.-C. Jwa, T.-S. Ko, and J.-W. Jwa, “Smart tourism chatbot system using multi-domain tourism information dst,” in 2023 Fourteenth International Conference on Ubiquitous and Future Networks (ICUFN) , 2023, pp. 608–612. [Online]. Available: https://ieeexplore.ieee.org/document/10200288
2023
Cited alongside, same era.
2023
Later among the works it cites.
K. Singh, “Fine tuning open source large language models (peft qlora) on azure machine learning,” Jul 2023. [Online]. Available: https://blog.devgenius.io/fine-tuning-large-language-models-on-azure-machine-learning-358338f4e66a
2023
Later among the works it cites.
“Full fine-tuning, peft, prompt engineering, or rag,” Sep 2023. [Online]. Available: https://deci.ai/blog/fine-tuning-peft-prompt-engineering-and-rag-which-one-is-right-for-you/
2023
Later among the works it cites.
“Dpo trainer,” 2023. [Online]. Available: https://huggingface.co/docs/trl/en/dpo_trainer
2023
Later among the works it cites.
F. Chiusano, “Two minutes nlp — learn the rouge metric by examples,” Aug 2023. [Online]. Available: https://medium.com/nlplanet/two-minutes-nlp-learn-the-rouge-metric-by-examples-f179cc285499
2023
Later among the works it cites.
“Ragas: Evaluation framework for your retrieval augmented generation (rag) pipelines,” 2023. [Online]. Available: https://docs.ragas.io/en/stable/concepts/metrics/
2023
Later among the works it cites.
2024
Closest in time.
P. Schmid, “Rlhf in 2024 with dpo and hugging face,” Jan 2024. [Online]. Available: https://www.philschmid.de/dpo-align-llms-in-2024-with-trl
2024
Closest in time.
C. Vidal and S. Subramanian, “Raft: A new way to teach llms to be better at rag,” Mar 2024. [Online]. Available: https://techcommunity.microsoft.com/t5/ai-ai-platform-blog/raft-a-new-way-to-teach-llms-to-be-better-at-rag/ba-p/4084674
2024
Closest in time.
A. Sojasingarayar, “Bertscore explained,” Jan 2024. [Online]. Available: https://medium.com/@abonia/bertscore-explained-in-5-minutes-0b98553bfb71
2024
Closest in time.
“Openai documentation,” 2024. [Online]. Available: https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo
2024
Closest in time.