Fetching the paper…
Reading the bibliography…
To deliver coherent and personalized experiences in long-term conversations, existing approaches typically perform retrieval augmented response generation by constructing memory banks from conversation history at either the turn-level, session-level, or through summarization techniques.In this paper, we present two key findings: (1) The granularity of memory unit matters: turn-level, session-level, and summarization-based methods each exhibit limitations in both memory retrieval accuracy and the semantic quality of the retrieved content.
Prediction and entropy of printed english
Claude E Shannon · 1951
Earlier work this paper cites.
Catastrophic interference in connectionist networks: The sequential learning problem
Michael McCloskey and Neal J Cohen · 1989
Earlier work this paper cites.
Summarization-based query expansion in information retrieval
Tomek Strzalkowski, Jin Wang, and G Bowden Wise · 1998
Earlier work this paper cites.
Statistical models for text segmentation
Doug Beeferman, Adam Berger, and John Lafferty · 1999
Earlier work this paper cites.
Cumulated gain-based evaluation of ir techniques
Kalervo Järvelin and Jaana Kekäläinen · 2002
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu · 2002
Earlier work this paper cites.
A critique and improvement of an evaluation metric for text segmentation
Lev Pevzner and Marti A Hearst · 2002
Earlier work this paper cites.
Using summaries in document retrieval
Mark Wasson · 2002
Earlier work this paper cites.
Information retrieval on noisy text
David Grangier, Alessandro Vinciarelli, and Hervé Bourlard · 2003
Earlier work this paper cites.
Rouge: A package for automatic evaluation of summaries
Chin-Yew Lin · 2004
Earlier work this paper cites.
BM25 , pp. 257–260
Giambattista Amati · 2009
Earlier work this paper cites.
Personalizing dialogue agents: I have a dog, do you have pets too?
Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston · 2018
Earlier work this paper cites.
Wizard of wikipedia: Knowledge-powered conversational agents
Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, and Jason Weston · 2019
Earlier work this paper cites.
Billion-scale similarity search with gpus
Jeff Johnson, Matthijs Douze, and Hervé Jégou · 2019
Earlier work this paper cites.
Coqa: A conversational question answering challenge
Siva Reddy, Danqi Chen, and Christopher D Manning · 2019
Earlier work this paper cites.
Unsupervised cross-lingual representation learning at scale
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov · 2020
Earlier work this paper cites.
doc2dial: A goal-oriented document-grounded dialogue dataset
Song Feng, Hui Wan, Chulaka Gunasekara, Siva Patel, Sachindra Joshi, and Luis Lastras · 2020
Earlier work this paper cites.
Dense passage retrieval for open-domain question answering
Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih · 2020
Earlier work this paper cites.
Retrieval-augmented generation for knowledge-intensive nlp tasks
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al · 2020
Earlier work this paper cites.
Mpnet: Masked and permuted pre-training for language understanding
Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, and Tie-Yan Liu · 2020
Earlier work this paper cites.
Bertscore: Evaluating text generation with bert
Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi · 2020
Earlier work this paper cites.
Prefix-tuning: Optimizing continuous prompts for generation
Xiang Lisa Li and Percy Liang · 2021
Cited alongside, same era.
Simple and effective unsupervised redundancy elimination to compress dense vectors for passage retrieval
Xueguang Ma, Minghan Li, Kai Sun, Ji Xin, and Jimmy Lin · 2021
Cited alongside, same era.
Tiage: A benchmark for topic-shift aware dialog modeling
Huiyuan Xie, Zhenghao Liu, Chenyan Xiong, Zhiyuan Liu, and Ann Copestake · 2021
Cited alongside, same era.
Topic-aware multi-turn dialogue modeling
Yi Xu, Hai Zhao, and Zhuosheng Zhang · 2021
Cited alongside, same era.
Sequential reptile: inter-task gradient alignment for multilingual learning
Seanie Lee, Hae Beom Lee, Juho Lee, and Sung Ju Hwang · 2022
Cited alongside, same era.
Curriculum contrastive context denoising for few-shot conversational dense retrieval
Kelong Mao, Zhicheng Dou, and Hongjin Qian · 2022
Recursively summarizing enables long-term dialogue memory in large language models
Qingyue Wang, Liang Ding, Yanan Cao, Zhiliang Tian, Shi Wang, Dacheng Tao, and Li Guo · 2023
Later among the works it cites.
Chain-of-note: Enhancing robustness in retrieval-augmented language models
Wenhao Yu, Hongming Zhang, Xiaoman Pan, Kaixin Ma, Hongwei Wang, and Dong Yu · 2023
Later among the works it cites.
Evolving large language model assistant with long-term conditional memory
Ruifeng Yuan, Shichao Sun, Zili Wang, Ziqiang Cao, and Wenjie Li · 2023
Later among the works it cites.
Facilitating multi-turn emotional support conversation with positive emotion elicitation: A reinforcement learning approach
Jinfeng Zhou, Zhuang Chen, Bo Wang, and Minlie Huang · 2023
Later among the works it cites.
Toward conversational agents with context and time sensitive long-term memory
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Beyond goldfish memory: Long-term open-domain conversation
Jing Xu, Arthur Szlam, and Jason Weston · 2022
Cited alongside, same era.
Unsupervised dialogue topic segmentation with topic-aware utterance representation
Haoyu Gao, Rui Wang, Ting-En Lin, Yuchuan Wu, Min Yang, Fei Huang, and Yongbin Li · 2023
Cited alongside, same era.
Faithful persona-based conversational dataset generation with large language models
Pegah Jandaghi, XiangHai Sheng, Xinyi Bai, Jay Pujara, and Hakim Sidahmed · 2023
Cited alongside, same era.
Llmlingua: Compressing prompts for accelerated inference of large language models
Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, and Lili Qiu · 2023
Cited alongside, same era.
Superdialseg: A large-scale dataset for supervised dialogue segmentation
Junfeng Jiang, Chengzhang Dong, Sadao Kurohashi, and Akiko Aizawa · 2023
Cited alongside, same era.
Aligning large language models through synthetic feedback
Sungdong Kim, Sanghwan Bae, Jamin Shin, Soyoung Kang, Donghyun Kwak, Kang Yoo, and Minjoon Seo · 2023
Cited alongside, same era.
Nick Alonso, Tomás Figliolia, Anthony Ndirango, and Beren Millidge · 2024
Later among the works it cites.
Nuo Chen, Hongguang Li, Juhua Huang, Baoyuan Wang, and Jia Li · 2024
Later among the works it cites.
Lumberchunker: Long-form narrative document segmentation
André V Duarte, João Marques, Miguel Graça, Miguel Freire, Lei Li, and Arlindo L Oliveira · 2024
Later among the works it cites.
Seo Hyun Kim, Kai Tzu-iunn Ong, Taeyoon Kwon, Namyoung Kim, Keummin Ka, SeongHyeon Bae, Yohan Jo, Seung-won Hwang, Dongha Lee, and Jinyoung Yeo · 2024
Later among the works it cites.
Seanie Lee, Jianpeng Chen, Joris Driesen, Alexandru Coca, and Anders Johannsen · 2024
Later among the works it cites.
Hello again! llm-powered personalized agent for long-term dialogue
Hao Li, Chenghao Yang, An Zhang, Yang Deng, Xiang Wang, and Tat-Seng Chua · 2024
Later among the works it cites.
Lost in the middle: How language models use long contexts
Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang · 2024
Later among the works it cites.
Evaluating very long-term conversational memory of llm agents
Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, and Yuwei Fang · 2024
Later among the works it cites.
Llmlingua-2: Data distillation for efficient and faithful task-agnostic prompt compression
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Menglin Xia, Xufang Luo, Jue Zhang, Qingwei Lin, Victor Rühle, Yuqing Yang, Chin-Yew Lin, et al · 2024
Later among the works it cites.
Self-reflection in llm agents: Effects on problem-solving performance
Matthew Renze and Erhan Guven · 2024
Later among the works it cites.
Optimizing retrieval-augmented generation with advanced chunking techniques: A comparative study
Antematter Team · 2024
Later among the works it cites.
Semantic chunking
Greg Kamradt · 2024
Later among the works it cites.
Wei Wu, Zhuoshi Pan, Chao Wang, Liyi Chen, Yunchu Bai, Kun Fu, Zheng Wang, and Hui Xiong · 2024
Later among the works it cites.
Boosting conversational question answering with fine-grained retrieval-augmentation and self-check
Linhao Ye, Zhikai Lei, Jianghao Yin, Qin Chen, Jie Zhou, and Liang He · 2024
Later among the works it cites.
A survey on the memory mechanism of large language model based agents
Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen · 2024
Later among the works it cites.
Memorybank: Enhancing large language models with long-term memory
Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang · 2024
Later among the works it cites.