Fetching the paper…
Reading the bibliography…
Recent advancements in large language models have significantly improved their context windows, yet challenges in effective long-term memory management remain.
Birch: an efficient data clustering method for very large databases
Tian Zhang, Raghu Ramakrishnan, and Miron Livny · 1996
Earlier work this paper cites.
Cognitive psychology and its implications
John R Anderson · 2005
Earlier work this paper cites.
What is a memory schema? a historical perspective on current neuroscience literature
Vanessa E Ghosh and Asaf Gilboa · 2014
Earlier work this paper cites.
Jason Weston, Sumit Chopra, and Antoine Bordes · 2014
Earlier work this paper cites.
Neurobiology of schemas and schema-mediated memory
Asaf Gilboa and Hannah Marlatte · 2017
Earlier work this paper cites.
A hierarchical algorithm for extreme clustering
Ari Kobren, Nicholas Monath, Akshay Krishnamurthy, and Andrew McCallum · 2017
Earlier work this paper cites.
Approximation bounds for hierarchical clustering: Average linkage, bisecting k-means, and local search
Benjamin Moseley and Joshua Wang · 2017
Earlier work this paper cites.
Online hierarchical clustering approximations
Aditya Krishna Menon, Anand Rajagopalan, Baris Sumengen, Gui Citovsky, Qin Cao, and Sanjiv Kumar · 2019
Earlier work this paper cites.
Longformer: The long-document transformer
Iz Beltagy, Matthew E Peters, and Arman Cohan · 2020
Earlier work this paper cites.
Quality: Question answering with long input texts, yes!
Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi, Nikita Nangia, Jason Phang, Angelica Chen, Vishakh Padmakumar, Johnny Ma, Jana Thompson, He He, et al · 2021
Earlier work this paper cites.
Do long-range language models actually use long-range context?
Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, and Mohit Iyyer · 2021
Earlier work this paper cites.
Beyond goldfish memory: Long-term open-domain conversation
J Xu · 2021
Earlier work this paper cites.
Memory-based model editing at scale
Eric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning, and Chelsea Finn · 2022
Earlier work this paper cites.
Knowledge-augmented language model prompting for zero-shot knowledge graph question answering
Jinheon Baek, Alham Fikri Aji, and Amir Saffari · 2023
Cited alongside, same era.
Taiyu Ban, Lyvzhou Chen, Xiangyu Wang, and Huanhuan Chen · 2023
Cited alongside, same era.
Scaling transformer to 1m tokens and beyond with rmt
Aydar Bulatov, Yuri Kuratov, Yermek Kapushev, and Mikhail S Burtsev · 2023
Cited alongside, same era.
Longlora: Efficient fine-tuning of long-context large language models
Yukang Chen, Shengju Qian, Haotian Tang, Xin Lai, Zhijian Liu, Song Han, and Jiaya Jia · 2023
Cited alongside, same era.
Lift yourself up: Retrieval-augmented text generation with self memory
Exploring large language models for knowledge graph completion
Liang Yao, Jiazhen Peng, Chengsheng Mao, and Yuan Luo · 2023
Later among the works it cites.
Arigraph: Learning knowledge graph world models with episodic memory for llm agents
Petr Anokhin, Nikita Semenov, Artyom Sorokin, Dmitry Evseev, Mikhail Burtsev, and Evgeny Burnaev · 2024
Closest in time.
Longrope: Extending llm context window beyond 2 million tokens
Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, and Mao Yang · 2024
Closest in time.
Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al · 2024
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, and Rui Yan · 2023
Cited alongside, same era.
Retrieval-augmented generation for large language models: A survey
Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, and Haofen Wang · 2023
Cited alongside, same era.
Llmlingua: Compressing prompts for accelerated inference of large language models
Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang, and Lili Qiu · 2023
Cited alongside, same era.
Ret-llm: Towards a general read-write memory for large language models
Ali Modarressi, Ayyoob Imani, Mohsen Fayyaz, and Hinrich Schütze · 2023
Cited alongside, same era.
Memgpt: Towards llms as operating systems
Charles Packer, Vivian Fang, Shishir G Patil, Kevin Lin, Sarah Wooders, and Joseph E Gonzalez · 2023
Cited alongside, same era.
Generative agents: Interactive simulacra of human behavior
Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein · 2023
Cited alongside, same era.
Enhancing knowledge graph construction using large language models
Milena Trajanoska, Riste Stojanov, and Dimitar Trajanov · 2023
Cited alongside, same era.
Improving text embeddings with large language models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, and Furu Wei · 2023
Cited alongside, same era.
Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, and Jonathan Larson · 2024
Closest in time.
In search of needles in a 11m haystack: Recurrent memory finds what llms miss
Yuri Kuratov, Aydar Bulatov, Petr Anokhin, Dmitry Sorokin, Artyom Sorokin, and Mikhail Burtsev · 2024
Closest in time.
Lost in the middle: How language models use long contexts
Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang · 2024
Closest in time.
Raptor: Recursive abstractive processing for tree-organized retrieval
Parth Sarthi, Salman Abdullah, Aditi Tuli, Shubh Khanna, Anna Goldie, and Christopher D Manning · 2024
Closest in time.
Multihop-rag: Benchmarking retrieval-augmented generation for multi-hop queries
Yixuan Tang and Yi Yang · 2024
Closest in time.
Focused transformer: Contrastive training for context scaling
Szymon Tworkowski, Konrad Staniszewski, Mikołaj Pacek, Yuhuai Wu, Henryk Michalewski, and Piotr Miłoś · 2024
Closest in time.
A survey on the memory mechanism of large language model based agents
Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen · 2024
Closest in time.
Memorybank: Enhancing large language models with long-term memory
Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang · 2024
Closest in time.