Self-Retrieval: End-to-End Information Retrieval with One Large Language Model

Understand

The rise of large language models (LLMs) has significantly transformed both the construction and application of information retrieval (IR) systems.

• However, current interactions between IR systems and LLMs remain limited, with LLMs merely serving as part of components within IR systems, and IR systems being constructed independently of LLMs.
• This separated architecture restricts knowledge sharing and deep collaboration between them.
• In this paper, we introduce Self-Retrieval, a novel end-to-end LLM-driven information retrieval architecture.