Persona-DB: Efficient Large Language Model Personalization for Response Prediction with Collaborative Data Refinement

Understand

The increasing demand for personalized interactions with large language models (LLMs) calls for methodologies capable of accurately and efficiently identifying user opinions and preferences.

• Retrieval augmentation emerges as an effective strategy, as it can accommodate a vast number of users without the costs from fine-tuning.
• Existing research, however, has largely focused on enhancing the retrieval stage and devoted limited exploration toward optimizing the representation of the database, a crucial aspect for tasks such as personalization.
• In this work, we examine the problem from a novel angle, focusing on how data can be better represented for more data-efficient retrieval in the context of LLM customization.