AQA: Adaptive Question Answering in a Society of LLMs via Contextual Multi-Armed Bandit

Understand

In question answering (QA), different questions can be effectively addressed with different answering strategies.

• Some require a simple lookup, while others need complex, multi-step reasoning to be answered adequately.
• This observation motivates the development of a dynamic method that adaptively selects the most suitable QA strategy for each question, enabling more efficient and effective systems capable of addressing a broader range of question types.
• To this aim, we build on recent advances in the orchestration of multiple large language models (LLMs) and formulate adaptive QA as a dynamic orchestration challenge.