CAESURA: Language Models as Multi-Modal Query Planners

Understand

Traditional query planners translate SQL queries into query plans to be executed over relational data.

• However, it is impossible to query other data modalities, such as images, text, or video stored in modern data systems such as data lakes using these query planners.
• In this paper, we propose Language-Model-Driven Query Planning, a new paradigm of query planning that uses Language Models to translate natural language queries into executable query plans.
• Different from relational query planners, the resulting query plans can contain complex operators that are able to process arbitrary modalities.