Uncovering Limitations of Large Language Models in Information Seeking from Tables

Understand

Tables are recognized for their high information density and widespread usage, serving as essential sources of information.

• Seeking information from tables (TIS) is a crucial capability for Large Language Models (LLMs), serving as the foundation of knowledge-based Q&A systems.
• However, this field presently suffers from an absence of thorough and reliable evaluation.
• This paper introduces a more reliable benchmark for Table Information Seeking (TabIS).