DTT: An Example-Driven Tabular Transformer for Joinability by Leveraging Large Language Models

Understand

Many organizations rely on data from government and third-party sources, and those sources rarely follow the same data formatting.

• This introduces challenges in integrating data from multiple sources or aligning external sources with internal databases.
• Commercial database systems do not offer adequate support for integrating data from heterogeneous sources, and manual integration is both time-consuming and inefficient.
• State-of-the-art data integration approaches that rely on similarity functions and textual transformations often fail to handle challenging cases where multiple mappings are required, or the mappings go beyond simple textual transformations.