Cocoon: Semantic Table Profiling Using Large Language Models

Understand

Data profilers play a crucial role in the preprocessing phase of data analysis by identifying quality issues such as missing, extreme, or erroneous values.

• Traditionally, profilers have relied solely on statistical methods, which lead to high false positives and false negatives.
• For example, they may incorrectly flag missing values where such absences are expected and normal based on the data's semantic context.
• To address these, we introduce Cocoon, a data profiling system that integrates LLMs to imbue statistical profiling with semantics.