Challenges and Future Directions of Data-Centric AI Alignment

Understand

As AI systems become increasingly capable and influential, ensuring their alignment with human values, preferences, and goals has become a critical research focus.

• Current alignment methods primarily focus on designing algorithms and loss functions but often underestimate the crucial role of data.
• This paper advocates for a shift towards data-centric AI alignment, emphasizing the need to enhance the quality and representativeness of data used in aligning AI systems.
• In this position paper, we highlight key challenges associated with both human-based and AI-based feedback within the data-centric alignment framework.