A Roadmap to Pluralistic Alignment

Understand

With increased power and prevalence of AI systems, it is ever more critical that AI systems are designed to serve all, i.e., people with diverse values and perspectives.

• However, aligning models to serve pluralistic human values remains an open research question.
• In this piece, we propose a roadmap to pluralistic alignment, specifically using language models as a test bed.
• We identify and formalize three possible ways to define and operationalize pluralism in AI systems: 1) Overton pluralistic models that present a spectrum of reasonable responses; 2) Steerably pluralistic models that can steer to reflect certain perspectives; and 3) Distributionally pluralistic models that are well-calibrated to a given population in distribution.