Mimetic vs Anchored Value Alignment in Artificial Intelligence

Understand

"Value alignment" (VA) is considered as one of the top priorities in AI research.

• Much of the existing research focuses on the "A" part and not the "V" part of "value alignment." This paper corrects that neglect by emphasizing the "value" side of VA and analyzes VA from the vantage point of requirements in value theory, in particular, of avoiding the "naturalistic fallacy"--a major epistemic caveat.
• The paper begins by isolating two distinct forms of VA: "mimetic" and "anchored." Then it discusses which VA approach better avoids the naturalistic fallacy.
• The discussion reveals stumbling blocks for VA approaches that neglect implications of the naturalistic fallacy.