A Validity Perspective on Evaluating the Justified Use of Data-driven Decision-making Algorithms

Understand

Recent research increasingly brings to question the appropriateness of using predictive tools in complex, real-world tasks.

• While a growing body of work has explored ways to improve value alignment in these tools, comparatively less work has centered concerns around the fundamental justifiability of using these tools.
• This work seeks to center validity considerations in deliberations around whether and how to build data-driven algorithms in high-stakes domains.
• Toward this end, we translate key concepts from validity theory to predictive algorithms.