Auditing Work: Exploring the New York City algorithmic bias audit regime

Understand

In July 2023, New York City (NYC) initiated the first algorithm auditing system for commercial machine-learning systems.

• Local Law 144 (LL 144) mandates NYC-based employers using automated employment decision-making tools (AEDTs) in hiring to undergo annual bias audits conducted by an independent auditor.
• This paper examines lessons from LL 144 for other national algorithm auditing attempts.
• Through qualitative interviews with 16 experts and practitioners within the regime, we find that LL 144 has not effectively established an auditing regime.