Government agencies are increasingly using automated decision systems to aid or supplant human decision-making and policy enforcement in various sensitive social domains. They determine who will have their food subsidies terminated, how much healthcare benefits a person is entitled to, and who is likely to be a victim of a crime. Yet, existing legislative and regulatory definitions fail to adequately describe or clarify how these technologies are used in practice and their impact on society. This failure to adequately describe and define “automated decision systems” leads to such systems evading scrutiny that policymakers are increasingly recognizing is warranted and potentially impedes avenues for legal redress. Such oversights can have concrete consequences for individuals and communities, such as increased law enforcement harassment, deportation, denial of housing or employment opportunities, and death.

Citation Key: richardson2021