November 01, 2017

Building Ethical Algorithms

By Natasha Duarte

This summer, the Supreme Court declined to hear a case about the constitutional rights of a man whose sentencing decision was determined in part by a computer.1 In State v. Loomis,2 the state used a tool called COMPAS (Correctional Offender Management Profiling for Alternative Sanctions) to calculate the “recidivism risk” of the defendant—the likelihood that he would be rearrested for another crime within two years, based on people who shared his characteristics and background. COMPAS asks a series of questions about the defendant and runs the answers through a proprietary algorithm, which provides a recidivism “risk score.”3 A study by ProPublica found that when COMPAS predictions were wrong, they were more likely to incorrectly classify black defendants as high risk and white defendants as low risk.4

Premium Content For:
  • Science and Technology Law Section
Join - Now