Misuse and incidents

False facial-recognition match leads to Robert Williams's wrongful arrest

An ACLU complaint disclosed the first known United States wrongful arrest caused by facial recognition after DataWorks Plus software falsely matched Robert Williams and police detained him for about 30 hours.

CURRENT ASSESSMENT · REVISION 1
TOWARD DOOM41confidence 94/100

Why it moved the index

The incident demonstrated that an opaque, biased identification system could materially distort human judgment and deprive a person of liberty. Subsequent police and witness decisions also contributed, so the software was not the sole causal actor.

AUDIT TRAIL

Assessment history

  1. R1
    Toward 41 · confidence 94

    New source-verified historical AI-misuse incident absent from the durable corpus.

    11 Aug 2026