Defense lawyers question the accuracy and reliability of Cybercheck, an AI tool used in thousands of US cases to identify suspects' locations and other details
How can this be? — Because law enforcement stacks the deck, and judges allow it, while legislatures ignore the injustices. — https://www.nbcnews.com/... CivicWhitaker / @civicwhitaker@mastodon … : For the love of everything good and holy - can we NOT use an untested closed source non-peer-reviewed system to throw people in jail? https://www.nbcnews.com/... There are so many red flags with this but noooooooooooo - it's the AI wave y'all! @rmd1023@infosec.exchange : “Yeah, it's 90% accurate! But you can't see the code. Or any other data. But it's TOTALLY accurate!! Honest! Just cue that shit up in your courtroom.” — https://www.nbcnews.com/... This smells like it's the “cybertech” version of that high tech “bomb/drug detection” dowsing rods someone that were being sold to cops/military for a while. Gerry McGovern / @gerrymcgovern@mastodon.green : “An AI tool used in thousands of criminal cases is facing legal challenges. Cybercheck's founder has said the software tops 90% accuracy. Defense lawyers have said he lied under oath about his expertise and made false claims about when and where the technology has been used.” — https://www.nbcnews.com/... @Wolven@ourislandgeorgia.net : This cannot be restated enough. Predictive policing algorithms, facial recognition systems, and other carceral tools are, like all under-the-streetlamp key searches and broken windows policing methods, tautologies, self fulfilling prophecies, definitionally limiting justifications. … X: Tim Stelloh / @timstelloh : scoop! Developer of AI tool used in thousands of criminal cases accused of lying under oath https://www.nbcnews.com/... via @nbcnews @eff : “We're being asked to trust a company to present evidence that could eventually put people in prison” without supporting evidence including transparent methodology, EFF's Bill Budington told @NBCNews. “That goes against the right to due process.” https://www.nbcnews.com/... LinkedIn: Merve Hickok : This is why we keep pounding on the message that public sector should NOT procure AI Systems That Ignore Human Rights. … Heather M. Roff, PhD : This is horrific from a legal and law enforcement perspective if not also from a basic science perspective. … Forums: r/boulder : Boulder county DA allegedly using dubious AI company to help prosecute cases
Context & Ripple Effects
The challenge to Cybercheck extends a longer criminal-justice debate over algorithmic tools used in policing, sentencing and supervision, including earlier coverage of predictive algorithms shaping police and court decisions. It matters because the disputed tool is described as having been used across thousands of cases, making its evidentiary basis consequential beyond any one prosecution.
The concerns also echo scrutiny of COMPAS risk-assessment shortcomings, but here the focus is on a system used to identify location and other suspect details. Defense claims about the founder's testimony and the EFF's due-process warning put transparency, not simply an advertised accuracy rate, at the center of the dispute.
First-order effects
- Defense lawyers can challenge Cybercheck-derived assertions more aggressively, particularly where the tool's methodology, claimed accuracy or the founder's representations are material to the evidence.
- Prosecutors and courts relying on Cybercheck face immediate pressure to establish what the system produced, how it produced it and whether those claims can be meaningfully tested by the defense.
Second-order effects
- The dispute raises the evidentiary burden for other opaque public-safety AI vendors: a performance claim alone may not satisfy courts or defense counsel when the underlying method cannot be examined.
- Police agencies and prosecutors may face more requests for disclosure and independent validation before AI-generated leads are presented as inculpatory evidence, potentially slowing their operational use in contested cases.
Third-order effects
- If such challenges persist, public-safety AI procurement is likely to shift toward auditable systems and contractual access to methodology, documentation and error testing rather than closed tools evaluated chiefly by vendor claims.
- The broader fault line is whether AI can remain a nontransparent investigative aid once its outputs influence liberty interests; courts and legislatures may increasingly set the practical assurance standard case by case if no common rules emerge.
The trend: Cybercheck is one instance of public-safety AI moving from experimental investigative support into a due-process test of transparency, validation and adversarial review.