Experts explain why there's no magic formula to always distinguish human-written and AI-written text, meaning AI writing detectors can only make a strong guess
Can AI writing detectors be trusted? We dig into the theory behind them. — If you feed America's most important legal document …
Ars TechnicaBenj Edwards
Context & Ripple Effects
The core constraint is statistical rather than a matter of detector tuning: text alone cannot reliably reveal its author in every case. That limitation matters as detector outputs are used to judge work whose wording may be conventional, edited, or shaped by language proficiency.
Related coverage has documented that popular tools can disproportionately flag non-native English writing, while later accounts describe generic prose being more likely to trigger flags. Claims of highly accurate detection and proposed watermarking approaches therefore address only parts of a broader assurance problem.
First-order effects
Schools, publishers, and employers using detectors must treat a positive result as a probabilistic signal, not conclusive proof of AI use.
Organizations that attach penalties to detector scores will need review processes and corroborating evidence, raising the operational cost of enforcing AI-use rules.
Detector vendors face pressure to communicate error rates and limits more clearly; claimed performance can be misleading when tools are deployed across large populations, as the risk of false positives at scale illustrates.
Third-order effects
If text provenance cannot be inferred reliably after the fact, verification is likely to shift toward process evidence and disclosure rather than binary authorship verdicts.
The market may split between tools that estimate likelihood from prose and systems designed to establish provenance, with watermarking remaining constrained by adoption and implementation debates.
The trend: AI-content governance is moving from confident text-based detection toward layered provenance, review, and accountability systems.
For this article from @benjedwards.bsky.social , I got to spend some time explaining the fundamental “AI” concept of “perplexity”. https://arstechnica.com/...
As educators panic about students using ChatGPT to write papers, many reach for AI detectors that perform slightly better than a random classifier — Many painful false accusations are the result. I wrote about why people should not rely on this imperfect tech: — https://arst…
A reminder that, just as you shouldn't rely on “AI” to write accurate prose, you also shouldn't rely on automated “AI detectors” to accurately flag cheating. Most of them, like the large language models they're trying to ID, are based on statistical pattern analysis rather than …
1) If you're interested in LLMs but want to understand more, this is really useful. It's also important to hear how inaccurate these ‘detectors’ are because I still encounter people who think you can paste text into ChatGPT and ask it for an opinion... https://arstechnica.com/...
Reminder that you can NEVER use a neural network to spot whether a text was written by a neural network. Corollary: You can never accuse anyone of cheating based on what a neural network said. https://arstechnica.com/...
shouldn't be surprising, but we're in an era of bad reporting on AI, so i'm taking wins where i can: this article on detecting AI-generated text (and why it's practically impossible) investigated/reported by @benjedwards is really good https://arstechnica.com/... just a few riffs…
As educators panic about students using ChatGPT to write papers, many reach for AI detectors that perform slightly better than random chance Many painful false accusations are the result. I wrote about why people should not rely on this imperfect tech: https://arstechnica.com/...
If you feed America's most important legal document—the US Constitution—into a tool designed to detect text written by AI models like ChatGPT, it will tell you that the document was almost certainly written by AI. https://arstechnica.com/...