Students, academics, and developers say AI writing detectors are most likely to falsely flag essays written in a more generic manner as written by AI tools
About two-thirds of teachers report regularly using tools for detecting AI-generated content. At that scale, even tiny error rates can add up quickly.
Bloomberg
Related Coverage
- Some NYC teachers experiment with AI-powered tools, while Education Department develops guidelines Chalkbeat · Julian Shen-Berro
- These AI detector tools are a really bad idea. If you're a teacher, you really shouldn't use them. — https://www.bloomberg.com/... @DrYohanJohn@fediscience.org · Yohan John
- #AI #GenerativeAI #AIDetectors #Universities #HigherEd: “About two-thirds of teachers report using an AI checker regularly, according to a survey of more than 450 instructors published in March by the Center for Democracy & Technology. — The best AI writing detectors are highly accurate, but they're not foolproof. … @remixtures@tldr.nettime.org · Miguel Afonso Caetano
- Just another story about the caution of AI detection tools as the only thing we are using. We need to foster a better culture of trust and respect as this technology emerges. … Adam Garry
- Teachers who use tools to detect AI-generated content are simply not doing their jobs. — The story ends with a good example of a right approach … NS Ramnath
- How to destroy your relationship with your entire class in one easy step. — Use an AI detector. — “About two-thirds of teachers report using … Darren Coxon
- Do you wish your writing was more human? — “majority of the time it takes him to complete an assignment is now spent tweaking wordings so he isn't falsely flagged … Szymon Machajewski
- NEW: Ever since students started using ChatGPT in the classroom, new tools have cropped up to help teachers catch them in the act of trying to pass off an AI's work as their own. … Jackie Davalos
Discussion
-
@liamdugan_
Liam Dugan
on x
Great article by @Bloomberg on how AI detectors have unsustainably high false positive rates. Even 1% or 2% FPR causes thousands of false flags. Key problem for the whole industry. More people should be focused on this. https://www.bloomberg.com/...
-
@bijans
Bijan Salehizadeh
on x
Teachers are using AI detection tools to catch students' cheating. But they're not always accurate, and consequences are piling up 2-4% false positive rate will lead to many many false accusations against high school and college students. https://www.bloomberg.com/...
-
@charleswlogan
Charles Logan
on x
So-called AI detection technologies are forcing students to develop the most tedious, joy-crushing AI literacy practices. See: https://www.bloomberg.com/... [image]
-
@m33r_6
Sameer Ali
on x
Despite evidence to the contrary, some institutes continue to hide behind these tools in absence of their own lack of expertise and reading on the subjects turn student and researchers' lives into hell! https://www.bloomberg.com/...
-
@emollick
Ethan Mollick
on x
It is morally wrong to use AI detectors when they produce false positives that smear students in ways that hurt them and where they can never prove their innocence. Do not use them. https://www.bloomberg.com/... [image]
-
@rmnth
Ramnath
on x
Teachers who use tools to detect AI-generated content are simply not doing their jobs. The story ends with a good example of a right approach: Know your students, go by your intuition, and have open discussions. https://www.bloomberg.com/...
-
@goblinsearch
@goblinsearch
on x
Do AI writing detectors work? I've seen anecdotal blogs by journalists which show they can missreport human content as AI generated. A new article by @Bloomberg reveals the level of risk and harm caused when false positives are treated as real. https://www.bloomberg.com/...
-
@annarmills
@annarmills
on x
Teachers are using AI detection tools to catch students' cheating. But they're not always accurate, and consequences are piling up “Businessweek found the services falsely flagged 1% to 2% of the essays as likely written by AI” https://www.bloomberg.com/... via @BW
-
@cesaregardito
Cesare G. Ardito
on x
This has been happening for two years, and people still trust businesses marketing their shoddy “99%* accuracy**”, and implement the pipe dream of “AI detection”. It's sad that lawsuits are slow. They won't stop until then, I suppose. https://www.bloomberg.com/... [image]
-
@technology
@technology
on x
About two-thirds of teachers report using tools for detecting AI-generated writing. At that scale, even tiny error rates can add up quickly. In this episode of The Big Take, we unpack what happens when AI detectors falsely accuse students of cheating https://landing.podtrac.com/ …
-
r/technology
r
on reddit
AI Detectors Falsely Accuse Students of Cheating—With Big Consequences
-
r/Professors
r
on reddit
AI Detectors Falsely Accuse Students of Cheating—With Big Consequences
-
r/OpenAI
r
on reddit
An article by Bloomberg: AI Detectors Falsely Accuse Students of Cheating—With Big Consequences