A GPT-3 AI bot posing as a human went seemingly undetected for a week on r/AskReddit, answering one question per minute on various topics including suicide
it didn't end well Tweets: Barry Schwartz / @rustybrick : This is great https://twitter.com/... Clive Thompson / @pomeranian99 : A bot based on GPT-3 was answering questions on Reddit for a week, and appeared to be fooling a lot of people, as @pbwinston documents in this terrific blog post — https://www.kmeme.com/... Mike Masnick / @mmasnick : For years people have been worried about deep fake videos distorting discourse... and it allowed us to miss the idea that GPT-3 AI-enabled bots might take over Reddit: https://www.kmeme.com/...
Context & Ripple Effects
In October 2020, a GPT-3 bot ran on r/AskReddit for a week at a question-a-minute pace, documented by @pbwinston's writeup, and the sharpest reaction came from Mike Masnick: while discourse fixated on deepfake video, plain-text impersonation slipped through first. The suicide-related answers made clear this wasn't just an authenticity curiosity but a safety exposure for an unmoderated-for-speed bot.
The later corpus shows what grew out of that moment: a detection arms race kicked off by GPTZero's perplexity-and-burstiness approach, researchers confirming models can produce convincing misinformation at scale, and Reddit itself now building its own Reddit Answers chatbot while fighting unauthorized scraping of the very user data that makes its forums valuable.
First-order effects
- r/AskReddit's moderators and users spent a week engaging with a machine under the assumption it was human, and the experiment ended only when @pbwinston exposed it — not because Reddit's defenses caught it.
- The bot's answers on suicide put vulnerable questioners in contact with a system with no safety guardrails, making platform liability and response protocols the immediate concern.
Second-order effects
- Detection became a product category: GPTZero's launch shows the demand created when human-vs-machine authorship is no longer visually distinguishable in text.
- Platforms hosting anonymous human conversation face pressure to verify humanness or label provenance, since their content's value — to users and to AI trainers alike — depends on it being authentic.
Third-order effects
- If high-frequency synthetic participants go undetected, the economics of community platforms invert: the scarcer asset becomes verified human attention, and 'proof of humanness' shifts from a nice-to-have to infrastructure.
- The same corpora of human conversation that bots imitate become contested assets — Reddit's later fight over scraping while launching its own AI products shows platforms trying to be both the source of training data and the owner of the resulting bots.
The trend: Text-based AI impersonation arrived before video deepfakes did, and platforms are still catching up — shifting from assuming posts are human to having to prove it.