Researchers: GPT-4 was 64.4% more persuasive than humans in one-on-one debates when given basic personal information about the person it was trying to persuade
I'm wondering how this would work on conspiracy theorists. [embedded post] Prof. Ian Walker / @ianwalker : Oh wow 64.4℅. The astonishing precision implied by the decimal point makes it entirely convincing and I'm wrong for thinking LLMs are the emperor's new clothes [embedded post] Forums: r/technology : AI Can Beat You in a Debate When It Knows Who You Are, Study Finds
Context & Ripple Effects
This result extends a documented arc from GPT-4’s improved precision alongside persistent hallucinations to evidence that individualized dialogue can shift even entrenched beliefs: GPT-4 Turbo conversations reduced selected conspiracy beliefs in experiments.
It also sharpens concerns already surfaced in OpenAI’s own evaluation materials, where GPT-4.5 was characterized as highly persuasive in a model-to-model test: a prior system-card assessment of model persuasiveness. The important variable here is not debate skill alone, but the addition of basic personal context.
First-order effects
- Systems deploying GPT-4 for sales, support, coaching, or public-facing dialogue gain a stronger case for tailoring arguments to users; those users face more effective influence attempts when personal details are available.
- Developers and operators must treat personalization as a safety-relevant capability, not merely a conversion feature, because the reported advantage arises in one-on-one persuasion.
Second-order effects
- Competing model providers and application builders will face pressure to evaluate persuasive behavior under personalized prompts, alongside accuracy and standard safety testing.
- Platforms that collect user profiles may face a sharper trade-off: the same data that improves relevance can increase the potency of misleading or manipulative messages, echoing earlier evidence that chatbots can generate convincing misinformation. Earlier research found ChatGPT could produce convincing misleading narratives.
Third-order effects
- If personalized AI persuasion becomes a repeatable product capability, governance will increasingly center on disclosure, limits on sensitive targeting, and auditing of influence-oriented use cases rather than on generated text alone.
- The longer-term market distinction may be between AI services that can demonstrate bounded, auditable personalization and those whose engagement optimization obscures when an assistant is trying to change a user’s mind.
The trend: This is one data point in the shift from general-purpose chatbots toward personalized influence systems, making persuasion controls a core AI-governance issue.