Analysis: scientists who appeared to use LLMs posted 33% more papers on arXiv than those who didn't, as concerns grow over AI slop in scientific publishing
Peer review has met its match. — On a frigid Norwegian afternoon earlier this month, Dan Quintana, a psychology professor …
Context & Ripple Effects
The reported association between apparent LLM use and higher arXiv posting volume turns a broad concern about scientific AI use into a measurable publishing-incentive problem. It matters because preprints circulate before conventional quality controls can fully assess them.
The issue sits alongside evidence that LLM-written text had already entered conference reviewing, with LLM-generated sentences detected in computer-science reviews, and later pressure on conferences to restrict LLM use in papers and reviews.
First-order effects
- Researchers who use LLMs may be able to increase preprint output relative to peers who do not, while readers and moderators face a larger volume of work to assess.
- The finding intensifies scrutiny of whether LLM assistance is supporting legitimate drafting or lowering the effective cost of low-quality submissions.
Second-order effects
- Conference organizers and publishers have stronger reason to define and enforce disclosure or use rules, consistent with conferences moving to restrict LLM use in writing and reviewing.
- More submissions can shift the bottleneck from producing manuscripts to screening them, raising the value of editorial triage and review processes that can identify fabricated or unreliable work.
Third-order effects
- If AI-assisted output continues to outpace review capacity, scientific publishing may separate further into high-volume preprint distribution and more selective validation channels.
- The durability of preprints as a discovery layer will depend on whether platforms can preserve trust as LLMs also enable fabricated-paper submissions by non-researchers.
The trend: Generative AI is reducing the cost of producing scientific text faster than the research ecosystem can verify its quality and provenance.