Analysis: Gemini 3-based AI Overviews are accurate ~90% of the time, meaning across 5T+ searches per year, tens of millions of answers are erroneous every hour
The company's A.I.-generated answers look authoritative, but they draw on an array of sources, from trustworthy sites to Facebook posts.
New York Times
Context & Ripple Effects
Google positioned Gemini around stronger factual performance before making it the default engine for AI Overviews globally; the global default-model rollout also made follow-up search interactions more seamless through AI Mode. That expanded the reach of any remaining reliability gap from a standalone model issue into a core search-product issue.
The contrast is notable because Google had earlier offered enterprise Gemini users the ability to ground responses in reliable sources. This analysis focuses attention on how source selection and verification work in consumer search answers, where the underlying material can vary substantially in quality.
First-order effects
Google faces a trust and quality-control problem in AI Overviews: a roughly 90% accuracy rate still produces a large absolute volume of wrong answers at search scale, especially when answers are presented authoritatively.
Users and subjects of searches can receive or be affected by incorrect claims, while publishers falsely associated with harmful conduct have a clearer basis to challenge erroneous summaries.
Second-order effects
Google will be pressured to tighten source-ranking, citation, and escalation safeguards for sensitive queries; publishers may seek stronger mechanisms to correct, limit, or contest AI-generated characterizations.
Search rivals can compete on answer provenance and reliability, while high-quality publishers gain leverage as differentiated inputs to systems that need more governable source corpora.
Third-order effects
As AI answers become the default interface for information retrieval, evaluation will shift from model-level accuracy claims to product-level accountability: source quality, query risk, correction speed, and the distribution of errors.
If high-volume summary errors persist, the economics of AI search may increasingly favor curated or licensed content and more explicit publisher-control and redress frameworks, rather than broad web retrieval alone.
The trend: This is one data point in the shift from deploying increasingly capable models to governing AI search as a high-stakes, mass-distribution information product.
Had someone come in to a library help shift asking “how to turn off all the AI.” So I dutifully twiddled the various Windows registry values to do so, handing it back to her to verify. She immediately did a Google search. the one bit of AI she wanted gone I couldn't help with […
continue to think that Google, which arguably has the best AI models in the market, deliberately filling its search results with responses from with the dumbest models it makes is one of the worst strategic decisions in the sector so far [embedded post]
“It was spitting out the stuff from my website as though it was God's own truth.” — How accurate are AI Overviews? Well, let me tell you, an entire cottage industry within marketing has sprung up to influence its results. — So, in other words, not trustworthy at all. www.nyt…
“Today's A.I. systems use mathematical probabilities to guess the best response, not a strict set of rules defined by human engineers. That means they make a certain number of mistakes.” www.nytimes.com/2026/04/07/t...
This article is a case study of why measuring AI performance is so hard. AI Overviews make mistakes. But the same mistakes are in Wikipedia. But the sources are harder to find when using AI. But the AI answers may be better than most people would find. Unclear what it all means. …
at the end of the day it always comes back to scale even with a 99.9 percent accuracy rate, .1 percent is still a huge number applies to every big tech co
glass half full: 90 percent accuracy is an impressive accuracy rate glass half empty: 10 percent error rate for a company that does more than 5 Trillion search queries per year is still a gigantic number https://www.nytimes.com/... [image]
‘AI Overviews face another challenge: They can be manipulated. If someone wants to be known as a world expert at something, he or she merely has to write a blog post self-proclaiming that distinction.’ www.nytimes.com/2026/04/07/t... [image]