ChatGPT Search is impressive in some ways, but it's unreliable for short queries containing just a few words, meaning it's far from being a “Google killer”
goodbye, Google Barry Schwartz / Search Engine Roundtable : Daily Search Forum Recap: November 4, 2024 Adrianna Nine / ExtremeTech : OpenAI Rolls Out ChatGPT Search to Paid Users Matthew Broersma / Silicon UK : OpenAI Adds ChatGPT Search Features Calvin Wankhede / Android Authority : I ditched Google for ChatGPT Search to find out if the grass is really greener X: @emilymbender : Setting things up so that you get “the answer” to your question cuts off the user's ability to do the sense-making that is critical to information literacy. >> @emilymbender : Furthermore, a system that is right 95% of the time is arguably more dangerous tthan one that is right 50% of the time. People will be more likely to trust the output, and likely less able to fact check the 5%. >> @emilymbender : If someone uses an LLM as a replacement for search, and the output they get is correct, this is just by chance. >> @emilymbender : As OpenAI and Meta introduce LLM-driven searchbots, I'd like to once again remind people that neither LLMs nor chatbots are good technology for information access. A thread, with links: >> Forums: r/technology : ChatGPT Search is not OpenAI's ‘Google killer’ yet
Context & Ripple Effects
OpenAI had just introduced ChatGPT Search for paid users as a way to retrieve timely information, following its earlier limited SearchGPT test. This assessment adds an important constraint: the product’s conversational presentation does not yet translate into dependable performance across basic search behavior.
The launch was framed as a direct challenge to Google, while prior coverage identified dissatisfaction with Google’s spam- and SEO-heavy results as an opening for chat-based search. Reliability on terse, high-intent queries is therefore central to whether users can treat ChatGPT Search as a substitute rather than a supplementary tool.
First-order effects
- Users making short queries have reason to verify ChatGPT Search results or fall back to conventional search, limiting immediate substitution away from Google.
- OpenAI’s newly launched paid search feature must improve query interpretation and retrieval consistency before its search positioning can match its conversational appeal.
Second-order effects
- Google faces less immediate pressure on its core lookup use cases, even as ChatGPT Search tests a different answer-led interface for more complex queries.
- Publishers and search marketers have a weaker basis for assuming that answer engines will quickly displace link-based discovery; mixed reliability keeps conventional search traffic and optimization relevant.
Third-order effects
- Search competition is likely to split by task: conversational systems may gain where synthesis is useful, while established engines retain an advantage where users need fast, precise retrieval and source comparison.
- The tension between a single generated answer and information literacy may become a durable product and policy issue if answer engines become a common access layer for the web.
The trend: AI search is evolving toward task-specific coexistence with conventional search, not an immediate winner-take-all replacement.