/
Navigation
Chronicles
Browse all articles
Explore
Semantic exploration
Research
Entity momentum
Nexus
Correlations & relationships
Story Arc
Topic evolution
Drift Map
Semantic trajectory animation
Posts
Analysis & commentary
Pulse API
Tech news intelligence API
Browse
Entities
Companies, people, products, technologies
Domains
Browse by publication source
Handles
Browse by social media handle
Detection
Concept Search
Semantic similarity search
High Impact Stories
Top coverage by position
Sentiment Analysis
Positive/negative coverage
Anomaly Detection
Unusual coverage patterns
Analysis
Rivalry Report
Compare two entities head-to-head
Semantic Pivots
Narrative discontinuities
Crisis Response
Event recovery patterns
Connected
Search: /
Command: ⌘K
Embeddings: large
TEXXR

Chronicles

The story behind the story

days · browse · Enter similar · o open

Reddit appears to be blocking search engines that don't rely on Google's indexing; Bing, DuckDuckGo, Mojeek, and others are not showing recent Reddit results

except the ones that pay Barry Schwartz / Search Engine Roundtable : Reddit Blocked Bing Search & Others But Not Google Ben Schoon / 9to5Google : Reddit now blocks all search engines other than Google following ‘misuse’ Ben Lovejoy / 9to5Mac : Reddit blocking all search engines except Google, as it implements AI paywall Will Shanklin / Engadget : AI search engines that don't pay up can't index Reddit content Alex Wilhelm / Cautious Optimism : Data wars, fighting VCs, and how Meta is disrupting the AI model market Konstancija Gasaityt&eabove / Cybernews.com : Google becomes the only search engine to show latest content from Reddit Luke Jones / WinBuzzer : Google Gains Exclusive Access to Reddit Data for AI, Restricting Rival Search Engines Arol Wright / How-To Geek : Reddit Is Blocking Most Search Engines Matt Milano / WebProNews : Google and Brave The Only Search Engines Able To Index Reddit Rani Molla / Sherwood News : Google spent a mere $60 million to build the most important moat in search right now Mastodon: Justin / @JustinH@twit.social : It's ironic that for the past five years #Reddit has moved away from “discussion forum” to just another image-and-short-video scroller, and yet it's their history of rich human-human discussions that are so valuable now.  —  But anyone who's added “reddit” to their searches lately knows that even many years-old threads are polluted with recent spam comments. … Berserk Du Soleil / @aetataureate@gamedev.lgbt : wow — this is wild.  reddit has deindexed itself from all search engines but google, in an effort to both stop AI scraping and force search engines to pay  —  https://www.404media.co/... X: Alex Miller / @alexlmiller : Reddit will no longer show up in regular search results anywhere but Google This is insane, Steve Huffman & @sundarpichai should be ashamed of themselves for doing this deal The open web has been on the brink for years and they're trying to kill it for good @evan_greer : Google has become so useless with ads and AI spam that a lot of people literally add “reddit” to the end of their search to try to find accurate information and now they are leveraging that to tighten their monopoly grip and i am so tired of this bullshit Barry Schwartz / @rustybrick : This might not be true - waiting to hear back from @facan Aric Toler / @arictoler : Considering like 50% of my Google searches are solved by just going to the first Reddit result, this is an *insane* bargain at $60m, and the decimal should be moved over once or twice to the right. https://www.404media.co/... Tim Sweeney / @timsweeneyepic : This is part of a disconcerting acceleration of monopolies expanding to further block competition and take from users. Search engines use to provide links to relevant content. Now they spam users with ads intermixed with scraped and content laundered by AI without attribution. Pranesh Prakash / @pranesh : I had predicted this last year itself. It's foolish to think you can have exclusive licensing of content for “AI” without that harming #competition (and #FOSS) and encouraging oligopolies. That's the very purpose of exclusivity! @vxunderground : .@404mediaco is reporting Reddit is blocking ALL search engine crawls EXCEPT Google - which is currently paying $60,000,000/year for the right to scrape Reddit for AI training data. More information: https://www.404media.co/... Aram Zucker-Scharff / @chronotope : This is shitty and monopolistic of Google. In a way tho it is extremely exciting because it means that Google feels threatened in the one area it seemed to have a full lock on dominance. Alternative Search engines have become popular enough to cause Google to freak out like this. Ori Zilbershtein / @orizilbershtein : Timeline: - Google boosts Reddit in search by over 400% - Google announces a 60M deal with Reddit right after - Reddit announces it seeks to go public 48-72 hours after - Reddit blocks all scraping for competition search engines shortly after 👏Anti 👏Competitive👏Behavior Adam Demasi / @hbkirb : This is shitty on Reddit's part. It makes complete sense now why they've been blocking my server. All Reddit links on The Apple Wiki have an archive. org link next to it, because every link seems “dead”. In fact, Reddit is blocking my server from confirming it's “up”. Ryan Orban / @ryanorban : I use DuckDuckGo and like many will add ‘Reddit’ to the end of a query if I'm looking for real product reviews, comparisons, etc. That stopped working a few weeks ago and now I know why! Joseph Cox / @josephfcox : New from 404 Media: Google is now the only search engine that works on Reddit thanks to its AI deal. Try to search for Reddit results with Bing, DuckDuckGo, or a bunch of others you won't get full results. Further monopoly on valuable information https://www.404media.co/... Emanuel Maiberg / @emanuelmaiberg : AI is causing the internet the lock down. Reddit is blocking all search engines from crawling the site, except Google, which is paying Reddit $60 million a year to scrape it for training data https://www.404media.co/... Megan Gray / @megangra : Surprised that this hasn't generated anticompetitive complaints Google's Exclusive Reddit Access Google (is now the only search engine that can surface results from Reddit (well also Kagi) https://www.404media.co/... Daniel Hanley / @danielahanley : Exclusive deals like this one should be banned. Google could have paid Reddit for access, and Reddit could have offered those same terms to others. But Google is using a similar trick it has used with Apple: the company uses its financial firepower to knee cap its rivals. Forums: Hacker News : Google is the only search engine that works on Reddit now thanks to AI deal r/duckduckgo : Reddit is now blocking major search engines and AI bots — except the ones that pay Theangriestbird To / Beehaw : Google Is the Only Search Engine That Works on Reddit Now, Thanks to AI Deal See also Mediagazer

404 Media Emanuel Maiberg

Discussion

  • @alexlmiller Alex Miller on x
    Reddit will no longer show up in regular search results anywhere but Google This is insane, Steve Huffman & @sundarpichai should be ashamed of themselves for doing this deal The open web has been on the brink for years and they're trying to kill it for good
  • @evan_greer @evan_greer on x
    Google has become so useless with ads and AI spam that a lot of people literally add “reddit” to the end of their search to try to find accurate information and now they are leveraging that to tighten their monopoly grip and i am so tired of this bullshit
  • @rustybrick Barry Schwartz on x
    This might not be true - waiting to hear back from @facan
  • @arictoler Aric Toler on x
    Considering like 50% of my Google searches are solved by just going to the first Reddit result, this is an *insane* bargain at $60m, and the decimal should be moved over once or twice to the right. https://www.404media.co/...
  • @timsweeneyepic Tim Sweeney on x
    This is part of a disconcerting acceleration of monopolies expanding to further block competition and take from users. Search engines use to provide links to relevant content. Now they spam users with ads intermixed with scraped and content laundered by AI without attribution.
  • @pranesh Pranesh Prakash on x
    I had predicted this last year itself. It's foolish to think you can have exclusive licensing of content for “AI” without that harming #competition (and #FOSS) and encouraging oligopolies. That's the very purpose of exclusivity!
  • @vxunderground @vxunderground on x
    .@404mediaco is reporting Reddit is blocking ALL search engine crawls EXCEPT Google - which is currently paying $60,000,000/year for the right to scrape Reddit for AI training data. More information: https://www.404media.co/...
  • @chronotope Aram Zucker-Scharff on x
    This is shitty and monopolistic of Google. In a way tho it is extremely exciting because it means that Google feels threatened in the one area it seemed to have a full lock on dominance. Alternative Search engines have become popular enough to cause Google to freak out like this.
  • @orizilbershtein Ori Zilbershtein on x
    Timeline: - Google boosts Reddit in search by over 400% - Google announces a 60M deal with Reddit right after - Reddit announces it seeks to go public 48-72 hours after - Reddit blocks all scraping for competition search engines shortly after 👏Anti 👏Competitive👏Behavior
  • @hbkirb Adam Demasi on x
    This is shitty on Reddit's part. It makes complete sense now why they've been blocking my server. All Reddit links on The Apple Wiki have an archive. org link next to it, because every link seems “dead”. In fact, Reddit is blocking my server from confirming it's “up”.
  • @ryanorban Ryan Orban on x
    I use DuckDuckGo and like many will add ‘Reddit’ to the end of a query if I'm looking for real product reviews, comparisons, etc. That stopped working a few weeks ago and now I know why!
  • @josephfcox Joseph Cox on x
    New from 404 Media: Google is now the only search engine that works on Reddit thanks to its AI deal. Try to search for Reddit results with Bing, DuckDuckGo, or a bunch of others you won't get full results. Further monopoly on valuable information https://www.404media.co/...
  • @emanuelmaiberg Emanuel Maiberg on x
    AI is causing the internet the lock down. Reddit is blocking all search engines from crawling the site, except Google, which is paying Reddit $60 million a year to scrape it for training data https://www.404media.co/...
  • @megangra Megan Gray on x
    Surprised that this hasn't generated anticompetitive complaints Google's Exclusive Reddit Access Google (is now the only search engine that can surface results from Reddit (well also Kagi) https://www.404media.co/...
  • @danielahanley Daniel Hanley on x
    Exclusive deals like this one should be banned. Google could have paid Reddit for access, and Reddit could have offered those same terms to others. But Google is using a similar trick it has used with Apple: the company uses its financial firepower to knee cap its rivals.
  • r/duckduckgo r on reddit
    Reddit is now blocking major search engines and AI bots — except the ones that pay
  • @florian4gamers Florian Mueller on x
    It says a lot about the state of the web that respecting robots.txt “no crawl” is newsworthy. Can't take anything for granted anymore.
  • @tomzur @tomzur on x
    Wow this is interesting Microsoft confirms Reddit blocked Bing Search Microsoft confirmed. A Microsoft spokesperson told Search Engine Land: “We respect the robots.txt standard. Bing stopped crawling Reddit after they implemented their updated robots.txt file on July 1, which
  • @wavesblog Simonetta Vezzoso on x
    “This is not at all related to our recent partnership with Google” 🤔
  • @rustybrick Barry Schwartz on x
    Microsoft confirms Reddit blocked Bing Search https://searchengineland.com/ ...
  • @kirsons @kirsons on x
    @rustybrick Something tells me the next core update's gonna make Reddit's organic traffic from Google even higher
  • @cyrusshepard @cyrusshepard on x
    Wild: Reddit now blocks all major search engines *except* Google from crawling content This can only increase Google's monopoly power... ... and you can bet regulators will be interested