Reddit blocks every search engine but Google from its recent posts
Search engines other than Google stopped showing recent Reddit posts, 404 Media reported on 24 July 2024, after Reddit changed its robots.txt file. Bing, DuckDuckGo and others could no longer crawl the site, while Google had a $60m deal to train its AI on Reddit's content.
- When
- , first reported
- Kind
- Lock-out
- Status
- In force
- Where
- Everywhere
Who it hit
People searching Reddit through Bing, DuckDuckGo and other alternatives stopped getting its recent posts.
What Reddit said
Reddit said some search engines wouldn't make enforceable promises about how they use its content, including for AI.
Sources
The Verge, press, 24 Jul 2024
"Over the past few weeks, Reddit has started blocking search engines from surfacing recent posts and comments unless the search engine pays up"
404 Media, press, 24 Jul 2024
"Google is now the only search engine that can surface results from Reddit, making one of the web’s most valuable repositories of user generated content exclusive to the internet’s already dominant search engine."