Major News Outlets Block Internet Archive to Combat AI Scraping
In a move that's shaking up the digital preservation world, major news publishers like The Guardian and The New York Times are blocking access to the Internet Archive. The aim? To prevent AI crawlers from scraping content and to discourage users from bypassing paywalls. Instead, publishers are eyeing lucrative licensing deals with AI companies. This article explores whether this move signals the end of the 'open web,' detailing the tensions between preserving internet history and the commercial interests of publishers.
Feb 6