A pay-to-scrape AI licensing standard is now official
TL;DR
The Really Simple Licensing (RSL) 1.0 standard is now official, enabling publishers to set licensing and payment rules for AI web crawlers. Backed by major companies, it expands on robots.txt but cannot block non-paying scrapers alone.
Tags
An open licensing standard that aims to make AI companies pay for the content they vacuum up across the web is now an official specification. Really Simple Licensing 1.0 - or RSL for short - gives publishers the ability to dictate licensing and compensation rules to the web crawlers that visit their sites.
The RSL Collective announced the standard in September with backing from Yahoo, Ziff Davis, and O'Reilly Media. It's an expansion of the robots.txt file, which outlines the parts of a website a web crawler can access. Though RSL alone can't block AI scrapers that don't pay for a license, the web infrastructure providers that support the s …