Skip to content
Ars Technica·

🕸️Meta Pauses Terms Update That Would Let It Crawl Publisher Sites for AI

Your linked sites might be Meta's AI training data

TL;DR

Meta has indefinitely delayed a Business terms update that would have let it crawl linked external sites for AI training, ignoring robots.txt. Courts in Brazil and Norway blocked the terms, and the UK's CMA opened an investigation. If you run a site Meta can reach, your crawler rules are the only defense you have right now.

Meta just shelved its plan to let it train AI on the open web through Business terms of service. The update was set for October 30, then pushed to November 20, and now it's indefinitely delayed. Pushback came from users, courts, and regulators worldwide. If you run a site linked from a Facebook Business page, this one hits you. The draft terms would have let Meta crawl any external site linked on Facebook and ignore robots.txt preferences. Legal experts flagged the vague language as the real problem. Meta also said it would never use its terms to skirt robots.txt, yet it added no specific language to back that up. The numbers that made publishers nervous: Nieman Lab warned Meta could dodge millions in licensing fees. The terms even asked publishers to create test credentials so Meta's bots could bypass paywalls. Brazil and Norway issued preliminary injunctions, and the UK's Competition and Markets Authority opened a formal probe into whether Meta is abusing a dominant position. Meta's comms VP says crawling practices remain unchanged. Watch whether the delay becomes a quiet rewrite.

Meta Pauses Terms Update That Would Let It Crawl Publisher Sites for AI — Ars Technica

Key Points

1

The update was originally scheduled for October 30, then pushed to November 20 before Meta indefinitely paused it amid global pushback from users, courts, and regulators.

Keep reading — it's free

Enter your email to keep reading — plus the best of AI & tech, daily. Free, forever.

Also get
or

Already a member? Sign in

Metarobots.txtAI trainingweb scrapingpublishers

Comments

Subscribe to join the conversation...

Be the first to comment