Technology

Meta commercial terms update paused following AI scraping backlash

Meta commercial terms update paused following AI scraping backlash

Meta has indefinitely delayed its planned Meta commercial terms update after facing intense pressure from news publishers, regulators, and lawmakers. The proposed changes would have required Meta Business account holders to allow the company to use content from linked external websites for AI training purposes. A Meta spokesperson told Reuters, “We’re pausing the changes as we continue to engage with stakeholders and take our time to get this right.” This decision follows global legal challenges and investigations into whether the company was attempting to bypass existing web scraping protections to secure massive datasets for artificial intelligence development.

The proposed changes and the immediate backlash

Meta originally intended to implement the updated commercial terms on October 30, 2026, before pushing the date back to November 20. The core of the controversy involved requirements for Meta Business account users that would have granted the company extensive rights to crawl and utilize content from external sites linked to Facebook pages. Legal experts warned Nieman Lab that the language in the update was sufficiently vague to potentially allow Meta to ignore the scraping preferences defined in robots.txt files, which are standard instructions used by website owners to tell automated bots which parts of a site should not be accessed.

The implications were particularly significant for news organizations. Because most news publishers maintain a presence on Facebook to reach audiences, the new terms would have effectively forced them to grant Meta access to their proprietary content. This access would have facilitated the exhaustive crawling of off-Facebook content to feed Meta's AI models. Critics argued that such a move could allow Meta to avoid paying millions of dollars in licensing fees that are typically required when using high-quality journalistic content for machine learning training.

Technical requirements for publishers

The proposed terms included specific technical mandates that further alarmed industry leaders. According to reports from Ars Technica, the update would have required publishers to provide Meta's bots with test credentials. This measure was designed to ensure that Meta's crawlers could reliably bypass paywalls on external websites, ensuring that even subscription-based content was available for AI training data collection. This requirement stripped publishers of their ability to protect their most valuable, gated content from being ingested by Meta's systems.

Global regulatory and legal opposition

The pushback against the Meta commercial terms update was not limited to industry groups; it quickly escalated into formal legal and regulatory challenges across multiple jurisdictions. Courts in Norway and Brazil issued preliminary injunctions to block the implementation of the terms following lawsuits filed by local organizations. These legal actions sought to prevent the company from enforcing terms that could undermine the digital sovereignty and intellectual property of content creators within those nations.

In the United Kingdom, the regulatory landscape shifted as the Competition and Markets Authority (CMA) launched a formal investigation. The CMA is examining whether Meta utilized its dominant market position to gain unfair access to valuable AI training data. This investigation highlights the growing concern among antitrust regulators regarding the intersection of social media dominance and the data-hungry requirements of generative artificial intelligence.

EntityAction TakenContext
Courts in BrazilPreliminary InjunctionBlocking the implementation of new terms following local lawsuits.
Courts in NorwayPreliminary InjunctionBlocking the implementation of new terms following local lawsuits.
UK CMAFormal InvestigationInvestigating potential exploitation of market dominance to seize AI data.
US SenateInquiry LettersBipartisan requests for Meta to withdraw the proposed terms.

Industry reactions and the 'development' loophole

Industry leaders expressed profound frustration with Meta's approach to the policy change. Theo Bamber, the chief executive of the UK’s News Media Association, described the company's actions as exhibiting "staggering" arrogance. Bamber argued that Meta's attempts to soften the blow by removing the specific word "train" from the terms of service were ineffective and misleading.

The concern stems from the fact that the revised language replaced "training" with "developing." According to Bamber, the phrase "develop any business product" poses the same fundamental threat to publishers as the original wording. He noted that the term remains broad enough to allow Meta to use any scraped content for a wide variety of commercial purposes, leaving publishers with little certainty regarding how their intellectual property would be utilized. This semantic shift was viewed by many in the media sector as an attempt to bypass scrutiny without actually addressing the underlying data extraction concerns.

Political intervention in the United States

The controversy also gained significant traction in the United States, where it attracted bipartisan attention from the Senate. Senators Adam Schiff (D-Calif.) and Marsha Blackburn (R-Tenn.) both took action by sending letters to Meta requesting that the company withdraw the proposed terms of service update. This unified front suggests that the issue of AI data scraping and its impact on the media ecosystem is a rare point of agreement in the current political climate.

Meta's response to this political and industry pressure came via Andy Stone, the company's vice president of communications. In a post on X, Stone stated that Meta had heard the feedback from publishers and intended to pause the policy changes. He emphasized that the company intends to engage in full consultation with industry leaders and groups, noting that the implementation would be delayed if such consultations extended beyond the original November 20 deadline.

The status of robots.txt and crawling protections

Despite the pause in the commercial terms update, Meta has maintained its stance regarding its technical crawling practices. The company has issued reminders to business page owners stating that its existing crawling practices remain unchanged. Meta asserts that content owners can continue to signal their preferences through the use of robots.txt files, which are the industry-standard method for managing bot access.

However, critics remain skeptical of these assurances. Nieman Lab has pointed out a significant gap in Meta's revised approach: while the company has promised to consult with publishers, it has not yet included specific, binding language in its terms of service that explicitly guarantees respect for robots.txt preferences. This lack of formal commitment means that, even with the pause, the fundamental tension between Meta's desire for massive AI datasets and the rights of publishers to control their own content remains unresolved.