Clicky

  • Login
  • Register
  • Submit Your Content
  • Contact Us
Thursday, July 3, 2025
World Tribune
No Result
View All Result
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food
Submit
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food
No Result
View All Result
World Tribune
No Result
View All Result

Cloudflare to block AI firms from scraping content without consent

July 1, 2025
in News
Reading Time: 3 mins read
A A
Cloudflare to block AI firms from scraping content without consent
0
SHARES
ShareShareShareShareShare

READ ALSO

Why Hong Kong is beating Wall Street as the top spot for IPOs

House GOP stalls ahead of key vote

Jaque Silva | Nurphoto | Getty Images

Internet firm Cloudflare will start blocking artificial intelligence crawlers from accessing content without website owners’ permission or compensation by default, in a move that could significantly impact AI developers’ ability to train their models.

Starting Tuesday, every new web domain that signs up to Cloudflare will be asked if they want to allow AI crawlers, effectively giving them the ability to prevent bots from scraping data from their websites. The company will also allow publishers to charge AI crawlers for access using a new “pay per crawl” model.

Cloudflare is what’s called a content delivery network, or CDN. It helps businesses deliver online content and applications faster by caching the data closer to end-users. They play a significant role in making sure people can access web content seamlessly every day.

Roughly 16% of global internet traffic goes directly through Cloudflare’s CDN, the firm estimated in a 2023 report.

“AI crawlers have been scraping content without limits. Our goal is to put the power back in the hands of creators, while still helping AI companies innovate,” said Matthew Prince, co-founder and CEO of Cloudflare, in a statement Tuesday.

“This is about safeguarding the future of a free and vibrant Internet with a new model that works for everyone,” he added.

What are AI crawlers?

AI crawlers are automated bots designed to extract large quantities of data from websites, databases and other sources of information to train large language models from the likes of OpenAI and Google.

Whereas the internet previously rewarded creators by directing users to original websites, according to Cloudflare, today AI crawlers are breaking that model by collecting text, articles and images to generate responses to queries in a way that users don’t need to visit the original source.

This, the company adds, is depriving publishers of vital traffic and, in turn, revenue from online advertising.

Tuesday’s move builds on a tool Cloudflare launched in September last year that gave publishers the ability to block AI crawlers with a single click. Now, the company is going a step further by making this the default for all websites it provides services for.

OpenAI says it declined to participate when Cloudflare previewed its plan to block AI crawlers by default on the grounds that the content delivery network is adding a middleman to the system.

The Microsoft-backed AI lab stressed its role as a pioneer of using robots.txt, a set of code that prevents automated scraping of web data, and said its crawlers respect publisher preferences.

“AI crawlers are typically seen as more invasive and selective when it comes to the data they consumer. They have been accused of overwhelming websites and significantly impacting user experience,” Matthew Holman, a partner at U.K. law firm Cripps, told CNBC.

“If effective, the development would hinder AI chatbots’ ability to harvest data for training and search purposes,” he added. “This is likely to lead to a short term impact on AI model training and could, over the long term, affect the viability of models.”

WATCH: AI engineers are in high demand — but what is the job really like?

Cloudflare to block AI firms from scraping content without consent

Credit: Source link

ShareTweetSendSharePin
Previous Post

Rich Paul adds ‘four teams’ twist to LeBron James-Lakers trade speculation

Next Post

The best Prime Day laptop deals on MacBooks, Chromebooks, Windows machines and more

Related Posts

Why Hong Kong is beating Wall Street as the top spot for IPOs
News

Why Hong Kong is beating Wall Street as the top spot for IPOs

July 3, 2025
House GOP stalls ahead of key vote
News

House GOP stalls ahead of key vote

July 3, 2025
Robinhood stock hits 0 as it roars 30% since S&P 500 snub
News

Robinhood stock hits $100 as it roars 30% since S&P 500 snub

July 3, 2025
Tesla (TSLA) Q2 vehicle deliveries report
News

Tesla (TSLA) Q2 vehicle deliveries report

July 2, 2025
UK government borrowing costs spike amid divisions in Labour party
News

UK government borrowing costs spike amid divisions in Labour party

July 2, 2025
Santander doubles down on UK presence amid Spain’s banking M&A turmoil
News

Santander doubles down on UK presence amid Spain’s banking M&A turmoil

July 2, 2025
Next Post
The best Prime Day laptop deals on MacBooks, Chromebooks, Windows machines and more

The best Prime Day laptop deals on MacBooks, Chromebooks, Windows machines and more

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

What's New Here!

Apple reveals new iOS 26 features and its Liquid Glass redesign at WWDC 2025

Apple reveals new iOS 26 features and its Liquid Glass redesign at WWDC 2025

June 11, 2025
Apple’s AirPods Pro 2 are back on sale for 0

Apple’s AirPods Pro 2 are back on sale for $170

June 6, 2025
Swiss government proposes tough new capital rules in major blow to UBS

Swiss government proposes tough new capital rules in major blow to UBS

June 6, 2025
Oil prices jump and Dow plummets 1.8% after Israel’s attack on Iran stokes fears of wider war

Oil prices jump and Dow plummets 1.8% after Israel’s attack on Iran stokes fears of wider war

June 14, 2025
Jobs report May 2025:

Jobs report May 2025:

June 6, 2025
2025 NBA Finals pick, best bets

2025 NBA Finals pick, best bets

June 5, 2025
Latest stock updates at Walmart, Best Buy and more

Latest stock updates at Walmart, Best Buy and more

June 25, 2025

About

World Tribune is an online news portal that shares the latest news on world, business, health, tech, sports, and related topics.

Follow us

Recent Posts

  • Travis Kelce, Taylor Swift hit a big ‘turning point’ in their relationship
  • Why Hong Kong is beating Wall Street as the top spot for IPOs
  • ‘Massive’ investment in R&D leads China’s Honor to launch world’s thinnest foldable phone
  • Lululemon has had enough of Gen Z’s dupe culture and is suing Costco for allegedly stealing its Scuba jacket and ABC pant designs

Newslatter

Loading
  • Submit Your Content
  • Contact Us
  • Privacy Policy
  • Terms of Use
  • DMCA

© 2024 World Tribune - All Rights Reserved!

No Result
View All Result
  • Home
  • News
  • Business
  • Technology
  • Sports
  • Health
  • Food

© 2024 World Tribune - All Rights Reserved!

Welcome Back!

Login to your account below

Forgotten Password? Sign Up

Create New Account!

Fill the forms below to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In