2w ago

Cloudflare offers to make AI pay to crawl websites

28 comments

I don't believe they have that capability
- Oh yes, they have and more, they are one of the most powerfull security and AI company with a ton of services. Perfectly capable to remove the plug of any service and web. Sadly with similar privacy concerns as Google.
  https://www.cloudflare.com/
  
  Okay great. Go ahead and explain to me how they plan to fight an army of bots doing everything they can to be invisible?
- Believe all you want, reality doesn't care.
  
  I agree!
This idea that you could have Cloudflare help by telling off AI crawlers sounds nice, but how long until it becomes a premium feature that requires loads of money to operate because AI companies lobby them to make it inaccessible to the masses? Or something equally as bad happens?
This could further accelerate the arms race between malicious srappers and websites.
My fear is this would create collateral damage, block legitimate scrappers and visitors, hassle people with an increasing number of captcha.
- yeah i think that there’s a good chance for vpn users to be harassed by anti ai measures
They probably can. Link

28 comments