‘Reddit can survive without search’: company reportedly threatens to block Google
online @ online @lemmy.ml Posts 1Comments 94Joined 2 yr. ago
online @ online @lemmy.ml
Posts
1
Comments
94
Joined
2 yr. ago
Deleted
Permanently Deleted
Speaking of this, what parts of the fediverse have added the option to block training generative AI to their respective robots.txt?
https://blog.google/technology/ai/an-update-on-web-publisher-controls/ https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers https://techcrunch.com/2023/09/28/medium-hints-at-a-nascent-media-coalition-to-block-ai-crawlers/
It looks like there's a handful of these lines you'd have to add to robots.txt
Is there anywhere that keeps a comprehensive list of these?