1077
AI companies are violating a basic social contract of the web and and ignoring robots.txt
(www.theverge.com)
This is a most excellent place for technology news and articles.
Copyright law in general needs changing though that's the real problem. I don't see the advantage of legally mandating that a hacky workaround solution becomes a legally mandated requirement.
Especially because there are many many legitimate reasons to ignore robots.txt including it being misconfigured or it just been set up for search engines when your bot isn't a search engine crawler.