The rise and fall of robots.txt
www.theverge.com
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
  • Dr_Satan@lemm.eedeleted by creatorEnglish
    11·
    2 years ago

    I think that good behavior is implicitly mandated even if there’s nobody to punish you if you don’t.