• Colonel Panic@programming.dev
    link
    fedilink
    arrow-up
    2
    ·
    5 hours ago

    interesting project, thx for sharing! though:

    There is not currently a way to differentiate between web crawlers that are indexing sites for search purposes, vs crawlers that are training AI models. ANY SITE THIS SOFTWARE IS APPLIED TO WILL LIKELY DISAPPEAR FROM ALL SEARCH RESULTS.