Ignacio@lemmy.ml to Technology@lemmy.ml · 11 months agoDisallow GPTBot to access your siteplatform.openai.comexternal-linkmessage-square13fedilinkarrow-up1120arrow-down16cross-posted to: privacyguides@lemmy.onelemmy_ca_support@lemmy.cahackernews@lemmy.smeargle.fanstechnews@radiation.party
arrow-up1114arrow-down1external-linkDisallow GPTBot to access your siteplatform.openai.comIgnacio@lemmy.ml to Technology@lemmy.ml · 11 months agomessage-square13fedilinkcross-posted to: privacyguides@lemmy.onelemmy_ca_support@lemmy.cahackernews@lemmy.smeargle.fanstechnews@radiation.party
minus-squareEager Eagle@lemmy.worldlinkfedilinkEnglisharrow-up16arrow-down6·11 months agoOr don’t do anything. There are plenty of crawlers out there and disallowing won’t stop the unethical ones.
minus-squareZikeji@programming.devlinkfedilinkEnglisharrow-up25arrow-down2·11 months agoJust because some people might break into my house doesn’t mean I’ll stop locking my doors.
minus-squareEager Eagle@lemmy.worldlinkfedilinkEnglisharrow-up10arrow-down5·11 months agothat doesn’t lock anything, it’s not a security feature.
minus-squareArakwar@kbin.sociallinkfedilinkarrow-up10arrow-down5·11 months agoA house door lock isn’t that much about security either.
minus-squareZikeji@programming.devlinkfedilinkEnglisharrow-up5·11 months agoIt’s a deterrent. Which is a pretty apt comparison for robots.txt and user agent blocking.
minus-squareCaptainAniki@lemmy.flight-crew.orglinkfedilinkEnglisharrow-up2arrow-down5·11 months agodeleted by creator
minus-square5BC2E7@lemmy.worldlinkfedilinkarrow-up1arrow-down1·11 months agoThat is the point. They don’t need to be secure to work as a deterrent
Or don’t do anything. There are plenty of crawlers out there and disallowing won’t stop the unethical ones.
Just because some people might break into my house doesn’t mean I’ll stop locking my doors.
that doesn’t lock anything, it’s not a security feature.
A house door lock isn’t that much about security either.
It’s a deterrent. Which is a pretty apt comparison for robots.txt and user agent blocking.
deleted by creator
That is the point. They don’t need to be secure to work as a deterrent