Cynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 1 month agoHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizexternal-linkmessage-square60fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizCynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 1 month agomessage-square60fedilink
minus-squarethanks_shakey_snake@lemmy.calinkfedilinkarrow-up0·1 month agoLie. Or at best, dangerously wrong. Like saying “Crosswalks make cars incapable of harming pedestrians who stay within them.”
minus-squareJackbyDev@programming.devlinkfedilinkEnglisharrow-up0·1 month agoIt’s better than saying something like “there’s no point in robots.txt because bots can disobey is” though.
minus-squareReversalHatchery@beehaw.orglinkfedilinkEnglisharrow-up0·edit-21 month agoIs it, though? I mean, robots.txt is the Do Not Track of the opposite side of the connection.
minus-squarethanks_shakey_snake@lemmy.calinkfedilinkarrow-up0·1 month agoMaybe? But it’s not like that’s the only alternative thing to say, lol
Lie. Or at best, dangerously wrong. Like saying “Crosswalks make cars incapable of harming pedestrians who stay within them.”
It’s better than saying something like “there’s no point in robots.txt because bots can disobey is” though.
Is it, though?
I mean, robots.txt is the Do Not Track of the opposite side of the connection.
Maybe? But it’s not like that’s the only alternative thing to say, lol