Resident Pulser@infosec.pubB to Pulse of Truth@infosec.pubEnglish · 1 month agoAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comexternal-linkmessage-square15fedilinkarrow-up1135arrow-down14file-textcross-posted to: artificial_intel@lemmy.mltechnology@lemmy.world
arrow-up1131arrow-down1external-linkAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comResident Pulser@infosec.pubB to Pulse of Truth@infosec.pubEnglish · 1 month agomessage-square15fedilinkfile-textcross-posted to: artificial_intel@lemmy.mltechnology@lemmy.world
minus-squareBlaster M@lemmy.worldlinkfedilinkEnglisharrow-up5·1 month agoRather funny that some of these are in code if(useragent == chatgpt) kind of sillyness. You need heiuristics to detect scrapers, because they’ll just report their user agent as the average user’s browser.
Rather funny that some of these are in code if(useragent == chatgpt) kind of sillyness. You need heiuristics to detect scrapers, because they’ll just report their user agent as the average user’s browser.