Tea@programming.dev to Technology@lemmy.worldEnglish · 16 days agoWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comexternal-linkmessage-square10fedilinkarrow-up197arrow-down13cross-posted to: technology@lemmy.zip
arrow-up194arrow-down1external-linkWikipedia is giving AI developers its data to fend off bot scrapersenterprise.wikimedia.comTea@programming.dev to Technology@lemmy.worldEnglish · 16 days agomessage-square10fedilinkcross-posted to: technology@lemmy.zip
minus-squareMonument@lemmy.sdf.orglinkfedilinkEnglisharrow-up13·16 days agoNo, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.
No, because there isn’t a single IP range or user agent, and many developers are going to lengths to defeat anti-scraping measures, which include user agent spoofing as well as vpns and the like to mask the source of the traffic.