Tea@programming.dev to Technology@lemmy.worldEnglish · edit-227 days agoAI crawlers cause Wikimedia(The umbrella organization of Wikipedia and a dozen or so other crowdsourced knowledge projects) Commons bandwidth demands to surge 50%.diff.wikimedia.orgexternal-linkmessage-square81fedilinkarrow-up1718arrow-down17cross-posted to: technology@beehaw.orgtechnology@lemmy.zip
arrow-up1711arrow-down1external-linkAI crawlers cause Wikimedia(The umbrella organization of Wikipedia and a dozen or so other crowdsourced knowledge projects) Commons bandwidth demands to surge 50%.diff.wikimedia.orgTea@programming.dev to Technology@lemmy.worldEnglish · edit-227 days agomessage-square81fedilinkcross-posted to: technology@beehaw.orgtechnology@lemmy.zip
minus-squareTXL@sopuli.xyzlinkfedilinkEnglisharrow-up1·24 days agoScraper bots don’t read instructions, they just follow links
Scraper bots don’t read instructions, they just follow links