cm0002@lemmy.world to Technology@lemmy.worldEnglish · 11 天前Open Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comexternal-linkmessage-square25fedilinkarrow-up1390arrow-down14
arrow-up1386arrow-down1external-linkOpen Source devs say AI crawlers dominate traffic, forcing blocks on entire countriesarstechnica.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 11 天前message-square25fedilink
minus-squarehenfredemars@infosec.publinkfedilinkEnglisharrow-up28·11 天前Even mainly text-mode sites like LWN are feeling the strain and finding it hard to support all this parasite bots.
minus-squarePlutoniumAcid@lemmy.worldlinkfedilinkEnglisharrow-up21·11 天前Sure, but the challenge is how to block them without putting undue load on humans. In the olden days, you’d just host a webserver and be done with it. Today you need elaborate setups to trick bots. It’s a losing proposition.
minus-squarewhyNotSquirrel@sh.itjust.workslinkfedilinkEnglisharrow-up5·10 天前Is there a tools to not have to manually block them? Like an updated list of AIshit IP?
Even mainly text-mode sites like LWN are feeling the strain and finding it hard to support all this parasite bots.
So don’t support them. Block them!
Sure, but the challenge is how to block them without putting undue load on humans.
In the olden days, you’d just host a webserver and be done with it. Today you need elaborate setups to trick bots. It’s a losing proposition.
Is there a tools to not have to manually block them? Like an updated list of AIshit IP?