Bots, AI scrapers, and other bandwidth-wasters

Given any thoughts to doing something to rate-limit what gets served? Some of these bots are just abusive.

You don't necessarily want to keep out the well-behaved bots (like the major search engines), but some of this is just ridiculous.
 
This time it was Google LLC. even though Google was limited. It ate up 3.25Gig.

It happened at the same time as our host moved teambuick to another server. Hopefully those headaches are over, but be prepared for the next week.
 
Back
Top