View Single Post
Old 07-28-2001, 10:37 AM   #15
Ralph Slate
Registered User
 
Join Date: Apr 2000
Location: Springfield, MA
Posts: 334
Default

Here's a tip on a program that I first read about here, but haven't seen mentioned in a while.

I bought a program called "Botbuster". Their URL is http://www.botbuster.com . It's a set of scripts that detects when a non-search engine is spidering your site, and blocks them using .htaccess.

It's been working great for me -- I block 10-20 bots per day. You have the option to block permanently, or for a specified time period.

They're working on enhancements to it where it will actually tell someone that they've been banned (instead of just blocking access), so that it will educate your users instead of just punishing them.

Try it out on my site -- hit me with a Spider and you'll see that you'll be blocked.

If you decide to buy it, mention my name so I get some brownie points!

Ralph
Ralph Slate is offline