The Bad Robot Blocker is a simple PHP script designed to trap bad robots and spiders from accessing your website. Bad robots and spiders will ignore anything in your robots.txt file and will attempt to access the directories/files listed in this file. All you need to do is add an entry to your
robots.txt file pointing to the directory where the script file is, and once they attempt to access
this directory, a message telling them they are banned in displayed in the form of a HTML page.
What also happens is that the script will add an entry to your .htaccess file in the root directory
of your website to deny access from their IP address, and also full details of the robot/spider are
logged in a tab delimited file called botfile.txt which you can download via FTP and open in either
a text editor or import into your favourite spreadsheet application.
This script is very quick and easy to install, you only need to modify and upload two files.
Support thread is at http://forums.oscommerce.com/index.php?showtopic=318071