Online


Robot Exclusion Protocol
info.webcrawler.com/mak/projects/robots/norobots.html

Tom Christansen's CPAN locator
www.perl.com/CPAN/