I-Spy is a Perl script which identifies new files on various remote FTP and Web sites. It grabs and

Harvest-NG is a collection of Perl modules and scripts which provide a powerful web crawling and sum

Web Secretary is a web page monitoring software. However, it goes beyond the normal functionalities

Datagrab Indexer - Web Crawler, Indexer & Search Engine Extracts urls from the web and start buildin