Libraries and scripts for crawling the TYPO3 page tree. Used for re-caching, re-indexing, publishing applications etc.
Simple image crawler/downloader. Grab images tag and download them using php and phpquery.
A simple crawler (spider) writen in php just for fun, with zero dependencies
A simple web crawler in php to run through the links of a given URL recursively
The source code from the Web Crawler tutorial series.
A PHP flexible web crawler that can login into a website.
A php crawler that finds emails on the internets
Web Crawler - with email/link scraping and proxy support