Automated pentest framework for offensive security experts
Goutte, a simple PHP Web Scraper
The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Get account information, photos, videos, stories and comments.
PHP library allowing thumbnail, snapshot or PDF generation from a url or a html page. Wrapper for wkhtmltopdf/wkhtmltoimage
The DomCrawler component eases DOM navigation for HTML and XML documents.
CLI tool to crawl a website and check HTTP status codes