PHP

Crawlers

Crawlers

Growing Popular Active Tagged
🌿 The DomCrawler component eases DOM navigation for HTML and XML documents.
2027 ⭐ (+3)
symfony/dom-crawler v4.2.2 Similar
🌿 The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
1279 ⭐ (+2)
symfony/browser-kit v4.2.2 Similar
🌿 Goutte, a simple PHP Web Scraper
7083 ⭐ (+1)
FriendsOfPHP/Goutte v3.1.0 Similar
🌿 An easy to use, powerful crawler implemented in PHP. Can execute Javascript.
1030 ⭐ (+1)
spatie/crawler 4.3.0 Similar
🌿 Instagram PHP Scraper. Get account information, photos, videos, stories and comments.
🌿 PHP library allowing thumbnail, snapshot or PDF generation from a url or a html page. Wrapper for wkhtmltopdf/wkhtmltoimage
3139 ⭐ (+1)
KnpLabs/snappy v1.1.0 Similar
🌿 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
855 ⭐ (<1)
JayBizzle/Crawler-Detect v1.2.79 Similar
🍂 A PHP library/toolkit designed to handle all of your web scraping needs under a MIT or LGPL license. Also has web server and WebSocket server classes for building custom servers.
🍂 CLI tool to crawl a website and check HTTP status codes
🌿 An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. PHP5.3+, no dependencies.

Once a week...

... I send out a list of most interesting libraries and apps.
Want to get it?