The simple, easy to use command line web crawler.
Python Web Crawler with Selenium and PhantomJS
A web crawler crawling all cosmetics information from Sephora implemented in Scrapy
Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
A simple python script written using Selenium and BeautifulSoup to extract every horse's information in the races.
This package is a complete tool for creating a large dataset of images (specially designed -but not only- for machine learning enthusiasts). It can crawl the web, download images, rename / resize / covert the images and merge folders..
Simple command-line client to the Anchore Engine service
Got any useful tips about rivermont/spidy?
... I send out a list of most interesting libraries and apps in the "Python" section to about 1100 subscribers.
Do you want it too?