Java / Crawlers

0
webmagic 🌿
9880 (+3) ⭐

A scalable web crawler framework for Java.

0
crawler4j 🌿
4114 (+0) ⭐

Open Source Web Crawler for Java

0
WebCollector 🌿
2798 (+0) ⭐

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.

0
415 (+0) ⭐

Open-source Enterprise Grade Search Engine Software

0
storm-crawler 🌿
713 (+0) ⭐

A scalable, mature and versatile web crawler based on Apache Storm

0
sitemapgen4j 🌿
143 (+0) ⭐

SitemapGen4j is a library to generate XML sitemaps in Java.

0
woothee-java 🌿
55 (+0) ⭐

Woothee Java implementation and Hive UDF

0
201 (+0) ⭐

The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)

0
serritor 🌿
19 (+0) ⭐

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

0
14 (+0) ⭐

REST and STREAMING crawlers of Twitter (java)

81953 Java libraries
(28807 libraries)
Go
(131304 libraries)
(69710 libraries)
(27435 libraries)
(36291 libraries)
C#
(62324 libraries)
(27414 libraries)
(47551 libraries)
(17129 libraries)
(12866 libraries)
(33985 libraries)
(18802 libraries)
(200731 libraries)
(20525 libraries)
Vue
(27240 libraries)
CSS
(107263 libraries)
(137408 libraries)
(83761 libraries)
(19909 libraries)
C++
(134935 libraries)
C
(105038 libraries)
(62985 libraries)
(84542 libraries)
(11889 libraries)
(81953 libraries)
PHP
(118589 libraries)
(185912 libraries)
(263454 libraries)
(10766 libraries)
Nim
(7146 libraries)
D
(13395 libraries)
(47314 libraries)
(3607 libraries)