Apache Nutch
open source web crawler.
similar
-
-
-
Apache Cassandra cassandra.apache.org
The right choice when you need scalability and high availability without compromising performance.
-
-
Apache NiFi nifi.apache.org
An easy to use, powerful, and reliable system to process and distribute data.
-
Apache Lens lens.apache.org
Big Data › Applications: “open source web crawler.”
Hadoop › Search Engine Framework: “Apache Nutch is a highly extensible and scalable open source web crawler software project.”