ArchiveSpark

github.comtool

An Apache Spark framework (not only) for Web Archives that enables easy data processing, extraction as well as derivation. (Stable)

from

Web Archiving

added

2026-10-10

likes

0

similar

1. ▲
   Archives Unleashed Toolkit github.com

   tool category #spark link ↗

   Open-source toolkit for analyzing web archives.

   
2. ▲
   Tweet Archvies Unleashed Toolkit github.com

   tool category #web-archiving link ↗

   An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark. (In Development)

   
3. ▲
   Apache Spark (⭐44k) github.com

   tool category #integration link ↗

   Unified analytics engine whose Structured Streaming API provides scalable, fault-tolerant stream processing on the Spark SQL engine.

   
4. ▲
   Apache Spark spark.apache.org

   site category #bigdata link ↗

   A multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.

   
5. ▲
   Apache Spark Streaming spark.apache.org

   site category #bigdata link ↗

   framework for stream processing, part of Spark.

6. ▲
   Apache Spark spark.apache.org

   site category #hadoop link ↗

   Makes it easy to build scalable fault-tolerant streaming applications.

Web Archiving › Tools & Software > Analysis: “An Apache Spark framework (not only) for Web Archives that enables easy data processing, extraction as well as derivation. (Stable)”