HadoopConcatGz

github.comtool

A Splitable Hadoop InputFormat for Concatenated GZIP Files (and *.warc.gz). (Stable)

from

Web Archiving

added

2026-10-10

likes

0

similar

1. ▲
   Jwat-Tools github.com

   tool category #web-archiving link ↗

   Tools for reading/writing/validating WARC/ARC/GZIP files (Java). (Stable)

   
2. ▲
   Jwat github.com

   tool category #web-archiving link ↗

   Libraries for reading/writing/validating WARC/ARC/GZIP files (Java). (Stable)

   
3. ▲
   ffmpeg-concat github.com

   tool category #ffmpeg link ↗
4. ▲
   Grunt-contrib-concat github.com

   tool category #wpo link ↗

   A Grunt plugin to concatenate files.

   
5. ▲
   gohadoop github.com

   tool category #hadoop link ↗
   
6. ▲
   WarcPartitioner github.com

   tool category #web-archiving link ↗

   Partition (W)ARC Files by MIME Type and Year. (Stable)

Web Archiving › Tools & Software > WARC I/O Libraries: “A Splitable Hadoop InputFormat for Concatenated GZIP Files (and *.warc.gz). (Stable)”