dogear

enter for all results · esc to close

webarchive-discovery

github.comtool

WARC and ARC full-text indexing and discovery tools, with a number of associated tools capable of using the index shown below. (Stable)

visit github.com ↗
0
sign in to dogear this
from
Web Archiving
added
2026-10-10
likes
0

similar

  1. webarchive-indexing github.com
    tool category #web-archiving link ↗

    Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.

  2. grab-site github.com
    tool category #web-archiving link ↗

    The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns. (Stable)

  3. Web Curator Tool webcuratortool.org
    site category #web-archiving link ↗

    Open-source workflow management for selective web archiving. (Stable)

  4. webarchive github.com
    tool category #web-archiving link ↗

    Golang readers for ARC and WARC webarchive formats (Golang).

  5. Web2Warc github.com
    tool category #web-archiving link ↗

    An easy-to-use and highly customizable crawler that enables anyone to create their own little Web archives (WARC/CDX). (Stable)

  6. UNT Web Archiving Course github.com
    tool category #web-archiving link ↗

Web Archiving › Tools & Software > Search & Discovery: “WARC and ARC full-text indexing and discovery tools, with a number of associated tools capable of using the index shown below. (Stable)”