dogear

enter for all results · esc to close

hyphe

github.comtool

A webcrawler built for research uses with a graphical user interface in order to build web corpuses made of lists of web actors and maps of links between them. (Stable)

visit github.com ↗
0
sign in to dogear this
from
Web Archiving
added
2026-10-10
likes
0

similar

  1. Heritrix github.com
    site category #web-archiving link ↗

    An open source, extensible, web-scale, archival quality web crawler. (Stable)

  2. Squidwarc github.com
    tool category #web-archiving link ↗

    An open source, high-fidelity, page interacting archival crawler that uses Chrome or Chrome Headless directly. (In Development)

  3. Scoop github.com
    tool category #web-archiving link ↗

    High-fidelity, browser-based, single-page web archiving library and CLI for witnessing the web. (Stable)

  4. httpx github.com
    tool category #python link ↗
  5. here github.com
    site category #web-archiving link ↗

    .

  6. webarchive-discovery github.com
    tool category #web-archiving link ↗

    WARC and ARC full-text indexing and discovery tools, with a number of associated tools capable of using the index shown below. (Stable)

Web Archiving › Tools & Software > Search & Discovery: “A webcrawler built for research uses with a graphical user interface in order to build web corpuses made of lists of web actors and maps of links between them. (Stable)”