crau

github.comtool

A lightweight command-line tool for archiving the Web and playing archives: you just need a list of URLs. The name "crau" stems from the Brazilian pronounciation of "crawl". (Stable)

from

Web Archiving

added

2026-10-10

likes

0

similar

1. ▲
   Cairn github.com

   tool category #web-archiving link ↗

   A npm package and CLI tool for saving webpages as single HTML files. It does not produce WARC or WACZ archives. (Stable)

   
2. ▲
   crocoite github.com

   tool category #web-archiving link ↗

   Crawl websites using headless Google Chrome/Chromium and save resources, static DOM snapshot and page screenshots to WARC files. (In Development)

3. ▲
   grab-site github.com

   tool category #web-archiving link ↗

   The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns. (Stable)

4. ▲
   Go Get Crawl github.com

   tool category #web-archiving link ↗

   Extract web archive data using Wayback Machine and Common Crawl. (Stable)

   
5. ▲
   crawley github.com

   tool category #go link ↗

   Web scraper/crawler for cli.

6. ▲
   webarchive github.com

   tool category #web-archiving link ↗

   Golang readers for ARC and WARC webarchive formats (Golang).

   

Web Archiving › Tools & Software > Acquisition: “A lightweight command-line tool for archiving the Web and playing archives: you just need a list of URLs. The name "crau" stems from the Brazilian pronounciation of "crawl". (Stable)”