#warc (10 Repositories)
Ranked open-source repositories tagged with #warc, scored by pull request acceptance likelihood and maintainer engagement velocity.
54.4%
31.6h
10 repositories tagged #warc
webrecorder/browsertrix-crawler
Run a high-fidelity browser-based web archiving crawler in a single Docker container
webrecorder/browsertrix
Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!
webrecorder/archiveweb.page
A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!
webrecorder/replayweb.page
Serverless replay of web archives directly in the browser
internetarchive/heritrix3
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
commoncrawl/news-crawl
News crawling with StormCrawler - stores content as WARC
commoncrawl/cdx_toolkit
A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
chatnoir-eu/chatnoir-resiliparse
A robust web archive analytics toolkit
helgeho/ArchiveSpark
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
webrecorder/warcio
Streaming WARC/ARC library for fast web archive IO