crau
Web archiver
A command-line tool for archiving and playing back websites in WARC format
Easy-to-use Web archiver
59 stars
4 watching
10 forks
Language: Python
last commit: over 3 years agoLinked from 1 awesome list
iipc/awesome-web-archivingRelated projects:
| Repository | Description | Stars |
|---|---|---|
 peterk/warcworker | A web archiving tool that archives websites with high-fidelity preservation capabilities. | 57 |
 archiveteam/grab-site | A web crawler designed to backup websites by recursively crawling and writing WARC files. | 1,406 |
 webrecorder/warcio | A fast streaming library for working with WARC format web archival data | 391 |
 chfoo/warcat | Tool for handling Web Archive files | 152 |
 internetarchive/warctools | Tools for working with archived web content | 153 |
| internetarchive/warcprox | An HTTP proxy designed to capture and archive web traffic, including encrypted HTTPS connections. | 389 |
| webrecorder/har2warc | Converts HTTP Archive format to Web Archive format | 48 |
 richardlehane/webarchive | Provides tools for reading and parsing web archive formats used in digital preservation. | 20 |
| webrecorder/archiveweb.page | A high-fidelity web archiving system for storing and replaying interactive web pages in browsers. | 903 |
 nla/httrack2warc | Converts HTTrack crawls to WARC files by reconstructing requests and responses from logs | 32 |
 n0tan3rd/squidwarc | An archival crawler built on top of Chrome or Chromium to preserve the web in high fidelity and user scriptable manner | 170 |
 ikreymer/webarchive-indexing | Tools for bulk indexing of WARC/ARC files to create a shared url index | 43 |
 wabarc/rivet | A tool for archiving webpages to IPFS | 12 |
| webrecorder/pywb | A toolkit for archiving and replaying web content accurately and efficiently | 1,418 |
| wabarc/cairn | A tool for archiving web pages as single HTML files | 45 |