httrack2warc
WARC crawler
Converts HTTrack crawls to WARC files by reconstructing requests and responses from logs
Converts HTTrack crawls to WARC files
32 stars
20 watching
6 forks
Language: Java
last commit: 7 months ago
Linked from 1 awesome list
web-archiving
Related projects:
| Repository | Description | Stars |
|---|---|---|
 webrecorder/har2warc | Converts HTTP Archive format to Web Archive format | 48 |
 archiveteam/grab-site | A web crawler designed to backup websites by recursively crawling and writing WARC files. | 1,406 |
 iipc/warc2html | Converts WARC files to static HTML with relative link rewriting and renaming | 41 |
 internetarchive/warctools | Tools for working with archived web content | 153 |
| iipc/jwarc | A Java library for reading and writing WARC files with a typed API | 48 |
 n0tan3rd/node-warc | A tool for parsing and generating Web Archive files in JavaScript using Node.js | 95 |
 helgeho/web2warc | A Web crawler that creates custom archives in WARC/CDX format | 25 |
| webrecorder/warcio | A fast streaming library for working with WARC format web archival data | 391 |
 chfoo/warcat | Tool for handling Web Archive files | 152 |
 steffenfritz/html2warc | Converts offline data into a standard archival format | 18 |
| helgeho/warcpartitioner | Tool for partitioning and merging Web archive files by MIME type and year | 1 |
 ukwa/webarchive-discovery | Tools for indexing and discovering archived web content | 117 |
 turicas/crau | A command-line tool for archiving and playing back websites in WARC format | 59 |
 nlnwa/gowarcserver | A tool for indexing and serving contents of WARC files. | 15 |
 ikreymer/webarchive-indexing | Tools for bulk indexing of WARC/ARC files to create a shared url index | 43 |