html2warc
Data converter
Converts offline data into a standard archival format
simple script to convert web resources to a single warc file
18 stars
4 watching
2 forks
Language: Python
last commit: almost 2 years ago
Linked from 1 awesome list
Related projects:
Repository | Description | Stars |
---|---|---|
| Converts HTTP Archive format to Web Archive format | 48 |
| Converts WARC files to static HTML with relative link rewriting and renaming | 41 |
| Converts HTTrack crawls to WARC files by reconstructing requests and responses from logs | 32 |
| A fast streaming library for working with WARC format web archival data | 391 |
| Tools for working with archived web content | 153 |
| Tool for handling Web Archive files | 152 |
| Converts HTML to plain text that can be easily read and formatted as Markdown. | 1,862 |
| Converts HTML to different formats | 4 |
| Tools to identify and convert duplicate records in archived web content | 6 |
| A tool for parsing and generating Web Archive files in JavaScript using Node.js | 95 |
| Converts TrueType font files to compressed Webfont formats for web use | 25 |
| A command-line tool for archiving and playing back websites in WARC format | 59 |
| A library for storing and querying web crawl data in a compact, easily sharable format. | 397 |
| Provides tools for reading and parsing web archive formats used in digital preservation. | 20 |
| A Java library for reading and writing WARC files with a typed API | 48 |