WarcPartitioner
by helgeho
Partition (W)ARC Files by MIME Type and Year
AI summary
ARC file processor
Tool for partitioning and merging Web archive files by MIME type and year
- stars
- 1
- forks
- 1
- watching
- 2
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
WARC Indexer
Tools for bulk indexing of WARC/ARC files to create a shared url index
Crawler
A Web crawler that creates custom archives in WARC/CDX format
Duplicate converter
Tools to identify and convert duplicate records in archived web content
WARC library
A fast streaming library for working with WARC format web archival data
Web archive parser
Provides tools for reading and parsing web archive formats used in digital preservation.
WARC parser
A tool for parsing and generating Web Archive files in JavaScript using Node.js
chfoo/warcat152
Archive tool
Tool for handling Web Archive files
Web archive indexer
Tools for indexing and discovering archived web content
WARC tools
Tools for working with archived web content
Converter
Converts HTTP Archive format to Web Archive format
Data processor
A framework for efficient data processing and extraction from archival collections, enabling the transformation of raw data into more accessible formats.
WARC crawler
Converts HTTrack crawls to WARC files by reconstructing requests and responses from logs
Web archiver
A web archiving tool that archives websites with high-fidelity preservation capabilities.
lord/wargo261
Rust compiler
An tool for easy compilation and testing of Rust applications on WebAssembly platforms.
Web crawler
A web crawler designed to backup websites by recursively crawling and writing WARC files.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions WarcPartitioner.
