Squidwarc
by N0taN3rd
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
AI summary
Web archiver
An archival crawler built on top of Chrome or Chromium to preserve the web in high fidelity and user scriptable manner
- stars
- 170
- forks
- 26
- watching
- 10
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Web archiver
A web archiving tool that archives websites with high-fidelity preservation capabilities.
Web crawler
A web crawler designed to backup websites by recursively crawling and writing WARC files.
Crawler
A Web crawler that creates custom archives in WARC/CDX format
Web Archiver
A graphical user interface layer for preserving and replaying web pages using multiple archiving tools.
Web archiver
A tool for archiving web pages as single HTML files
wabarc/wayback1.8K
Web archiver
A tool for capturing and preserving web content and making it accessible in the future.
Web archiver
A command-line tool for archiving and playing back websites in WARC format
Web archiver
A high-fidelity web archiving system for storing and replaying interactive web pages in browsers.
webrecorder/pywb1.4K
Web archiver
A toolkit for archiving and replaying web content accurately and efficiently
Web Crawler
A distributed web crawler that fetches and extracts links from websites using a real browser.
WARC parser
A tool for parsing and generating Web Archive files in JavaScript using Node.js
Crawler
A containerized browser-based crawler system for capturing web content in a high-fidelity and customizable manner.
WARC crawler
Converts HTTrack crawls to WARC files by reconstructing requests and responses from logs
Converter
Converts HTTP Archive format to Web Archive format
Web archiver
An HTTP proxy designed to capture and archive web traffic, including encrypted HTTPS connections.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions Squidwarc.
