wasp

Web archiver

A containerized web archive and search system using Elastic Search

27 stars

13 watching

4 forks

Language: Java

last commit: almost 4 years ago

Linked from 1 awesome list

Backlinks from these awesome lists:

iipc/awesome-web-archiving

Related projects:

Repository	Description	Stars
sul-dlss/wasapi-downloader	An application to download archives of web archiving projects	6
ukwa/webarchive-discovery	Tools for indexing and discovering archived web content	117
webrecorder/archiveweb.page	A high-fidelity web archiving system for storing and replaying interactive web pages in browsers.	903
derfenix/webarchive	A web-based archive service that allows users to store and manage web pages in various formats.	115
webrecorder/pywb	A toolkit for archiving and replaying web content accurately and efficiently	1,418
vida-nyu/ache	A web crawler designed to efficiently collect and prioritize relevant content from the web	459
oduwsdl/ipwb	A system for dispersing and replaying archived web content using peer-to-peer technology.	617
jarofghosts/memento-client	Provides a simple JavaScript interface to access historical web pages via the Wayback Machine	14
internetarchive/arch	A distributed compute analysis system for web archive collections	15
florents-tselai/warcdb	A library for storing and querying web crawl data in a compact, easily sharable format.	397
archiveteam/grab-site	A web crawler designed to backup websites by recursively crawling and writing WARC files.	1,406
ikreymer/webarchive-indexing	Tools for bulk indexing of WARC/ARC files to create a shared url index	43
elastic/elasticsearch	A distributed search and analytics engine for scalable data storage and real-time search capabilities	71,007
netarchivesuite/jwat	A toolkit for analyzing and extracting data from legacy web archives in a structured format suitable for further analysis or reuse	3
stevepolitodesign/my_site_archive	A simple Rails application for archiving websites	27