crypto-crawler-rs
Crawler library
A Rust-based library for building and managing cryptocurrency crawlers
A rock-solid cryptocurrency crawler library.
235 stars
8 watching
75 forks
Language: Rust
last commit: almost 2 years ago crawlercryptocurrencywebsocket
Related projects:
| Repository | Description | Stars |
|---|---|---|
 turnersoftware/infinitycrawler | A web crawling library for .NET that allows customizable crawling and throttling of websites. | 248 |
 postmodern/spidr | A Ruby web crawling library that provides flexible and customizable methods to crawl websites | 809 |
 spider-rs/spider | A tool for web data extraction and processing using Rust | 1,234 |
 keep-reth-strange/reth-crawler | A software tool designed to crawl and analyze the Ethereum network | 60 |
 rust-bitcoin/rust-bitcoin | A Rust library for working with Bitcoin protocol messages and data structures | 2,181 |
 webrecorder/browsertrix-crawler | A containerized browser-based crawler system for capturing web content in a high-fidelity and customizable manner. | 677 |
 qinxuye/cola | A high-level framework for building distributed data extractors from web pages | 1,501 |
 dagenix/rust-crypto | A pure-Rust implementation of common cryptographic algorithms | 1,400 |
 puerkitobio/gocrawl | A concurrent web crawler written in Go that allows flexible and polite crawling of websites. | 2,036 |
 internetarchive/brozzler | A distributed web crawler that fetches and extracts links from websites using a real browser. | 678 |
 rndinfosecguy/scavenger | An OSINT bot that crawls pastebin sites to search for sensitive data leaks | 634 |
 fredwu/crawler | A high-performance web crawling and scraping solution with customizable settings and worker pooling. | 945 |
 chenjiandongx/github-spider | A Python-based web crawler for scraping Github user and repository data. | 264 |
 orion-rs/orion | A cryptographic library providing secure encryption and decryption methods | 631 |
 a11ywatch/crawler | Performs web page crawling at high performance. | 51 |