crypto-crawler-rs
Crawler library
A Rust-based library for building and managing cryptocurrency crawlers
A rock-solid cryptocurrency crawler library.
232 stars
8 watching
74 forks
Language: Rust
last commit: over 1 year ago crawlercryptocurrencywebsocket
Related projects:
| Repository | Description | Stars |
|---|---|---|
 turnersoftware/infinitycrawler | A web crawling library for .NET that allows customizable crawling and throttling of websites. | 248 |
 postmodern/spidr | A Ruby web crawling library that provides flexible and customizable methods to crawl websites | 806 |
 spider-rs/spider | A web crawler and scraper built on top of Rust, designed to extract data from the web in a flexible and configurable manner. | 1,140 |
 keep-reth-strange/reth-crawler | A software tool designed to crawl and analyze the Ethereum network | 60 |
 rust-bitcoin/rust-bitcoin | A Rust library for serializing and deserializing Bitcoin protocol messages and keys. | 2,132 |
 webrecorder/browsertrix-crawler | A containerized browser-based crawler system for capturing web content in a high-fidelity and customizable manner. | 652 |
 qinxuye/cola | A high-level framework for building distributed data extractors from web pages | 1,500 |
 dagenix/rust-crypto | A pure-Rust implementation of common cryptographic algorithms | 1,394 |
 puerkitobio/gocrawl | A concurrent web crawler written in Go that allows flexible and polite crawling of websites. | 2,038 |
 internetarchive/brozzler | A distributed web crawler that fetches and extracts links from websites using a real browser. | 671 |
 rndinfosecguy/scavenger | An OSINT bot that crawls pastebin sites to search for sensitive data leaks | 629 |
 fredwu/crawler | A high-performance web crawling and scraping solution with customizable settings and worker pooling. | 945 |
 chenjiandongx/github-spider | A Python-based web crawler for scraping Github user and repository data. | 264 |
 orion-rs/orion | A cryptographic library providing secure encryption and decryption methods | 545 |
 a11ywatch/crawler | Performs web page crawling at high performance. | 49 |