reth-crawler
Crawler
A software tool designed to crawl and analyze the Ethereum network
Reth crawler
60 stars
5 watching
8 forks
Language: Rust
last commit: about 1 year ago
Linked from 1 awesome list
jmcph4/awesome-rethRelated projects:
| Repository | Description | Stars |
|---|---|---|
 crypto-crawler/crypto-crawler-rs | A Rust-based library for building and managing cryptocurrency crawlers | 235 |
 rndinfosecguy/scavenger | An OSINT bot that crawls pastebin sites to search for sensitive data leaks | 634 |
 webrecorder/browsertrix-crawler | A containerized browser-based crawler system for capturing web content in a high-fidelity and customizable manner. | 677 |
 fredwu/crawler | A high-performance web crawling and scraping solution with customizable settings and worker pooling. | 945 |
 attestate/crawler | A tool for retrieving on-chain data from Ethereum and other blockchain networks in a modular, efficient manner. | 6 |
 hominee/dyer | A fast and flexible web crawling tool with features like asynchronous I/O and event-driven design. | 135 |
 archiveteam/grab-site | A web crawler designed to backup websites by recursively crawling and writing WARC files. | 1,406 |
 internetarchive/brozzler | A distributed web crawler that fetches and extracts links from websites using a real browser. | 678 |
 joenorton/rubyretriever | A Ruby-based tool for web crawling and data extraction, aiming to be a replacement for paid software in the SEO space. | 143 |
 keep-starknet-strange/gomu-gomu-no-gatling | A benchmarking tool for Starknet sequencers | 22 |
 puerkitobio/fetchbot | A flexible web crawler that follows robots.txt policies and crawl delays. | 787 |
| puerkitobio/gocrawl | A concurrent web crawler written in Go that allows flexible and polite crawling of websites. | 2,036 |
 brendonboshell/supercrawler | A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages. | 380 |
 matteoredaelli/ebot | An Erlang-based web crawler designed to be scalable and highly configurable | 330 |
 elixir-crawly/crawly | A framework for extracting structured data from websites | 994 |