SeimiCrawler
一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
AI summary
Crawler framework
A distributed crawler framework that simplifies the process of building crawlers using Spring Boot and Redis
- stars
- 2K
- forks
- 681
- watching
- 176
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Crawler framework
A Java framework for building web-based crawlers with features like distributed crawling and proxy support.
wspl/creeper780
Crawler framework
A framework for building cross-platform web crawlers using Go
Web crawler
A PHP framework for asynchronous internet crawling and web scraping
Crawler library
A web crawling library for .NET that allows customizable crawling and throttling of websites.
crawler framework
A PHP framework for building distributed web crawlers with modular design and extensibility
Crawler
A modular, concurrent web crawler framework written in Go.
dyweb/scrala113
Web crawler framework
A web crawling framework written in Scala that allows users to define the start URL and parse response from it
Crawler framework
A scalable and versatile web crawling framework based on Apache Storm
Web Crawler Framework
A minimalist web crawler framework built on top of miners and structure-based data extraction
qinxuye/cola1.5K
Crawler library
A high-level framework for building distributed data extractors from web pages
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
Web Crawler
A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages.
howie6879/ruia1.8K
Crawler framework
An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling
hominee/dyer135
Web crawler
A fast and flexible web crawling tool with features like asynchronous I/O and event-driven design.
Web crawler
A framework for building fast and efficient web crawlers and scrapers in Go.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions SeimiCrawler.
