Awesome Lists

WebCollector

by CrawlScript

Javapushed over 2 years ago

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.

AI summary

Web crawler library

A Java-based framework for building web crawlers with automatic URL detection and content extraction capabilities.

stars
3.1K
forks
1.5K
watching
328
awesome list
1
View on GitHubgithub.com/CrawlScript/WebCollector

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/CrawlScript/WebCollector/links.svg)](https://awesome.facts.dev/awesome/CrawlScript/WebCollector)
HTML
<a href="https://awesome.facts.dev/awesome/CrawlScript/WebCollector"><img src="https://awesome.facts.dev/shield/CrawlScript/WebCollector/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/CrawlScript/WebCollector/links.svg

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.