Awesome Lists

gocrawl

by PuerkitoBio

Gopushed over 5 years ago

Polite, slim and concurrent web crawler.

AI summary

Crawler

A concurrent web crawler written in Go that allows flexible and polite crawling of websites.

stars
2K
forks
193
watching
108
awesome list
1
View on GitHub

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/PuerkitoBio/gocrawl/links.svg)](https://awesome.facts.dev/awesome/PuerkitoBio/gocrawl)
HTML
<a href="https://awesome.facts.dev/awesome/PuerkitoBio/gocrawl"><img src="https://awesome.facts.dev/shield/PuerkitoBio/gocrawl/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/PuerkitoBio/gocrawl/links.svg

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.