Awesome Lists

sparkler

by USCDataScience

Javapushed over 3 years ago

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

AI summary

Web Crawler

A high-performance web crawler built on Apache Spark that fetches and analyzes web resources in real-time.

stars
411
forks
141
watching
45
awesome list
1
View on GitHubirds.usc.edu/sparkler

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/USCDataScience/sparkler/links.svg)](https://awesome.facts.dev/awesome/USCDataScience/sparkler)
HTML
<a href="https://awesome.facts.dev/awesome/USCDataScience/sparkler"><img src="https://awesome.facts.dev/shield/USCDataScience/sparkler/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/USCDataScience/sparkler/links.svg

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.