anemone
Spider
A web spider framework that crawls domains and collects information about visited pages
Anemone web-spider framework
2k stars
63 watching
324 forks
Language: Ruby
last commit: almost 5 years ago
Linked from 1 awesome list
christian-bromann/awesome-seleniumRelated projects:
| Repository | Description | Stars |
|---|---|---|
 chrispenner/firefly | A simple Haskell web framework for building lightweight servers with monad-based request handling. | 87 |
 crepe/crepe | A lightweight Ruby framework for building fast and flexible APIs | 128 |
 stephencelis/crepe | A Ruby-based API framework providing a thin stack for building web applications | 2 |
 spider-gazelle/spider-gazelle | A web framework template built on top of Crystal that aims to provide speed and extensibility for building Ruby-like web applications. | 180 |
 arachne-framework/aristotle | Provides a Clojure interface to RDF and OWL libraries for data modeling and querying | 131 |
 hu17889/go_spider | A modular, concurrent web crawler framework written in Go. | 1,827 |
 kballenegger/kenji | A lightweight Ruby web framework for building backend APIs with clean routing and modular code organization. | 32 |
 3nock/spidersuite | A cross-platform web spider/crawler tool for analyzing and mapping attack surfaces | 614 |
 feng19/spider_man | A high-level web crawling and scraping framework for Elixir. | 23 |
 dyweb/scrala | A web crawling framework written in Scala that allows users to define the start URL and parse response from it | 113 |
 postmodern/spidr | A Ruby web crawling library that provides flexible and customizable methods to crawl websites | 809 |
 jcasts/gin | A lightweight Ruby web framework designed to support large applications with scalability and expressiveness. | 25 |
 elixir-crawly/crawly | A framework for extracting structured data from websites | 994 |
 colinkiama/spider | A tool for quickly generating a basic HTML5 site structure | 2 |
 puerkitobio/gocrawl | A concurrent web crawler written in Go that allows flexible and polite crawling of websites. | 2,036 |