crawly
Spider
A framework for extracting structured data from websites
Crawly, a high-level web crawling & scraping framework for Elixir.
994 stars
20 watching
115 forks
Language: Elixir
last commit: about 2 years agoLinked from 1 awesome list
crawlercrawlingelixirerlangextract-datascraperscrapingscraping-websitesspider
h4cc/awesome-elixirRelated projects:
| Repository | Description | Stars |
|---|---|---|
 feng19/spider_man | A high-level web crawling and scraping framework for Elixir. | 23 |
 anonyfox/elixir-scrape | A tool for extracting structured data from web resources using information-retrieval techniques. | 328 |
 fredwu/crawler | A high-performance web crawling and scraping solution with customizable settings and worker pooling. | 945 |
 spider-rs/spider | A tool for web data extraction and processing using Rust | 1,234 |
 hu17889/go_spider | A modular, concurrent web crawler framework written in Go. | 1,827 |
 gushonorato/mechanize | A web scraping and automation tool for Elixir. | 30 |
 pigmej/exelli | An Elixir wrapper with a simple syntax for building web applications. | 16 |
 junekelly/sneeze | Tools for rendering Elixir data structures into HTML | 59 |
 antchfx/antch | A framework for building fast and efficient web crawlers and scrapers in Go. | 261 |
 dyweb/scrala | A web crawling framework written in Scala that allows users to define the start URL and parse response from it | 113 |
 howie6879/ruia | An async web scraping micro-framework built with asyncio and aiohttp to simplify URL crawling | 1,753 |
 elixir-soap/soap | A Elixir library to interact with SOAP web services | 136 |
 postmodern/spidr | A Ruby web crawling library that provides flexible and customizable methods to crawl websites | 809 |
 chenjiandongx/github-spider | A Python-based web crawler for scraping Github user and repository data. | 264 |
 rdf-elixir/sparql-ex | An implementation of the SPARQL query language in Elixir to execute queries against RDF data structures and protocol endpoints. | 39 |