scrape
Scraper
A collection of utility functions and tools to simplify web scraping in Go.
A simple, higher level interface for Go web scraping.
2k stars
41 watching
99 forks
Language: Go
last commit: almost 10 years agoLinked from 1 awesome list
brucedone/awesome-crawlerRelated projects:
| Repository | Description | Stars |
|---|---|---|
 jakopako/goskyr | A tool to simplify web scraping of list-like structured data from web pages | 36 |
 zhuyingda/webster | A framework for automating web scraping and crawling tasks using Node.js | 518 |
 davemolk/gogetjs | Tools for extracting and analyzing JavaScript files from web pages | 41 |
 gushonorato/mechanize | A web scraping and automation tool for Elixir. | 30 |
 slotix/dataflowkit | A framework for extracting structured data from web pages using CSS selectors. | 667 |
 kkyr/go-recipe | A Go library for scraping recipe data from various websites using HTML scraping and schema-based approaches | 27 |
 spider-rs/spider | A tool for web data extraction and processing using Rust | 1,234 |
 its0x08/duckduckgo | A tool that scrapes search results from DuckDuckGo using Python | 23 |
 miyagawa/web-scraper | A Perl toolkit for extracting structured data from HTML documents using a DSL-like interface. | 104 |
 skallwar/suckit | A Rust-based web scraping tool that recursively visits and downloads websites to disk. | 750 |
 needmorecowbell/giggity | A tool to scrape and store hierarchical data about GitHub organizations, users, or repositories. | 127 |
 antchfx/antch | A framework for building fast and efficient web crawlers and scrapers in Go. | 261 |
 benibela/xidel | A tool to extract data from web pages using various query languages and selectors. | 690 |
 jaimeiniesta/metainspector | A Ruby gem for web scraping and extracting metadata from web pages. | 1,038 |
 jjelosua/doga_scraper | A tool that extracts and converts Galician Official journal documents to different formats based on input year. | 0 |