scrape
Scraper
A collection of utility functions and tools to simplify web scraping in Go.
A simple, higher level interface for Go web scraping.
2k stars
41 watching
98 forks
Language: Go
last commit: almost 8 years ago
Linked from 1 awesome list
brucedone/awesome-crawlerRelated projects:
| Repository | Description | Stars |
|---|---|---|
 jakopako/goskyr | A tool to simplify web scraping of list-like structured data from web pages | 35 |
 zhuyingda/webster | A framework for automating web scraping and crawling tasks using Node.js | 515 |
 davemolk/gogetjs | Tools for extracting and analyzing JavaScript files from web pages | 40 |
 gushonorato/mechanize | A web scraping and automation tool for Elixir. | 30 |
 slotix/dataflowkit | A framework for extracting structured data from web pages using CSS selectors. | 662 |
 kkyr/go-recipe | A Go library for scraping recipe data from various websites using HTML scraping and schema-based approaches | 27 |
 spider-rs/spider | A web crawler and scraper built on top of Rust, designed to extract data from the web in a flexible and configurable manner. | 1,140 |
 its0x08/duckduckgo | A tool that scrapes search results from DuckDuckGo using Python | 23 |
 miyagawa/web-scraper | A Perl toolkit for extracting structured data from HTML documents using a DSL-like interface. | 104 |
 skallwar/suckit | A Rust-based web scraping tool that recursively visits and downloads websites to disk. | 747 |
 needmorecowbell/giggity | A tool to scrape and store hierarchical data about GitHub organizations, users, or repositories. | 126 |
 antchfx/antch | A framework for building fast and efficient web crawlers and scrapers in Go. | 260 |
 benibela/xidel | A tool to extract data from web pages using various query languages and selectors. | 686 |
 jaimeiniesta/metainspector | A Ruby gem for web scraping and extracting metadata from web pages. | 1,036 |
 jjelosua/doga_scraper | A tool that extracts and converts Galician Official journal documents to different formats based on input year. | 0 |