goskyr

Web scraper

A tool to simplify web scraping of list-like structured data from web pages

A configurable command-line web scraper written in go with auto configuration capability

GitHub

36 stars
3 watching
5 forks
Language: Go
last commit: about 1 month ago
gogolangscraperwebscraping

Related projects:

Repository Description Stars
yhat/scrape A collection of utility functions and tools to simplify web scraping in Go. 1,513
kkyr/go-recipe A Go library for scraping recipe data from various websites using HTML scraping and schema-based approaches 27
davemolk/gogetjs Tools for extracting and analyzing JavaScript files from web pages 41
slotix/dataflowkit A framework for extracting structured data from web pages using CSS selectors. 667
miyagawa/web-scraper A Perl toolkit for extracting structured data from HTML documents using a DSL-like interface. 104
jjelosua/doga_scraper A tool that extracts and converts Galician Official journal documents to different formats based on input year. 0
spekulatius/phpscraper A web scraping utility for PHP that simplifies the process of extracting information from websites. 544
joseconstela/webparsy A Node.js library and CLI for scraping websites using Puppeteer and YAML definitions 44
s0rg/crawley A utility for systematically extracting URLs from web pages and printing them to the console. 268
spider-rs/spider A tool for web data extraction and processing using Rust 1,234
gushonorato/mechanize A web scraping and automation tool for Elixir. 30
its0x08/duckduckgo A tool that scrapes search results from DuckDuckGo using Python 23
eureka101v/weibospidergo A tool for extracting data from Weibo social media platform using Go programming language and Colly library 66
benibela/xidel A tool to extract data from web pages using various query languages and selectors. 690
jaimeiniesta/metainspector A Ruby gem for web scraping and extracting metadata from web pages. 1,038