js-crawler
by amoilanen
Web crawler for Node.JS
AI summary
Web crawler
A Node.js module for crawling web sites and scraping their content
- stars
- 254
- forks
- 55
- watching
- 12
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Website scraper
A Node.js library and CLI for scraping websites using Puppeteer and YAML definitions
Web Crawler
A flexible web crawler that can be used to extract data from websites in a scalable and efficient manner
Web crawler
A web crawler designed to efficiently collect and prioritize relevant content from the web
Crawler
A containerized browser-based crawler system for capturing web content in a high-fidelity and customizable manner.
Web tester
A tool for end-to-end testing of web applications by crawling and comparing screenshots.
Web Crawler
A web crawler designed to crawl websites while obeying robots.txt rules, rate limits and concurrency limits, with customizable content handlers for parsing and processing crawled pages.
spider-rs/spider1.2K
Web scraper
A tool for web data extraction and processing using Rust
Link crawler
A tool to crawl websites by exploring links recursively with support for JavaScript rendering.
Crawler library
A web crawling library for .NET that allows customizable crawling and throttling of websites.
Web scraper
A framework for automating web scraping and crawling tasks using Node.js
Web crawler
A web crawler designed to backup websites by recursively crawling and writing WARC files.
Web scraper
Automates web page scraping and text extraction to make any webpage readable
Website scraper
Downloads and crawls web pages, allowing for the archiving of websites.
Web Crawler
A flexible PHP web crawler with configurable traversal algorithms and filters.
Web crawler
A simple command-line web crawler that automatically extracts links from web pages and can be run in parallel for efficient crawling
Featured in 1 awesome list
Each link jumps to the spot where the list mentions js-crawler.
