gpt-crawler
by BuilderIO
Crawl a site to generate knowledge files to create your own custom GPT from a URL
AI summary
Content scraper
Automates the process of generating knowledge files to create custom AI models from website content
- stars
- 19.1K
- forks
- 2K
- watching
- 124
Similar projects
Found by comparing what the projects do, not just their names.
Code generator
An AI-powered platform to experiment with software engineering tasks using natural language input.
apify/crawlee16.1K
Web scraper
A tool for building reliable web scraping and browser automation pipelines in Node.js.
gitbookio/gitbook27.3K
Doc site builder
A Next.js based web application for managing and hosting documentation sites using Markdown format
spatie/crawler2.6K
Crawler
A powerful web crawler written in PHP that can execute JavaScript and crawl multiple URLs concurrently.
code4craft/webmagic11.5K
crawler
A framework for building scalable web crawlers in Java.
chart generator
An AI tool to generate charts from text input
Code generator
An interactive code generation and execution tool using AI models
Web crawler
A Java-based web crawler for extracting and processing web page content
git-bug/git-bug8.2K
Bug tracker
A distributed, offline-first bug tracker embedded in git that allows collaborative development without vendor lock-in.
Design converter
A tool for converting Figma designs into live webpages and code, supporting various frameworks and languages.
Frontend framework generator
Enables developers to visually create and generate code for various frontend frameworks
Git repository manager
A standalone UI tool for managing Git repositories, integrating with Windows Explorer and Visual Studio.
Package manager
Provides a package repository and build service for JVM and Android projects
Crawler
A distributed crawling framework that leverages Headless Chrome to scrape dynamic websites
unclecode/crawl4ai18.5K
Web crawler
A web crawling tool designed to extract structured data from the web for use in AI applications
