gv-crawl
by vchahun
Global Voices bitext crawler
AI summary
Text aligner
Automates text extraction and alignment from Global Voices articles to create parallel corpora for low-resource languages.
- stars
- 9
- forks
- 4
- watching
- 1
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Data scraper
A Python script that captures data from vgchartz.com and saves it to a CSV file
crawler
A Python web crawling framework utilizing asyncio and aiohttp for efficient data extraction from websites.
Crawler
A Python-based web crawler for scraping Github user and repository data.
jmg/crawley188
Crawler
A Pythonic framework for building high-speed web crawlers with flexible data extraction and storage options.
Web Crawler
A versatile web crawler built with modern tools and concurrency to handle various crawl tasks
Crawler
A concurrent web crawler written in Go that allows flexible and polite crawling of websites.
Model value alignment
Evaluates and aligns the values of Chinese large language models with safety and responsibility standards
Text analyzer
Analyzes text data to extract patterns of words or characters for password cracking and analysis purposes.
Video model evaluator
A benchmark suite for evaluating the performance of video generative models
Pastebin crawler
Searches public pastebins for specified keywords and returns matching results
Sentence aligner
Automates the process of extracting parallel sentences from comparable corpora to aid in statistical machine translation
crawler
Performs web page crawling at high performance.
Web crawler
A web crawler designed to efficiently collect and prioritize relevant content from the web
Block translator
Enables data translation between Minecraft versions and platforms via an intermediate format.
Dungeon crawler
A dungeon crawler game written in Python, featuring procedurally generated content and turn-based gameplay.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions gv-crawl.
