GlotLID
by cisnlp
Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
AI summary
Language identifier
A language identification model that supports over 2000 languages and can be used for various NLP tasks.
- stars
- 106
- forks
- 7
- watching
- 5
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Language identifier
A tool that identifies languages in text by comparing them to a reference set of patterns.
Language identifier
A deep learning-based system for identifying spoken language in audio files.
Language dictionary
A Galician language dictionary for use in spell-checking software
Language Detector
A Ruby-based language detection tool that uses N-Gram based text categorization to identify the language of given text.
NLP datasets
A curated list of Natural Language Processing datasets used to train and evaluate NLP models.
Language detector
A system designed to identify the language of an arbitrary text string using machine learning and multiple data sources.
Language detector
A library that accurately detects the language of short to long text inputs without requiring external APIs or configuration.
Language detector
A library for detecting and identifying languages in text
Language extractor toolkit
Developing tools and scripts to extract data from low-resource languages, focusing on language processing and machine learning applications.
cltk/cltk843
NLP toolkit
A Python library offering natural language processing capabilities for pre-modern languages
Language detector
An implementation of GitHub's Linguist for syntax highlighting and language detection in Crystal programming language
Language detector
An accurate language detection library for Java and the JVM suitable for both short and long text inputs.
ydli-ai/csl582
Chinese Scientific Dataset
A large-scale dataset for natural language processing tasks focused on Chinese scientific literature, providing tools and benchmarks for NLP research.
Language detector collection tool
Detects languages of Chinese minority websites and collects them into a dataset.
Language detector
A Rust library for detecting the language of text, including script recognition and reliability estimation.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions GlotLID.