twitter_langid

Language ID framework

An open-source software framework for training and evaluating hierarchical neural networks for language identification tasks.

A hierarchical character-word neural network for language identification

GitHub

15 stars
6 watching
4 forks
Language: Python
last commit: almost 8 years ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
twerkmeister/ilid A deep learning-based system for identifying spoken language in audio files. 90
alvations/sugarlike A tool that identifies languages in text by comparing them to a reference set of patterns. 1
iassafc/langchainjsdotnet A .NET wrapper around the LangChain.js library to enable seamless integration of AI models into .NET applications. 33
alvations/sugali A system designed to identify the language of an arbitrary text string using machine learning and multiple data sources. 2
pld-linux/apertium-dict-es-gl A dictionary file for machine translation between two languages using a specific rule-based machine translation system 1
cisnlp/glotlid A language identification model that supports over 2000 languages and can be used for various NLP tasks. 106
xiyuzhai-husky-lang/husky A new programming language designed to support the development of hybrid AI systems. 86
korpling/salt A flexible data model and API for representing linguistic data in a language-independent and theory-neutral way. 15
jrwdunham/old-webapp A collaborative web application platform for managing and sharing language data 4
pluskid/mocha.jl A deep learning framework for Julia inspired by Caffe, providing an efficient and modular way to train neural networks. 1,288
nytud/hulu A collection of linguistic datasets and benchmarks for natural language understanding tasks 8
ixa-ehu/ixa-pipe-pos Provides tools for part of speech tagging and lemmatization across multiple languages using machine learning models. 18
akoenig/express-lingua Middleware for internationalizing Express.js applications by automatically determining the user's language and populating views with localized resources. 66
pld-linux/apertium-dict-en-gl An English-Galician language translation dictionary for the Apertium platform. 1
juliatext/languages.jl A package for working with human languages in Julia. 54