polyglot

Multilingual models

Large language models designed to perform well in multiple languages and address performance issues with current multilingual models.

Polyglot: Large Language Models of Well-balanced Competence in Multi-languages

GitHub

475 stars
21 watching
39 forks
last commit: about 1 year ago

Related projects:

Repository Description Stars
damo-nlp-mt/polylm A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. 76
ibm-granite/granite-3.0-language-models A collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources. 214
xverse-ai/xverse-moe-a36b Develops and publishes large multilingual language models with advanced mixing-of-experts architecture. 36
bilibili/index-1.9b A lightweight, multilingual language model with a long context length 904
microsoft/unicoder This repository provides pre-trained models and code for understanding and generation tasks in multiple languages. 88
shawn-ieitsystems/yuan-1.0 Large-scale language model with improved performance on NLP tasks through distributed training and efficient data processing 591
ieit-yuan/yuan2.0-m32 A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation 180
elanmart/psmm An implementation of a neural network model for character-level language modeling. 50
will-singularity/skywork-mm An empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities 23
alexa/massive A collection of tools and modeling code for a large multilingual Natural Language Understanding dataset 538
untra/polyglot A plugin for Jekyll blogs that enables support for multiple languages and internationalization. 417
kendryte/toucan-llm A large language model with 70 billion parameters designed for chatbot and conversational AI tasks 29
skyworkai/skywork A pre-trained language model developed on 3.2TB of high-quality multilingual and code data for various applications including chatbots, text generation, and math calculations. 1,223
clue-ai/chatyuan Large language model for dialogue support in multiple languages 1,902
01-ai/yi A series of large language models trained from scratch to excel in multiple NLP tasks 7,699