polyglot
Multilingual models
Large language models designed to perform well in multiple languages and address performance issues with current multilingual models.
Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
475 stars
21 watching
39 forks
last commit: about 1 year ago Related projects:
Repository | Description | Stars |
---|---|---|
damo-nlp-mt/polylm | A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. | 76 |
ibm-granite/granite-3.0-language-models | A collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources. | 214 |
xverse-ai/xverse-moe-a36b | Develops and publishes large multilingual language models with advanced mixing-of-experts architecture. | 36 |
bilibili/index-1.9b | A lightweight, multilingual language model with a long context length | 904 |
microsoft/unicoder | This repository provides pre-trained models and code for understanding and generation tasks in multiple languages. | 88 |
shawn-ieitsystems/yuan-1.0 | Large-scale language model with improved performance on NLP tasks through distributed training and efficient data processing | 591 |
ieit-yuan/yuan2.0-m32 | A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation | 180 |
elanmart/psmm | An implementation of a neural network model for character-level language modeling. | 50 |
will-singularity/skywork-mm | An empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities | 23 |
alexa/massive | A collection of tools and modeling code for a large multilingual Natural Language Understanding dataset | 538 |
untra/polyglot | A plugin for Jekyll blogs that enables support for multiple languages and internationalization. | 417 |
kendryte/toucan-llm | A large language model with 70 billion parameters designed for chatbot and conversational AI tasks | 29 |
skyworkai/skywork | A pre-trained language model developed on 3.2TB of high-quality multilingual and code data for various applications including chatbots, text generation, and math calculations. | 1,223 |
clue-ai/chatyuan | Large language model for dialogue support in multiple languages | 1,902 |
01-ai/yi | A series of large language models trained from scratch to excel in multiple NLP tasks | 7,699 |