polyglot
Multilingual models
Large language models designed to perform well in multiple languages and address performance issues with current multilingual models.
Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
476 stars
21 watching
39 forks
last commit: over 1 year ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 damo-nlp-mt/polylm | A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. | 77 |
 ibm-granite/granite-3.0-language-models | A collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources. | 232 |
 xverse-ai/xverse-moe-a36b | Develops and publishes large multilingual language models with advanced mixing-of-experts architecture. | 37 |
 bilibili/index-1.9b | A lightweight, multilingual language model with a long context length | 920 |
 microsoft/unicoder | This repository provides pre-trained models and code for understanding and generation tasks in multiple languages. | 89 |
 shawn-ieitsystems/yuan-1.0 | Large-scale language model with improved performance on NLP tasks through distributed training and efficient data processing | 591 |
 ieit-yuan/yuan2.0-m32 | A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation | 182 |
 elanmart/psmm | An implementation of a neural network model for character-level language modeling. | 50 |
 will-singularity/skywork-mm | An empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities | 23 |
 alexa/massive | A collection of tools and modeling code for a large multilingual Natural Language Understanding dataset | 541 |
 untra/polyglot | A plugin for Jekyll blogs that enables support for multiple languages and internationalization. | 425 |
 kendryte/toucan-llm | A large language model with 70 billion parameters designed for chatbot and conversational AI tasks | 29 |
 skyworkai/skywork | A pre-trained language model developed on 3.2TB of high-quality multilingual and code data for various applications including chatbots, text generation, and math calculations. | 1,228 |
 clue-ai/chatyuan | Large language model for dialogue support in multiple languages | 1,903 |
 01-ai/yi | A series of large language models trained from scratch to excel in multiple NLP tasks | 7,743 |