Orion

Multilingual LLMs

A family of large language models designed to handle multilingual text and provide strong performance in various tasks such as chat, long context, and retrieval augmented generation.

Orion-14B is a family of models includes a 14B foundation LLM, and a series of models: a chat model, a long context model, a quantized model, a RAG fine-tuned model, and an Agent fine-tuned model. Orion-14B 系列模型包括一个具有140亿参数的多语言基座大模型以及一系列相关的衍生模型,包括对话模型,长文本模型,量化模型,RAG微调模型,Agent微调模型等。

GitHub

789 stars
9 watching
57 forks
Language: Python
last commit: 8 months ago

Related projects:

Repository Description Stars
skyworkai/skywork A pre-trained language model developed on 3.2TB of high-quality multilingual and code data for various applications including chatbots, text generation, and math calculations. 1,228
orionstarai/orionstar-yi-34b-chat A high-quality chat model trained on 15W+ high-quality data to provide excellent conversational experiences. 259
pleisto/yuren-baichuan-7b A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks 73
xverse-ai/xverse-7b A multilingual large language model developed by XVERSE Technology Inc. 50
neulab/pangea An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts 92
deeplangai/lingowhale-8b An open bilingual LLM developed using the LingoWhale model, trained on a large dataset of high-quality middle English text, and fine-tuned for specific tasks such as conversation generation. 134
damo-nlp-mt/polylm A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. 77
langboat/mengzi3 An 8B and 13B language model based on the Llama architecture with multilingual capabilities. 2,031
lyuchenyang/macaw-llm A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation 1,568
bilibili/index-1.9b A lightweight, multilingual language model with a long context length 920
eleutherai/polyglot Large language models designed to perform well in multiple languages and address performance issues with current multilingual models. 476
sail-sg/sailor-llm Develops language models tailored for South-East Asia's linguistic diversity and cultural nuances 120
linksoul-ai/llasm A large language and speech model for multilingual conversational dialogue 539
mbzuai-oryx/groundinglmm An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations 797
xverse-ai/xverse-moe-a36b Develops and publishes large multilingual language models with advanced mixing-of-experts architecture. 37