Unicoder

Multilingual language models

This repository provides pre-trained models and code for understanding and generation tasks in multiple languages.

Unicoder model for understanding and generation.

GitHub

89 stars
11 watching
13 forks
Language: Python
last commit: almost 3 years ago

Related projects:

RepositoryDescriptionStars
bilibili/index-1.9bA lightweight, multilingual language model with a long context length920
xverse-ai/xverse-moe-a36bDevelops and publishes large multilingual language models with advanced mixing-of-experts architecture.37
nttcslab-nlp/doc_lmThis repository contains source files and training scripts for language models.12
eleutherai/polyglotLarge language models designed to perform well in multiple languages and address performance issues with current multilingual models.476
microsoft/wavecoderA system for generating and improving code through large language models53
microsoft/mpnetDevelops a method for pre-training language understanding models by combining masked and permuted techniques, and provides code for implementation and fine-tuning.288
tiger-ai-lab/uniirTrains and evaluates a universal multimodal retrieval model to perform various information retrieval tasks.114
xverse-ai/xverse-13bA large language model developed to support multiple languages and applications648
ieit-yuan/yuan2.0-m32A high-performance language model designed to excel in tasks like natural language understanding, mathematical computation, and code generation182
alexa/massiveA collection of tools and modeling code for a large multilingual Natural Language Understanding dataset541
ibm-granite/granite-3.0-language-modelsA collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources.232
juliastrings/utf8procA C library for processing UTF-8 Unicode data1,069
vhellendoorn/code-lmsA guide to using pre-trained large language models in source code analysis and generation1,789
shawn-ieitsystems/yuan-1.0Large-scale language model with improved performance on NLP tasks through distributed training and efficient data processing591
lang/unicode_utilsUtilities for working with Unicode strings in Ruby113