rust-bert

NLP pipeline

Provides pre-trained Rust-native transformer-based models and pipelines for Natural Language Processing tasks.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

GitHub

3k stars
41 watching
215 forks
Language: Rust
last commit: about 2 months ago
Linked from 3 awesome lists

bartbertdeep-learningelectragptgpt-2language-generationmachine-learningnernlpquestion-answeringrobertarustrust-langsentiment-analysistransformertranslation

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
codertimo/bert-pytorch An implementation of Google's 2018 BERT model in PyTorch, allowing pre-training and fine-tuning for natural language processing tasks 6,222
brightmart/roberta_zh Implements RoBERTa for Chinese pre-training using TensorFlow and provides PyTorch versions for loading and training 2,618
huggingface/text-generation-inference A toolkit for deploying and serving Large Language Models. 9,106
axa-group/nlp.js A comprehensive NLP library for building conversational AI systems with entity extraction, sentiment analysis, language identification, and more. 6,283
rust-ml/linfa A comprehensive toolkit for building machine learning applications in Rust. 3,762
brightmart/text_classification An NLP project offering various text classification models and techniques for deep learning exploration 7,861
huggingface/tokenizers A toolkit providing optimized tokenizers for natural language processing tasks in various programming languages. 9,051
google-research/bert Provides pre-trained models and code for natural language processing tasks using TensorFlow 38,204
dbmdz/berts Provides pre-trained language models for natural language processing tasks 155
brikerman/kashgari A production-level NLP framework for text labeling and classification 2,395
tensorflow/rust A Rust binding to TensorFlow's C API for machine learning 5,190
defog-ai/sqlcoder An AI model that converts natural language questions to SQL queries 3,395
dfki-nlp/gevalm Evaluates German transformer language models with syntactic agreement tests 7
pretzelhammer/rust-blog An educational blog for Rust beginners with technical tutorials and articles 7,553
sebastianruder/nlp-progress A comprehensive repository tracking progress in NLP tasks and their corresponding datasets. 22,715