rust-bert

NLP pipeline

Provides pre-trained Rust-native transformer-based models and pipelines for Natural Language Processing tasks.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

GitHub

3k stars
41 watching
217 forks
Language: Rust
last commit: 4 months ago
Linked from 3 awesome lists

bartbertdeep-learningelectragptgpt-2language-generationmachine-learningnernlpquestion-answeringrobertarustrust-langsentiment-analysistransformertranslation

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
codertimo/bert-pytorch An implementation of Google's 2018 BERT model in PyTorch, allowing pre-training and fine-tuning for natural language processing tasks 6,251
brightmart/roberta_zh Implements RoBERTa for Chinese pre-training using TensorFlow and provides PyTorch versions for loading and training 2,638
huggingface/text-generation-inference A toolkit for deploying and serving Large Language Models (LLMs) for high-performance text generation 9,456
axa-group/nlp.js A comprehensive NLP library for building conversational AI systems with entity extraction, sentiment analysis, language identification, and more. 6,301
rust-ml/linfa A comprehensive toolkit for building machine learning applications in Rust. 3,810
brightmart/text_classification An NLP project offering various text classification models and techniques for deep learning exploration 7,881
huggingface/tokenizers A toolkit providing optimized tokenizers for natural language processing tasks in various programming languages. 9,156
google-research/bert Provides pre-trained models and code for natural language processing tasks using TensorFlow 38,374
dbmdz/berts Provides pre-trained language models for natural language processing tasks 155
brikerman/kashgari A production-level NLP framework for text labeling and classification 2,395
tensorflow/rust A Rust binding to TensorFlow's C API for machine learning 5,215
defog-ai/sqlcoder An AI model that converts natural language questions to SQL queries 3,445
dfki-nlp/gevalm Evaluates German transformer language models with syntactic agreement tests 7
pretzelhammer/rust-blog An educational blog for Rust beginners with technical tutorials and articles 7,662
sebastianruder/nlp-progress A comprehensive repository tracking progress in NLP tasks and their corresponding datasets. 22,742