CTranslate2
by OpenNMT
Fast inference engine for Transformer models
AI summary
Inference engine
A high-performance inference engine for transformer models
- stars
- 3.5K
- forks
- 308
- watching
- 59
Similar projects
Found by comparing what the projects do, not just their names.
Transformer component
A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks.
Speech-to-text system
A fast speech-to-text implementation using CTranslate2 and optimized for inference on CPU and GPU.
Language model trainer
Provides a framework for training large-scale language models on GPUs with advanced features and optimizations.
karpathy/mingpt20.5K
Transformer model
A minimal PyTorch implementation of a transformer-based language model
huggingface/transformers136.4K
Model repository
A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects.
Transformer platform
A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms.
Text embeddings library
Provides dense vector representations for text using transformer networks
Text Generation Toolkit
A toolkit for deploying and serving Large Language Models (LLMs) for high-performance text generation
nvidia/megatron-lm10.8K
LLM trainer
A framework for training large language models using scalable and optimized GPU techniques
Transformer framework
Provides a unified interface to various transformer models implemented in C/C++ using GGML library
Text generator
A tool for retraining and fine-tuning the OpenAI GPT-2 text generation model on new datasets.
Language model backend
Implementations of a neural network architecture for language modeling
Transformer model trainer
A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods.
Transformer trainer
Research tool for training large transformer language models at scale
CTR models
A PyTorch-based package for building and training click-through rate models using various deep learning architectures.
