femtoGPT

GPT transformer

A Rust implementation of a minimal Generative Pretrained Transformer architecture.

Pure Rust implementation of a minimal Generative Pretrained Transformer

GitHub

834 stars
15 watching
51 forks
Language: Rust
last commit: 2 months ago
Linked from 1 awesome list

from-scratchgptgpullmmachine-learningneural-networkopenclrust

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
neukg/techgpt A generative transformer model designed to process and generate text in various vertical domains, including computer science, finance, and more. 212
ist-daslab/gptq An implementation of post-training quantization algorithm for transformer models to reduce memory usage and improve inference speed 1,937
graykode/gpt-2-pytorch An implementation of the GPT-2 language model in PyTorch for generating text 973
gengteng/rust-assistant An expert assistant for Rust programming questions and issues with precise code interpretation, up-to-date crate information, and source code analysis. 9
microsoft/megatron-deepspeed Research tool for training large transformer language models at scale 1,895
0xeb/gpt-analyst A resource repository providing tools and guides for analyzing and reverse engineering GPT models. 181
gram-ai/radio-transformer-networks An implementation of a machine learning-based communications system using deep learning techniques. 127
folyd/robotstxt A Rust port of Google's robots.txt parser and matcher C++ library 88
bigscience-workshop/megatron-deepspeed A collection of tools and scripts for training large transformer language models at scale 1,335
tg44/mqtt-transformer A service that transforms and re-publishes JSON messages between MQTT topics. 14
yitu-opensource/t2t-vit A deep learning framework for training vision transformers from scratch on image data. 1,148
gperinazzo/dict-derive A Rust derive macro that automatically transforms Python dicts into Rust structs and vice versa. 105
locuslab/pytorch_fft Provides an efficient wrapper around CUDA FFTs for PyTorch transformations 314
hengruo/qanet-pytorch An implementation of QANet with PyTorch for text classification tasks 345
fastnlp/cpt A pre-trained transformer model for natural language understanding and generation tasks in Chinese 481