xformers

Transformer toolkit

Provides optimized building blocks and components for transformer-based architectures in various domains.

Hackable and optimized Transformers building blocks, supporting a composable construction.

GitHub

9k stars
76 watching
614 forks
Language: Python
last commit: 7 days ago

Related projects:

Repository Description Stars
facebookresearch/metaseq A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms. 6,515
huggingface/transformers A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. 135,022
ukplab/sentence-transformers Provides dense vector representations for text using transformer networks 15,329
facebookresearch/fairscale A PyTorch extension library that provides high-performance and large-scale training techniques. 3,193
conda-forge/miniforge Pre-configured package installer with support for various CPU architectures and Python implementations 6,509
facebookresearch/dinov2 A PyTorch implementation of a self-supervised learning method for learning robust visual features without supervision. 9,211
adapter-hub/adapters A unified library for parameter-efficient and modular transfer learning in NLP tasks 2,577
pytorch/pytorch A Python library providing tensors and dynamic neural networks with strong GPU acceleration 83,959
facebookresearch/pytorch3d A deep learning library for 3D data processing and computer vision research using PyTorch 8,806
opennmt/ctranslate2 A high-performance library for efficient inference with Transformer models on CPUs and GPUs. 3,404
huggingface/optimum A toolkit providing optimization tools and hardware acceleration for training and inference of machine learning models 2,572
xtensor-stack/xtensor A C++ library for efficient multi-dimensional array expressions with lazy broadcasting and computation 3,360
nvidia/fastertransformer A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks. 5,886
kimiyoung/transformer-xl Implementations of a neural network architecture for language modeling 3,611
ml-tooling/opyrator Automates conversion of machine learning code into production-ready microservices with web API and GUI. 3,102