xformers

Transformer library

A library of optimized building blocks for deep learning models using the Transformer architecture.

Hackable and optimized Transformers building blocks, supporting a composable construction.

GitHub

9k stars
77 watching
632 forks
Language: Python
last commit: about 1 month ago

Related projects:

Repository Description Stars
facebookresearch/metaseq A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms. 6,519
huggingface/transformers A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. 136,357
ukplab/sentence-transformers Provides dense vector representations for text using transformer networks 15,556
facebookresearch/fairscale A PyTorch extension library that provides high-performance and large-scale training techniques. 3,210
conda-forge/miniforge Pre-configured package installer with support for various CPU architectures and Python implementations 6,728
facebookresearch/dinov2 A PyTorch implementation of a self-supervised learning method for learning robust visual features without supervision. 9,425
adapter-hub/adapters A unified library for parameter-efficient and modular transfer learning in NLP tasks 2,600
pytorch/pytorch A Python library providing tensors and dynamic neural networks with strong GPU acceleration 84,978
facebookresearch/pytorch3d A deep learning library for 3D data processing and computer vision research using PyTorch 8,889
opennmt/ctranslate2 A high-performance inference engine for transformer models 3,467
huggingface/optimum A toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms. 2,618
xtensor-stack/xtensor A C++ library for efficient multi-dimensional array expressions with lazy broadcasting and computation 3,388
nvidia/fastertransformer A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks. 5,937
kimiyoung/transformer-xl Implementations of a neural network architecture for language modeling 3,619
ml-tooling/opyrator Automates conversion of machine learning code into production-ready microservices with web API and GUI. 3,116