xformers

Transformer library

A library of optimized building blocks for deep learning models using the Transformer architecture.

Hackable and optimized Transformers building blocks, supporting a composable construction.

GitHub

9k stars
77 watching
632 forks
Language: Python
last commit: almost 2 years ago

Related projects:

RepositoryDescriptionStars
facebookresearch/metaseqA codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms.6,519
huggingface/transformersA collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects.136,357
ukplab/sentence-transformersProvides dense vector representations for text using transformer networks15,556
facebookresearch/fairscaleA PyTorch extension library that provides high-performance and large-scale training techniques.3,210
conda-forge/miniforgePre-configured package installer with support for various CPU architectures and Python implementations6,728
facebookresearch/dinov2A PyTorch implementation of a self-supervised learning method for learning robust visual features without supervision.9,425
adapter-hub/adaptersA unified library for parameter-efficient and modular transfer learning in NLP tasks2,600
pytorch/pytorchA Python library providing tensors and dynamic neural networks with strong GPU acceleration84,978
facebookresearch/pytorch3dA deep learning library for 3D data processing and computer vision research using PyTorch8,889
opennmt/ctranslate2A high-performance inference engine for transformer models3,467
huggingface/optimumA toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms.2,618
xtensor-stack/xtensorA C++ library for efficient multi-dimensional array expressions with lazy broadcasting and computation3,388
nvidia/fastertransformerA high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks.5,937
kimiyoung/transformer-xlImplementations of a neural network architecture for language modeling3,619
ml-tooling/opyratorAutomates conversion of machine learning code into production-ready microservices with web API and GUI.3,116