xformers
Transformer library
A library of optimized building blocks for deep learning models using the Transformer architecture.
Hackable and optimized Transformers building blocks, supporting a composable construction.
9k stars
77 watching
632 forks
Language: Python
last commit: 3 months ago Related projects:
| Repository | Description | Stars |
|---|---|---|
| facebookresearch/metaseq | A codebase for working with Open Pre-trained Transformers, enabling deployment and fine-tuning of transformer models on various platforms. | 6,519 |
 huggingface/transformers | A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. | 136,357 |
 ukplab/sentence-transformers | Provides dense vector representations for text using transformer networks | 15,556 |
| facebookresearch/fairscale | A PyTorch extension library that provides high-performance and large-scale training techniques. | 3,210 |
 conda-forge/miniforge | Pre-configured package installer with support for various CPU architectures and Python implementations | 6,728 |
| facebookresearch/dinov2 | A PyTorch implementation of a self-supervised learning method for learning robust visual features without supervision. | 9,425 |
 adapter-hub/adapters | A unified library for parameter-efficient and modular transfer learning in NLP tasks | 2,600 |
 pytorch/pytorch | A Python library providing tensors and dynamic neural networks with strong GPU acceleration | 84,978 |
| facebookresearch/pytorch3d | A deep learning library for 3D data processing and computer vision research using PyTorch | 8,889 |
 opennmt/ctranslate2 | A high-performance inference engine for transformer models | 3,467 |
| huggingface/optimum | A toolkit for optimizing and accelerating the training and inference of machine learning models on various hardware platforms. | 2,618 |
 xtensor-stack/xtensor | A C++ library for efficient multi-dimensional array expressions with lazy broadcasting and computation | 3,388 |
 nvidia/fastertransformer | A high-performance transformer-based NLP component optimized for GPU acceleration and integration into various frameworks. | 5,937 |
 kimiyoung/transformer-xl | Implementations of a neural network architecture for language modeling | 3,619 |
 ml-tooling/opyrator | Automates conversion of machine learning code into production-ready microservices with web API and GUI. | 3,116 |