sparse_attention
by openai
Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
AI summary
Attention library
Provides primitives for sparse attention mechanisms used in transformer models to improve computational efficiency and scalability
- stars
- 1.5K
- forks
- 192
- watching
- 43
Similar projects
Found by comparing what the projects do, not just their names.
Language model trainer
This project provides code and model for improving language understanding through generative pre-training using a transformer-based architecture.
Sparse optimizer
A collection of unconstrained optimization algorithms for sparse modeling in MATLAB
Attention-based transformer
A vision transformer architecture that uses a novel attention mechanism to capture local-global interactions in images
language model tuning
Training methods and tools for fine-tuning language models using human preferences
Model optimizer
Enables the creation of smaller neural network models through efficient pruning and quantization techniques
Attention module implementation
An implementation of the Bottleneck Attention Module in TensorFlow using attention mechanism
Attention Network
An image classification neural network implementation using attention mechanisms and residual learning
Review generator
Generates reviews and discovers sentiment using a language model
Sparse network pruner
Re-implements sparse structure selection algorithm for deep neural networks in a modified MXNet framework.
Attention network
A Gluon implementation of Residual Attention Network for image classification tasks
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
OpenAI API client
A Rust library providing an asynchronous interface to the OpenAI API
macpaw/openai2.1K
API client
An OpenAI API wrapper for Swift applications
Text assistant
An AI-powered Sublime Text plugin for generating text and answering questions using OpenAI models
API spec
A specification for an API providing access to AI capabilities
