attention-transfer
by szagoruyko
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
AI summary
Attention transfer
Improves performance of convolutional neural networks by transferring knowledge from teacher models to student models using attention mechanisms.
- stars
- 1.4K
- forks
- 276
- watching
- 51
Similar projects
Found by comparing what the projects do, not just their names.
Image recognition toolkit
Pre-trained models and code for fine-tuning image recognition tasks using deep learning frameworks
Attention calibrator
This project proposes a novel method for calibrating attention distributions in multimodal models to improve contextualized representations of image-text pairs.
Neural network architecture
An implementation of a 1-bit weight neural network architecture using PyTorch
ResNet experiment
An experimental study on residual networks to improve depth and width trade-offs in neural networks
Attention Network
An image classification neural network implementation using attention mechanisms and residual learning
Attention network
A Gluon implementation of Residual Attention Network for image classification tasks
Graph algorithm
An implementation of a deep learning algorithm for graph data
Graph Neural Network Model
A PyTorch implementation of a graph neural network model that learns personalized node representations
Transfer Learning Benchmark
An experiment and benchmarking framework for evaluating the effectiveness of transfer learning in PyTorch-based deep learning models
Attention model training
Trains a bottom-up attention model using Faster R-CNN and Visual Genome annotations for image captioning and VQA tasks
Robotics research project
Research on repurposing reinforcement learning for transfer between tasks in robotics and multi-step visual tasks with simulation-to-real transfer
Semantic Segmentation Model
An implementation of a deep learning model using PyTorch for semantic segmentation tasks.
Graph classifier
An implementation of a graph classification model using structural attention and PyTorch
Attention network
A deep learning framework for semantic segmentation with spatial attention mechanisms
Image OCR model
A TensorFlow model for recognizing text in images using visual attention and a sequence-to-sequence architecture.
