RepDistiller
by HobbitLong
[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
AI summary
Knowledge Distiller
A Python-based project implementing contrastive representation distillation and benchmarking recent knowledge distillation methods
- stars
- 2.2K
- forks
- 401
- watching
- 17
Similar projects
Found by comparing what the projects do, not just their names.
BERT distiller
A high-level API for distilling BERT models to create smaller, more efficient variants with reduced training time and improved inference speed.
Model distiller
Automatically trains models from large foundation models to perform specific tasks with minimal human intervention.
Experiment builder
A framework for designing and running deep learning experiments without writing code
Refiner
Creates detailed images by upscaling and refining Stable Diffusion outputs
Distributed Backpropagation Library
Enables backpropagation in distributed settings and facilitates model parallelism using differentiable communication between processes
Data transformer
A library for serializing and deserializing data structures into strings, mappings, and lists while performing validation.
Federated distillation framework
A framework for achieving domain-aware knowledge distillation in federated learning environments.
Dict matcher
A language for validating and filtering Python dictionaries
Deep Learning Bridge
A Python library that enables seamless interaction between deep learning frameworks and Lua/Torch libraries.
asonge/loom224
CRDT library
A collection of composable and extensible conflict-free data types designed to track causality for modifications
Cryptography library
A cryptographic toolkit written in Common Lisp.
CRDT library
An implementation of a simple CRDT that represents an ordered sequence of items, designed to handle concurrent modifications in collaborative editing systems.
Concept Linker
A Python library for training models on knowledge graphs to predict links between concepts
Transfer learner
An implementation of a boosting-based transfer learning algorithm for regression tasks.
Memory optimizer for deep learning models
A lightweight wrapper around PyTorch to prevent CUDA out-of-memory errors and optimize model execution
