kfac-jax
Second Order Optimization and Curvature Estimation with K-FAC in JAX.
AI summary
KFAC optimizer
Library providing an implementation of the K-FAC optimizer and curvature estimator for second-order optimization in neural networks.
- stars
- 252
- forks
- 23
- watching
- 11
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Deep learning optimizer
An open-source project providing hardware accelerated, batchable and differentiable optimizers in JAX for deep learning.
Gradient optimizer library
A gradient processing and optimization library designed to facilitate research and productivity in machine learning by providing building blocks for custom optimizers and gradient processing components.
Graph library
A lightweight library for working with graph neural networks in jax.
LLM optimizer
A flexible framework for LLM inference optimizations with support for multiple models and architectures
Deep Learning Models
Provides a collection of deep learning models and utilities in JAX/Flax for research purposes.
Hyperopt tuner
Automates hyperparameter optimization and neural network architecture search using Hyperopt on a CNN model for the CIFAR-100 dataset
Bayesian optimizer
A lightweight Bayesian optimization library designed to optimize expensive-to-evaluate functions using Gaussian Process models and various acquisition functions.
Model repository
Provides pre-trained deep learning models for the Jax/Flax ecosystem.
CNN optimizer
A tool for exploring and optimizing the architecture of Convolutional Neural Networks using a Genetic Algorithm
Hyperparameter Optimizer
A package for optimizing hyperparameters and meta-learning using gradient-based methods in TensorFlow.
Converter
Converts TensorFlow functions to equivalent JAX Python functions.
Topology optimizer
Optimization code for topology optimization problems using machine learning and deep learning techniques
Model optimizer
Enables the creation of smaller neural network models through efficient pruning and quantization techniques
Hyperparameter optimizer
A reinforcement learning-based framework for optimizing hyperparameters in distributed machine learning environments.
Model optimizer
Tools and techniques for optimizing large language models on various frameworks and hardware platforms.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions kfac-jax.
