optimum-benchmark
by huggingface
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
AI summary
Performance comparer
A tool for comparing and optimizing the performance of various machine learning frameworks and models on different hardware platforms.
- stars
- 274
- forks
- 50
- watching
- 5
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Quantizer
A PyTorch quantization backend for models.
Optimization benchmarks
Provides benchmarking functions for mathematical optimization algorithms
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Performance tester
Automated performance testing and analysis tool for distributed systems
Optimization analyzer
An automated toolbox for performing worst-case analyses of first-order optimization methods in convex and nonconvex optimization.
Benchmark suite
A collection of benchmark problems for hyperparameter optimization
Hyperparameter Optimizer
A package for optimizing hyperparameters and meta-learning using gradient-based methods in TensorFlow.
Benchmarking
Comparative benchmarks of various machine learning algorithms
Hyperparameter optimizer
A reinforcement learning-based framework for optimizing hyperparameters in distributed machine learning environments.
Visual Model Benchmark
An open-source benchmarking framework for evaluating cross-style visual capability of large multimodal models
ML benchmark
A benchmark for evaluating machine learning algorithms' performance on large datasets
Performance tester
A performance benchmarking and testing framework for .NET applications.
Benchmark suite
An authoritative source of real-world benchmarks for Python implementations.
AutoML pipeline tool
Automated machine learning tool for tabular data pipelines
Performance benchmarking tool
A tool for comparing the performance of different programming languages or code snippets in a controlled and measurable way
Featured in 1 awesome list
Each link jumps to the spot where the list mentions optimum-benchmark.
