inference
by mlcommons
Reference implementations of MLPerf™ inference benchmarks
AI summary
Model benchmarking suite
Measures the performance of deep learning models in various deployment scenarios.
- stars
- 1.3K
- forks
- 538
- watching
- 57
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
ML benchmark
A benchmark for evaluating machine learning algorithms' performance on large datasets
Benchmarking
A platform for private benchmarking of machine learning models with different trust levels.
Machine Learning Benchmark
A benchmarking project comparing performance of different machine learning inference frameworks and models on Go platform
Machine Learning Framework
A framework for hosting and training machine learning models on a blockchain, enabling secure sharing and prediction without requiring users to pay for data or model updates.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
utensor/utensor1.7K
ML inference library
A lightweight machine learning inference framework built on Tensorflow optimized for Arm targets.
Multimodal LLM test suite
A benchmark for evaluating large language models' ability to process multimodal input
model server
A high-performance ML model serving framework
ML pipeline
Automates the end-to-end machine learning workflow from code commit to model deployment
Optimization benchmarks
Provides benchmarking functions for mathematical optimization algorithms
MLOps toolset
A lightweight MLOps library for small teams and individuals to manage machine learning model development lifecycle
Benchmarking
Comparative benchmarks of various machine learning algorithms
Mocking framework tests
Performs performance benchmarking of various .NET mocking libraries
Visual Model Benchmark
An open-source benchmarking framework for evaluating cross-style visual capability of large multimodal models
Benchmark suite
An authoritative source of real-world benchmarks for Python implementations.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions inference.
