foundation-model-benchmarking-tool
by aws-samples
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
AI summary
AI benchmarking tool
A tool for benchmarking performance and accuracy of generative AI models on various AWS platforms
- stars
- 210
- forks
- 32
- watching
- 8
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
cloud-cv/evalai1.8K
Benchmarking tool
A platform for comparing and evaluating AI and machine learning algorithms at scale
Visual Model Benchmark
An open-source benchmarking framework for evaluating cross-style visual capability of large multimodal models
Weather Model Bench
A benchmark framework for evaluating and comparing data-driven global weather models.
Generative metrics benchmark
Provides standardized benchmarks for evaluating the quality of generative models for crystal structures.
Model Tester
A tool for testing and evaluating large language models with a focus on AI safety and model assessment.
Performance tester
Automated performance testing and analysis tool for distributed systems
Benchmark tool
A Rust benchmarking library that supports running and filtering benchmarks.
Performance benchmarking toolkit
An open-source project providing benchmarks and tools to measure the performance of AI and machine learning systems.
Reward model evaluator
A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning.
Robotics Benchmarking Platform
A collection of robotic environment benchmarks for evaluating meta-reinforcement learning and multi-task learning algorithms.
Benchmarking tool
A tool for designing and running benchmarking experiments in JavaScript to measure the performance of code
Benchmarking
A platform for private benchmarking of machine learning models with different trust levels.
Model comparator
Evaluates and compares the performance of various CLIP-like models on different tasks and datasets.
Model benchmarking suite
Measures the performance of deep learning models in various deployment scenarios.
Benchmarker
A tool for benchmarking Elixir code and comparing performance statistics
Featured in 1 awesome list
Each link jumps to the spot where the list mentions foundation-model-benchmarking-tool.
