EvalAI
by Cloud-CV
Evaluating state of the art in AI
AI summary
Benchmarking tool
A platform for comparing and evaluating AI and machine learning algorithms at scale
- stars
- 1.8K
- forks
- 799
- watching
- 54
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Benchmarking
Comparative benchmarks of various machine learning algorithms
Multimodal LLM test suite
A benchmark for evaluating large language models' ability to process multimodal input
AI benchmarking tool
A tool for benchmarking performance and accuracy of generative AI models on various AWS platforms
Benchmarker
Tools for comparing and benchmarking small code snippets
ethicalml/xai1.1K
Bias analysis tool
An eXplainability toolbox for machine learning that enables data analysis and model evaluation to mitigate biases and improve performance
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
Learning benchmark
A benchmarking suite for multimodal in-context learning models
Benchmarker
A tool for benchmarking Elixir code and comparing performance statistics
AI/ML Guide
A comprehensive resource guide to stay updated on AI, ML, DL, and CV advancements
Visual Model Benchmark
An open-source benchmarking framework for evaluating cross-style visual capability of large multimodal models
AI library
A collection of algorithms and data structures for artificial intelligence and machine learning in Swift
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Cheminformatics toolkit
Automated machine learning protocols for cheminformatics using Python
Video model evaluator
A benchmark suite for evaluating the performance of video generative models
Featured in 1 awesome list
Each link jumps to the spot where the list mentions EvalAI.