automlbenchmark
AutoML benchmarker
A framework for evaluating and comparing AutoML systems in a standardized way
OpenML AutoML Benchmarking Framework
405 stars
15 watching
133 forks
Language: Python
last commit: 4 days ago
Linked from 1 awesome list
automlbenchmarkmachine-learning
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 sb-ai-lab/lightautoml | A framework for creating machine learning models with minimal code and customization options | 1,204 |
 automl/hpobench | A collection of benchmark problems for hyperparameter optimization | 138 |
 pku-dair/mindware | An efficient AutoML system that automates the machine learning lifecycle | 52 |
 skblaz/autobot | An autoML framework for evolving text representations to support explainable text classification models | 10 |
 gudovskiy/autodo | Develops an automated machine learning framework to improve deep learning model performance on biased and noisy data | 24 |
 qcri/llmebench | A benchmarking framework for large language models | 80 |
 davecheney/autobench | A framework to compare performance of Go versions | 99 |
 yuliang-liu/multimodalocr | An evaluation benchmark for OCR capabilities in large multmodal models. | 471 |
 multimodal-art-projection/omnibench | Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously. | 14 |
 datacanvasio/hypernets | An automated machine learning framework that simplifies the development of end-to-end AutoML toolkits for various domains. | 266 |
 rll-research/url_benchmark | A benchmark suite for unsupervised reinforcement learning agents, providing pre-trained models and scripts for testing and fine-tuning agent performance. | 332 |
 catboost/benchmarks | Comparative benchmarks of various machine learning algorithms | 169 |
 udellgroup/oboe | Automated machine learning system for selecting promising models or pipelines for new datasets | 82 |
 thumnlab/autogl | An autoML framework for machine learning on graphs, enabling researchers and developers to automate the process of building and training neural networks on graph data. | 1,088 |
 microsoft/private-benchmarking | A platform for private benchmarking of machine learning models with different trust levels. | 6 |