MMCBench
by sail-sg
AI summary
Model robustness tester
A benchmarking framework designed to evaluate the robustness of large multimodal models against common corruption scenarios
- stars
- 27
- forks
- 0
- watching
- 5
Similar projects
Found by comparing what the projects do, not just their names.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Chinese understanding benchmark
Measures the understanding of massive multitask Chinese datasets using large language models
Model robustness testing
Evaluates and benchmarks the robustness of deep learning models to various corruptions and perturbations in computer vision tasks.
Robustness tester
A toolbox for researching and evaluating robustness against attacks on machine learning models
Modbus tester
A modular framework for testing and exploiting Modbus protocol vulnerabilities in industrial control systems
Multimodal LLM test suite
A benchmark for evaluating large language models' ability to process multimodal input
Multi-modal model evaluation suite
A collection of benchmarks to evaluate the multi-modal understanding capability of large vision language models.
Adversarial benchmarking tool
A standardized benchmark for measuring the robustness of machine learning models against adversarial attacks
Robust text model
A pre-trained Chinese language model designed to be robust against maliciously crafted texts
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Robustness framework
Provides a framework for computing tight certificates of adversarial robustness for randomly smoothed classifiers.
tsb0601/mmvp296
Visual model evaluation
An evaluation framework for multimodal language models' visual capabilities using image and question benchmarks.
Chart model trainer
Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models.
Model Robustness Tool
A toolset to evaluate the robustness of machine learning models
Vulnerability scanner
Automated attack synthesis tool for discovering vulnerabilities in CPU architecture and cryptographic protocols
