robustbench
Adversarial benchmarking tool
A standardized benchmark for measuring the robustness of machine learning models against adversarial attacks
RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]
667 stars
9 watching
99 forks
Language: Python
last commit: 16 days ago
Linked from 1 awesome list
adversarial-machine-learningadversarial-robustnessbenchmarkmodel-zoo
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 borealisai/advertorch | A toolbox for researching and evaluating robustness against attacks on machine learning models | 1,308 |
 guanghelee/neurips19-certificates-of-robustness | Tight certificates of adversarial robustness for randomly smoothed classifiers | 17 |
 hendrycks/robustness | Evaluates and benchmarks the robustness of deep learning models to various corruptions and perturbations in computer vision tasks. | 1,022 |
 max-andr/provably-robust-boosting | Provides provably robust machine learning models against adversarial attacks | 50 |
 rebench/rebench.github.io | A platform providing reasonably accurate benchmarking results for JavaScript performance comparisons. | 44 |
 google-research/robustness_metrics | A toolset to evaluate the robustness of machine learning models | 466 |
 madrylab/robustness | A library for training and evaluating neural networks with a focus on adversarial robustness. | 918 |
 google/fuzzbench | Automated testing of software components to identify vulnerabilities and weaknesses | 1,108 |
 eth-sri/diffai | Trains neural networks to be provably robust against adversarial examples using abstract interpretation techniques. | 218 |
 thunlp/openattack | A Python toolkit for generating adversarial examples to test the robustness of natural language processing models | 689 |
 sail-sg/mmcbench | A benchmarking framework designed to evaluate the robustness of large multimodal models against common corruption scenarios | 27 |
 illidanlab/fedrbn | An implementation of Federated Robustness Propagation in PyTorch to share robustness across heterogeneous federated learning users. | 26 |
 phpbench/phpbench | A tool for measuring and comparing the performance of PHP code | 1,900 |
 chenhongge/robusttrees | An implementation of robust decision tree based models against adversarial examples using the XGBoost framework. | 67 |
 allenai/reward-bench | A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning. | 429 |