robustbench
Adversarial benchmarking tool
A standardized benchmark for measuring the robustness of machine learning models against adversarial attacks
RobustBench: a standardized adversarial robustness benchmark [NeurIPS 2021 Benchmarks and Datasets Track]
682 stars
9 watching
98 forks
Language: Python
last commit: 6 months ago
Linked from 1 awesome list
adversarial-machine-learningadversarial-robustnessbenchmarkmodel-zoo
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 borealisai/advertorch | A toolbox for researching and evaluating robustness against attacks on machine learning models | 1,311 |
 guanghelee/neurips19-certificates-of-robustness | Provides a framework for computing tight certificates of adversarial robustness for randomly smoothed classifiers. | 17 |
 hendrycks/robustness | Evaluates and benchmarks the robustness of deep learning models to various corruptions and perturbations in computer vision tasks. | 1,030 |
 max-andr/provably-robust-boosting | Provides provably robust machine learning models against adversarial attacks | 50 |
 rebench/rebench.github.io | A platform providing reasonably accurate benchmarking results for JavaScript performance comparisons. | 44 |
 google-research/robustness_metrics | A toolset to evaluate the robustness of machine learning models | 466 |
 madrylab/robustness | A library for training and evaluating neural networks with a focus on adversarial robustness. | 921 |
 google/fuzzbench | Automated testing of software components to identify vulnerabilities and weaknesses | 1,110 |
 eth-sri/diffai | Trains neural networks to be provably robust against adversarial examples using abstract interpretation techniques. | 219 |
 thunlp/openattack | A Python toolkit for generating adversarial examples to test the robustness of natural language processing models | 699 |
 sail-sg/mmcbench | A benchmarking framework designed to evaluate the robustness of large multimodal models against common corruption scenarios | 27 |
 illidanlab/fedrbn | An implementation of Federated Robustness Propagation in PyTorch to share robustness across heterogeneous federated learning users. | 26 |
 phpbench/phpbench | A tool for measuring and comparing the performance of PHP code | 1,906 |
 chenhongge/robusttrees | An implementation of robust decision tree based models against adversarial examples using the XGBoost framework. | 67 |
 allenai/reward-bench | A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning. | 459 |