robustness_metrics

hendrycks/robustness1K

Model robustness testing

Evaluates and benchmarks the robustness of deep learning models to various corruptions and perturbations in computer vision tasks.

borealisai/advertorch1.3K

Robustness tester

A toolbox for researching and evaluating robustness against attacks on machine learning models

robustbench/robustbench682

Adversarial benchmarking tool

A standardized benchmark for measuring the robustness of machine learning models against adversarial attacks

google-research/deep_ope85

RL benchmarks

Provides benchmarking policies and datasets for offline reinforcement learning

guanghelee/neurips19-certificates-of-robustness17

Robustness framework

Provides a framework for computing tight certificates of adversarial robustness for randomly smoothed classifiers.

jmgirard/mreliability41

Measurement Consistency Tools

Tools for calculating consistency of observer measurements in various contexts

edisonleeeee/greatx85

Graph robustness toolkit

A toolbox for graph reliability and robustness against noise, distribution shifts, and attacks.

modeloriented/fairmodels86

Bias detector

A tool for detecting bias in machine learning models and mitigating it using various techniques.

google-research/rlds302

RL dataset toolkit

A toolkit for storing and manipulating episodic data in reinforcement learning and related tasks.

google/ml-fairness-gym314

Fairness simulator

An open-source tool for simulating the long-term impacts of machine learning-based decision systems on social environments

freedomintelligence/mllm-bench56

Model evaluator

Evaluates and compares the performance of multimodal large language models on various tasks

benhamner/metrics1.6K

Evaluation metrics library

Provides implementations of various supervised machine learning evaluation metrics in multiple programming languages.

i-gallegos/fair-llm-benchmark115

Bias datasets

Compiles bias evaluation datasets and provides access to original data sources for large language models

sail-sg/mmcbench27

Model robustness tester

A benchmarking framework designed to evaluate the robustness of large multimodal models against common corruption scenarios

cmawer/reproducible-model86

ML reproducibility

A project demonstrating how to create a reproducible machine learning model using Python and version control