winogender-schemas

Bias test sentences

A dataset of manually crafted sentence templates to evaluate the presence of gender bias in natural language processing systems

Data for evaluating gender bias in coreference resolution systems.

GitHub

68 stars
0 watching
12 forks
Language: Python
last commit: over 5 years ago

Related projects:

Repository Description Stars
visionjo/facerec-bias-bfw This project provides a data proxy to evaluate bias in facial recognition systems across demographic groups. 46
i-gallegos/fair-llm-benchmark Compiles bias evaluation datasets and provides access to original data sources for large language models 110
modeloriented/fairmodels A tool for detecting bias in machine learning models and mitigating it using various techniques. 86
cisco-open/inclusive-language Tools and resources for identifying biased language in code and content. 21
megantosh/fairness_measures_code This repository contains implementations of measures to quantify discrimination in data 38
tolga-b/debiaswe Removes problematic gender bias from word embeddings to create more neutral representations. 243
btschwertfeger/python-cmethods A collection of bias correction techniques for climate data analysis 60
dssg/aequitas Toolkit to audit and mitigate biases in machine learning models 694
privacytrustlab/bias_in_fl Analyzing bias propagation in federated learning algorithms to improve group fairness and robustness 11
nyu-mll/bbq A dataset and benchmarking framework to evaluate the performance of question answering models on detecting and mitigating social biases. 87
ethicalml/xai An eXplainability toolbox for machine learning that enables data analysis and model evaluation to mitigate biases and improve performance 1,125
datamllab/mitigating_gender_bias_in_captioning_system An investigation into bias in image captioning systems using a dataset and a new model design to mitigate this bias 13
hrs/markov-sentence-generator Generates random text based on a statistical model of input text 95
uglytoad/pragmaticsegmenternet A C# implementation of sentence boundary detection with rule-based approach. 33
laser-umass/themis A tool to test software for discriminatory biases in decision-making processes 101