A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

Curated list of open source tooling for data-centric AI on unstructured data.

Programming assignments and quizzes from all courses within the GANs specialization offered by deeplearning.ai

WEFE: The Word Embeddings Fairness Evaluation Framework. WEFE is a framework that standardizes the bias measurement and mitigation in Word Embeddings models. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

To help public defenders better serve their clients, Open Sentencing shows racial bias in data such as demographics providing insights for each case

Solutions on Practical Data Science Specialization on Coursera (offered by deeplearning.ai)

Learning to Split for Automatic Bias Detection

Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"

Tools for diagnostics and assessment of (machine learning) models

Multi-Calibration & Multi-Accuracy Boosting for R

A curated list of Robust Machine Learning papers/articles and recent advancements.

👚 Speedy Word Embedding Association Test & Extras using R

"Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color" (ICCV 2023)

HonestyMeter: An NLP-powered framework for evaluating objectivity and bias in media content, detecting manipulative techniques, and providing actionable feedback.

Detection of propaganda or partisan allegiance in natural text.

Official code of "Discover and Mitigate Unknown Biases with Debiasing Alternate Networks" (ECCV 2022)

Code & Data for the paper "RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Models"

Reveal to Revise: An Explainable AI Life Cycle for Iterative Bias Correction of Deep Models. Paper presented at MICCAI 2023 conference.

Official code of "Discover the Unknown Biased Attribute of an Image Classifier" (ICCV 2021)