AI Model Auditing Lab

An audit dashboard for overall and per-group performance, error rates, fairness metrics and data quality, auditing your own predictions in your browser, and an eight-area checklist.

العربية

Module experiments (3)

Concepts and formulas

Model auditing

A systematic examination of an AI system: overall and per-group performance, error-rate gaps, fairness metrics, data quality and representation, documentation and oversight (Raji et al., 2020). An audit documents limits; it does not certify.

Try it in: Model audit studio

Model card and datasheet

A model card (Mitchell et al., 2019) states purpose, evaluation data, per-group performance and limits; a datasheet (Gebru et al.) documents data source, collection, composition and suitable uses.

Try it in: Audit checklist

Questions and guides

My model is 95% accurate; is it fair?

Overall accuracy does not say. The average can hide poor performance on a small group, or be high because positives are rare. Compute per-group metrics, error rates and fairness metrics.

Try it in: Model audit studio

Are the lab results a certified audit?

No. Experiments are educational simulations on synthetic data or on your file in your browser; they are not a certified audit nor a final ethical or legal verdict.

Try it in: Audit checklist

Is my data or file sent to the server?

No. Experiments run in your browser and the audit CSV is read locally. "Download PDF" sends only the displayed results (numbers, charts) to this site's server to build the file, which is not stored. Conversations are not stored by default.

Try it in: Audit your own predictions (CSV)

Module sources

  1. Artificial Intelligence Risk Management Framework (AI RMF 1.0)NIST (2023) — Framework
  2. Fairlearn — open-source fairness toolkitFairlearn contributors (2025) — Tool
  3. Fairlearn User Guide — AssessmentFairlearn contributors (2025) — Tool
  4. Model Cards for Model Reporting (arXiv:1810.03993)M. Mitchell et al. (2019) — Paper
  5. Datasheets for Datasets (arXiv:1803.09010)T. Gebru et al. (2018) — Paper
  6. Closing the AI Accountability Gap: internal algorithmic auditing (arXiv:2001.00973)I. D. Raji et al. (2020) — Paper