Robust ML Auditing using Prior Knowledge
(ICML) Formally establishes the conditions under which an auditor can prevent audit manipulations using prior knowledge about the ground truth.
- from
- Audit Algorithms
- added
- 2026-10-10
- likes
- 0
similar
-
Active Fairness Auditing proceedings.mlr.press
(ICML) Studies of query-based auditing algorithms that can estimate the demographic parity of ML models in a query-efficient manner.
-
CALM: Curiosity-Driven Auditing for Large Language Models arxiv.org
(AAAI) Auditing as a black-box optimization problem where the goal is to automatically uncover input-output pairs of the target LLMs that exhibit illegal, immoral, or unsafe behaviors.
-
Auditing fairness under unawareness through counterfactual reasoning sciencedirect.com
(Information Processing & Management) Shows how to unveil whether a black-box model, complying with the regulations, is still biased or not.
-
Keeping Up with the Language Models: Robustness-Bias Interplay in NLI Data and Models arxiv.org
(Arxiv) Proposes a way to extend the shelf-life of auditing datasets by using language models themselves; also finds problems with the current bias auditing metrics and proposes alternatives -- these alternatives highlight that model brittleness superficially increased the…
-
Under manipulations, are some AI models harder to audit? grodino.github.io
(SATML) Relates the difficulty of black-box audits to the capacity of the targeted models, using the Rademacher complexity.
-
The Fair Game: Auditing & debiasing AI algorithms over time cambridge.org
Jouarnal of Cambridge Forum on AI: Law and Governance
Audit Algorithms › Papers > 2025: “(ICML) Formally establishes the conditions under which an auditor can prevent audit manipulations using prior knowledge about the ground truth.”