Auditing Pay-Per-Token in Large Language Models
(arXiv) Develops an auditing framework based on martingale theory that enables a trusted third-party auditor who sequentially queries a provider to detect token misreporting.
- from
- Audit Algorithms
- added
- 2026-10-10
- likes
- 0
similar
-
Keeping Up with the Language Models: Robustness-Bias Interplay in NLI Data and Models arxiv.org
(Arxiv) Proposes a way to extend the shelf-life of auditing datasets by using language models themselves; also finds problems with the current bias auditing metrics and proposes alternatives -- these alternatives highlight that model brittleness superficially increased the…
-
CALM: Curiosity-Driven Auditing for Large Language Models arxiv.org
(AAAI) Auditing as a black-box optimization problem where the goal is to automatically uncover input-output pairs of the target LLMs that exhibit illegal, immoral, or unsafe behaviors.
-
Mapping the Field of Algorithm Auditing: A Systematic Literature Review Identifying Research Trends, Linguistic and… arxiv.org
(Arxiv) Systematic review of algorithm auditing studies and identification of trends in their methodological approaches.
-
XAudit : A Theoretical Look at Auditing with Explanations arxiv.org
(Arxiv) Formalizes the role of explanations in auditing and investigates if and how model explanations can help audits.
-
Extracting Training Data from Large Language Models arxiv.org
(arxiv) Performs a training data extraction attack to recover individual training examples by querying the language model.
-
Audit Algorithms › Papers > 2025: “(arXiv) Develops an auditing framework based on martingale theory that enables a trusted third-party auditor who sequentially queries a provider to detect token misreporting.”