Theory
1,949 items in 14 lists
-
Modeling rabbit‑holes on YouTube link.springer.com
(SNAM) Models the trapping dynamics of users in rabbit holes in YouTube, and provides a measure of this enclosure.
-
Scaling up search engine audits: Practical insights for algorithm auditing journals.sagepub.com
(Journal of Information Science) (Code) Audits multiple search engines using simulated browsing behavior with virtual agents.
-
Query Strategies for Evading Convex-Inducing Classifiers jmlr.org
(JMLR) Evasion methods for convex classifiers. Considers evasion complexity.
-
Membership Inference Attacks Against Machine Learning Models ieeexplore.ieee.org
(Symposium on Security and Privacy) Given a machine learning model and a record, determine whether this record was used as part of the model's training dataset or not.
-
Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning Systems ieeexplore.ieee.org
(Security and Privacy) Introduces measures that capture the degree of influence of inputs on outputs of the observed system.
-
Back in Black: Towards Formal, Black Box Analysis of Sanitizers and Filters ieeexplore.ieee.org
(Security and Privacy) Black-box analysis of sanitizers and filters.
-
Stealing Knowledge from Protected Deep Neural Networks Using Composite Unlabeled Data ieeexplore.ieee.org
(ICNN) Composite method which can be used to attack and extract the knowledge ofa black box model even if it completely conceals its softmaxoutput.
-
Under manipulations, are some AI models harder to audit? grodino.github.io
(SATML) Relates the difficulty of black-box audits to the capacity of the targeted models, using the Rademacher complexity.
-
The Imitation Game: Algorithm Selectionby Exploiting Black-Box Recommender github.com
(Netys) (Code) Parametrize a local recommendation algorithm by imitating the decision of a remote and better trained one.
-
Online Fairness Auditing through Iterative Refinement dl.acm.org
(KDD) Provides an adaptive process that automates the inference of probabilistic guarantees associated with estimating fairness metrics.
-
Auditing Algorithms: On Lessons Learned and the Risks of DataMinimization dl.acm.org
(AIES) A practical audit for a well-being recommendation app developed by Telefónica (mostly on bias).
-
Auditing radicalization pathways on dl.acm.org
(FAT*) Studies the reachability of radical channels from each others, using random walks on static channel recommendations.
-
Auditing YouTube’s Recommendation Algorithm for Misinformation Filter Bubbles dl.acm.org
(Transactions on Recommender Systems) What it takes to “burst the bubble,” i.e., revert the bubble enclosure from recommendations.
-
Auditing Algorithmic Bias on Twitter dl.acm.org
(WebSci).
-
Auditing the Personalization and Composition of Politically-Related Search Engine Results Pages dl.acm.org
(WWW) A Chrome extension to survey participants and collect the Search Engine Results Pages (SERPs) and autocomplete suggestions, for studying personalization and composition.
-
Neural Network Inversion in Adversarial Setting via Background Knowledge Alignment dl.acm.org
(CCS) Model inversion approach in the adversary setting based on training an inversion model that acts as aninverse of the original model. With no fullknowledge about the original training data, an accurate inversion is still possible by training the inversion model on…
-
Practical Black-Box Attacks against Machine Learning dl.acm.org
(Asia CCS) Understand how vulnerable is a remote service to adversarial classification attacks.
-
Peeking Beneath the Hood of Uber dl.acm.org
(IMC) Infer implementation details of Uber's surge price algorithm.
-
Measuring Personalization of Web Search dl.acm.org
(WWW) Develops a methodology for measuring personalization in Web search result.
-
Privacy Oracle: a System for Finding Application Leakswith Black Box Differential Testing dl.acm.org
(CCS) Privacy Oracle: a system that uncovers applications' leaks of personal information in transmissions to remoteservers.
-
Adversarial Learning dl.acm.org
(KDD) Reverse engineering of remote linear classifiers, using membership queries.
-
Uncovering Influence Cookbooks : Reverse Engineering the Topological Impact in Peer Ranking Services dl.acm.org
(CSCW) Aims at identifying which centrality metrics are in use in a peer ranking service.
-
Bias in Online Freelance Marketplaces: Evidence from TaskRabbit datworkshop.org
(dat workshop) Measures the TaskRabbit's search algorithm rank.
-
Auditing Black-Box Prediction Models for Data Minimization Compliance cs.bu.edu
(NeurIPS) Measures the level of data minimization satisfied by the prediction model using a limited number of queries.
-
Auditing: Active Learning with Outcome-Dependent Query Costs cs.bgu.ac.il
(NIPS) Learns from a binary classifier paying only for negative labels.
-
The Fair Game: Auditing & debiasing AI algorithms overtime cambridge.org
(Cambridge Forum on AI: Law and Governance) Aims to simulate the evolution of ethical and legal frameworks in the society by creating an auditor which sends feedback to a debiasing algorithm deployed around an ML system.
-
The Fair Game: Auditing & debiasing AI algorithms over time cambridge.org
Jouarnal of Cambridge Forum on AI: Law and Governance
-
Auditing Pay-Per-Token in Large Language Models arxiv.org
(arXiv) Develops an auditing framework based on martingale theory that enables a trusted third-party auditor who sequentially queries a provider to detect token misreporting.
-
-
Robust ML Auditing using Prior Knowledge arxiv.org
(ICML) Formally establishes the conditions under which an auditor can prevent audit manipulations using prior knowledge about the ground truth.
-
Hardware and software platform inference arxiv.org
(arXiv) A method for identifying the underlying GPU architecture and software stack of a black-box machine learning model solely based on its input-output behavior.
-
FairProof: Confidential and Certifiable Fairness for Neural Networks arxiv.org
(Arxiv) Proposes an alternative paradigm to traditional auditing using crytographic tools like Zero-Knowledge Proofs; gives a system called FairProof for verifying fairness of small neural networks.
-
Fairness Auditing with Multi-Agent Collaboration arxiv.org
(ECAI) Considers multiple agents working together, each auditing the same platform for different tasks.
-
(Arxiv) Systematic review of algorithm auditing studies and identification of trends in their methodological approaches.
-
Improved Membership Inference Attacks Against Language Classification Models arxiv.org
(ICLR) Presents a framework for running membership inference attacks against classifier, in audit mode.
-
Auditing Yelp’s Business Ranking and Review Recommendation Through the Lens of Fairness arxiv.org
(Arxiv) Audits the fairness of Yelp’s business ranking and review recommendation systems, with demographic parity, exposure, and statistical tests such as quantile linear and logistic regression.
-
Auditing Fairness by Betting arxiv.org
(Neurips) [Code] Sequential methods that allows for the continuous monitoring of incoming data from a black-box classifier or regressor.
-
Keeping Up with the Language Models: Robustness-Bias Interplay in NLI Data and Models arxiv.org
(Arxiv) Proposes a way to extend the shelf-life of auditing datasets by using language models themselves; also finds problems with the current bias auditing metrics and proposes alternatives -- these alternatives highlight that model brittleness superficially increased the…
-
(ICLR) Considers backdoor detection under the black-box setting in machine learning as a service (MLaaS) applications.
-
XAudit : A Theoretical Look at Auditing with Explanations arxiv.org
(Arxiv) Formalizes the role of explanations in auditing and investigates if and how model explanations can help audits.
-
Your Echos are Heard: Tracking, Profiling, and Ad Targeting in the Amazon Smart Speaker Ecosystem arxiv.org
(arxiv) Infers a link between the Amazon Echo system and the ad targeting algorithm.
-
(CHI) Makes the case for "everyday algorithmic auditing" by users.
-
(FAccT) Do Amazon private label products get an unfair share of recommendations and are therefore advantaged compared to 3rd party products?
-
Extracting Training Data from Large Language Models arxiv.org
(USENIX Security) Extract verbatim text sequences from the GPT-2 model’s training data.
-
Extracting Training Data from Large Language Models arxiv.org
(arxiv) Performs a training data extraction attack to recover individual training examples by querying the language model.
-
Making targeted black-box evasion attacks effective andefficient arxiv.org
(arXiv) Investigates how an adversary can optimally use its query budget for targeted evasion attacks against deep neural networks.
-
Neural Network Model Extraction Attacks in Edge Devicesby Hearing Architectural Hints arxiv.org
(arxiv) Through the acquisition of memory access events from bus snooping, layer sequence identification bythe LSTM-CTC model, layer topology connection according to the memory access pattern, and layer dimension estimation under data volume constraints, it demonstrates one can…
-
Stealing Neural Networks via Timing Side Channels arxiv.org
(arXiv) Stealing/approximating a model through timing attacks usin queries.
-
xGEMs: Generating Examplars to Explain Black-Box Models arxiv.org
(arXiv) Searches bias in the black box model by training an unsupervised implicit generative model. Thensummarizes the black-box model behavior quantitatively by perturbing data samples along the data manifold.
-
Learning Networks from Random Walk-Based Node Similarities arxiv.org
(NIPS) Reversing graphs by observing some random walk commute times.
- next page of items loading…
