Learning Systems of Concepts with an Infinite Relational Model aaai.org

AAAI'06, 2006. [All Versions].

The Public Acquisition of Commonsense Knowledge aaai.org

Proceedings of AAAI Spring Symposium on Acquiring (and Using) Linguistic (and World) Knowledge for Information Access, 2002. [All Versions]. The first attempt for acquring commonsense knowlege from humans' activities on the internet.

Philosophical Writings of Peirce 4lib.org

Courier Corporation, 1955. [All Versions]. Original writings by C. S. Peirce, the philosopher who first introduces the concept of Abduction.

Handbook of Knowledge Representation 1lib.net

Elsevier, 2008. [All Versions]. A pragmatical handbook for all kinds of knowledge representation modes.

A Cognitive Theory of Metaphor 1lib.net

MIT Press, 1985. [All Versions]. A cognitive account on Metaphor.

Learning to Solve Problems: A Handbook for Designing Problem-Solving Learning Environments 196.223.158.148

Taylorfrancis, 2010. [All Versions].

XRay: Enhancing the Web's Transparency with Differential Correlation usenix.org

(USENIX Security) Audits which user profile data were used for targeting a particular ad, recommendation, or price.

Stealing Machine Learning Models via Prediction APIs usenix.org

(Usenix Security) (Code) Aims at extracting machine learning models in use by remote services.

Data driven exploratory attacks on black box classifiers in adversarial domains sciencedirect.com

(Neurocomputing) Reverse engineers remote classifier models (e.g., for evading a CAPTCHA test).

Auditing fairness under unawareness through counterfactual reasoning sciencedirect.com

(Information Processing & Management) Shows how to unveil whether a black-box model, complying with the regulations, is still biased or not.

FairLens: Auditing black-box clinical decision support systems sciencedirect.com

(Information Processing & Management) Presents a pipeline to detect and explain potential fairness issues in Clinical DSS, by comparing different multi-label classification disparity measures.

Online Learning for Measuring Incentive Compatibility in Ad Auctions research.fb.com

(WWW) Measures the incentive compatible- (IC) mechanisms (regret) of black-box auction platforms.

Remote Explainability faces the bouncer problem rdcu.be

(Nature Machine Intelligence volume 2, pages529–539) (Code) Shows the impossibility (with one request) or the difficulty to spot lies on the explanations of a remote AI decision.

Identifying the Machine Learning Family from Black-Box Models rd.springer.com

(CAEPIA) Determines which kind of machine learning model is behind the returned predictions.

Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysis proceedings.neurips.cc

(NeurIPS) Sobol indices provide an efficient way to capture higher-order interactions between image regions and their contributions to a (black box) neural network’s prediction through the lens of variance.

Black-Box Ripper: Copying black-box models using generative evolutionary algorithms proceedings.neurips.cc

(NeurIPS) Replicates the functionality of a black-box neural model, yet with no limit on the amount of queries (via a teacher/student scheme and an evolutionary search).

Active Fairness Auditing proceedings.mlr.press

(ICML) Studies of query-based auditing algorithms that can estimate the demographic parity of ML models in a query-efficient manner.

Bayesian Algorithm Execution: Estimating Computable Properties of Black-box Functions Using Mutual Information proceedings.mlr.press

(ICML) A budget constrained and Bayesian optimization procedure to extract properties out of a black-box algorithm.

Stealing the Decoding Algorithms of Language Models people.cs.umass.edu

(CCS) Steal the type and hyperparameters of the decoding algorithms of a LLM.

Opening Up the Black Box:Auditing Google's Top Stories Algorithm par.nsf.gov

(Flairs-32) Audit of the Google's Top stories panel that pro-vides insights into its algorithmic choices for selectingand ranking news publisher

Confidential-PROFITT: Confidential PROof of FaIr Training of Trees openreview.net

(ICLR) Proposes fair decision tree learning algorithms along with zero-knowledge proof protocols to obtain a proof of fairness on the audited server.

A zest of lime: towards architecture-independent model distances openreview.net

(ICLR) Measures the distance between two remote models using LIME.

GeoDA: a geometric framework for black-box adversarial attacks openaccess.thecvf.com

(CVPR) (Code) Crafts adversarial examples to fool models, in a pure blackbox setup (no gradients, inferred class only).

Auditing News Curation Systems:A Case Study Examining Algorithmic and Editorial Logic in Apple News ojs.aaai.org

(ICWSM) Audit study of Apple News as a sociotechnical news curation system (trending stories section).

Two-Face: Adversarial Audit of Commercial Face Recognition Systems ojs.aaai.org

(ICWSM) Performs an adversarial audit on multiple systems APIs and datasets, making a number of concerning observations.

Privacy Auditing with One (1) Training Run neurips.cc

(NeurIPS - best paper) A scheme for auditing differentially private machine learning systems with a single training run.

An Empirical Analysis of Algorithmic Pricing on Amazon Marketplace mislove.org

(WWW) (Code) Develops a methodology for detecting algorithmic pricing, and use it empirically to analyze their prevalence and behavior on Amazon Marketplace.

Modeling rabbit‑holes on YouTube link.springer.com

(SNAM) Models the trapping dynamics of users in rabbit holes in YouTube, and provides a measure of this enclosure.

Scaling up search engine audits: Practical insights for algorithm auditing journals.sagepub.com

(Journal of Information Science) (Code) Audits multiple search engines using simulated browsing behavior with virtual agents.

Query Strategies for Evading Convex-Inducing Classifiers jmlr.org

(JMLR) Evasion methods for convex classifiers. Considers evasion complexity.

Membership Inference Attacks Against Machine Learning Models ieeexplore.ieee.org

(Symposium on Security and Privacy) Given a machine learning model and a record, determine whether this record was used as part of the model's training dataset or not.

Algorithmic Transparency via Quantitative Input Influence: Theory and Experiments with Learning Systems ieeexplore.ieee.org

(Security and Privacy) Introduces measures that capture the degree of influence of inputs on outputs of the observed system.

Back in Black: Towards Formal, Black Box Analysis of Sanitizers and Filters ieeexplore.ieee.org

(Security and Privacy) Black-box analysis of sanitizers and filters.

Stealing Knowledge from Protected Deep Neural Networks Using Composite Unlabeled Data ieeexplore.ieee.org

(ICNN) Composite method which can be used to attack and extract the knowledge ofa black box model even if it completely conceals its softmaxoutput.

Under manipulations, are some AI models harder to audit? grodino.github.io

(SATML) Relates the difficulty of black-box audits to the capacity of the targeted models, using the Rademacher complexity.

The Imitation Game: Algorithm Selectionby Exploiting Black-Box Recommender github.com

(Netys) (Code) Parametrize a local recommendation algorithm by imitating the decision of a remote and better trained one.

Online Fairness Auditing through Iterative Refinement dl.acm.org

(KDD) Provides an adaptive process that automates the inference of probabilistic guarantees associated with estimating fairness metrics.

Auditing Algorithms: On Lessons Learned and the Risks of DataMinimization dl.acm.org

(AIES) A practical audit for a well-being recommendation app developed by Telefónica (mostly on bias).

Auditing radicalization pathways on dl.acm.org

(FAT*) Studies the reachability of radical channels from each others, using random walks on static channel recommendations.

Auditing YouTube’s Recommendation Algorithm for Misinformation Filter Bubbles dl.acm.org

(Transactions on Recommender Systems) What it takes to “burst the bubble,” i.e., revert the bubble enclosure from recommendations.

Auditing Algorithmic Bias on Twitter dl.acm.org

(WebSci).

Auditing the Personalization and Composition of Politically-Related Search Engine Results Pages dl.acm.org

(WWW) A Chrome extension to survey participants and collect the Search Engine Results Pages (SERPs) and autocomplete suggestions, for studying personalization and composition.

Neural Network Inversion in Adversarial Setting via Background Knowledge Alignment dl.acm.org

(CCS) Model inversion approach in the adversary setting based on training an inversion model that acts as aninverse of the original model. With no fullknowledge about the original training data, an accurate inversion is still possible by training the inversion model on…

Practical Black-Box Attacks against Machine Learning dl.acm.org

(Asia CCS) Understand how vulnerable is a remote service to adversarial classification attacks.

Peeking Beneath the Hood of Uber dl.acm.org

(IMC) Infer implementation details of Uber's surge price algorithm.

Measuring Personalization of Web Search dl.acm.org

(WWW) Develops a methodology for measuring personalization in Web search result.

Privacy Oracle: a System for Finding Application Leakswith Black Box Differential Testing dl.acm.org

(CCS) Privacy Oracle: a system that uncovers applications' leaks of personal information in transmissions to remoteservers.

Adversarial Learning dl.acm.org

(KDD) Reverse engineering of remote linear classifiers, using membership queries.

Uncovering Influence Cookbooks : Reverse Engineering the Topological Impact in Peer Ranking Services dl.acm.org

(CSCW) Aims at identifying which centrality metrics are in use in a peer ranking service.

Bias in Online Freelance Marketplaces: Evidence from TaskRabbit datworkshop.org

(dat workshop) Measures the TaskRabbit's search algorithm rank.