On the information bottleneck theory of deep learning
Journal of Statistical Mechanics: Theory and Experiment, 2019. [All Versions].
- from
- AGI & CoCoSci
- added
- 2026-10-10
- likes
- 0
similar
-
Deep Learning and the Information Bottleneck Principle robotics.caltech.edu
IEEE Information Theory Workshop'15, 2015. [All Versions]. The first paper identifying the problem of information bottleneck in representation learning.
-
Individual differences among deep neural network models kriegeskortelab.zuckermaninstitute.columbia.edu
Nature Communications, 2020. [All Versions].
-
Meta-Interpretive Learning from noisy images link.springer.com
Machine Learning, 2018. [All Versions].
-
George Dahl cs.toronto.edu
-
Jiquan Mgiam cs.stanford.edu
-
Moitra. Theoretical Foundations for Deep Learning. MIT people.csail.mit.edu
It explores theoretical foundations for deep learning, emphasizing the following themes: (1) Approximation: What sorts of functions can be represented by deep networks, and does depth provably increase the expressive power? (2) Optimization: Essentially all optimization…
AGI & CoCoSci › Papers > Complexity & Information Theory > Dimensionality Reduction: “Journal of Statistical Mechanics: Theory and Experiment, 2019. [All Versions].”