Publication
Norm-based Generalization Bounds for Sparse Neural Networks. NeurIPS 2023 (2023). at <https://proceedings.neurips.cc/paper_files/paper/2023/file/8493e190ff1bbe3837eca821190b61ff-Paper-Conference.pdf>
NeurIPS-2023-norm-based-generalization-bounds-for-sparse-neural-networks-Paper-Conference.pdf (577.69 KB)
Notes on Hierarchical Splines, DCLNs and i-theory. (2015).
CBMM Memo 037 (1.83 MB)
NSF Science and Technology Centers – The Class of 2013. (2013).
NSFGender2013_poster.pdf (2.77 MB)
From Neuron to Cognition via Computational Neuroscience (The MIT Press, 2016). at <https://mitpress.mit.edu/neuron-cognition>
Object-Oriented Deep Learning. (2017).
CBMM-Memo-070.pdf (963.54 KB)
An Overview of Some Issues in the Theory of Deep Networks. IEEJ Transactions on Electrical and Electronic Engineering 15, 1560 - 1571 (2020).
PCA as a defense against some adversaries. (2022).
CBMM-Memo-135.pdf (2.58 MB)
Phone Classification by a Hierarchy of Invariant Representation Layers. INTERSPEECH 2014 - 15th Annual Conf. of the International Speech Communication Association (International Speech Communication Association (ISCA), 2014). at <http://www.isca-speech.org/archive/interspeech_2014/i14_2346.html>
Position: A Theory of Deep Learning Must Include Compositional Sparsity. (2025).
CBMM Memo 159.pdf (676.35 KB)
On the Power of Decision Trees in Auto-Regressive Language Modeling. (2024).
CBMM-Memo-149.pdf (2.11 MB)
Properties of invariant object recognition in human one-shot learning suggests a hierarchical architecture different from deep convolutional neural networks. Vision Science Society (2019).
Properties of invariant object recognition in human oneshot learning suggests a hierarchical architecture different from deep convolutional neural networks . Vision Science Society (2019). doi:10.1167/19.10.28d
Pruning Convolutional Neural Networks for Image Instance Retrieval. (2017). at <https://arxiv.org/abs/1707.05455>
1707.05455.pdf (143.46 KB)
Representation Learning from Orbit Sets for One-shot Classification. AAAI Spring Symposium Series, Science of Intelligence (2017). at <https://www.aaai.org/ocs/index.php/SSS/SSS17/paper/view/15357>
Representation Learning in Sensory Cortex: a theory. (2014).
CBMM-Memo-026_neuron_ver45.pdf (1.35 MB)
Representation Learning in Sensory Cortex: a theory. IEEE Access 1 - 1 (2022). doi:10.1109/ACCESS.2022.3208603
Representation_Learning_in_Sensory_Cortex_a_theory.pdf (1.17 MB)
Scale and translation-invariance for novel objects in human vision. Scientific Reports 10, (2020).
s41598-019-57261-6.pdf (1.46 MB)
A Science of Intelligence . (2015).
A Science of Intelligence.pdf (659.5 KB)
Self-Assembly of a Biologically Plausible Learning Circuit. (2024).
CBMM-Memo-152.pdf (1.84 MB)
SGD and Weight Decay Provably Induce a Low-Rank Bias in Deep Neural Networks. (2023).
Low-rank bias.pdf (2.38 MB)
SGD Noise and Implicit Low-Rank Bias in Deep Neural Networks. (2022).
Implicit Rank Minimization.pdf (1.76 MB)
]