Publication
Word-level Invariant Representations From Acoustic Waveforms. INTERSPEECH 2014 - 15th Annual Conf. of the International Speech Communication Association (International Speech Communication Association (ISCA), 2014). at <http://www.isca-speech.org/archive/interspeech_2014/i14_2385.html>
Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review. International Journal of Automation and Computing 1-17 (2017). doi:10.1007/s11633-017-1054-2
art%3A10.1007%2Fs11633-017-1054-2.pdf (1.68 MB)
Unsupervised learning of invariant representations with low sample complexity: the magic of sensory cortex or a new framework for machine learning?. (2014).
CBMM Memo No. 001 (940.36 KB)
Unsupervised Learning of Invariant Representations in Hierarchical Architectures. (2013).
1311.4158v2.pdf (3.78 MB)
Unsupervised learning of invariant representations. Theoretical Computer Science (2015). doi:10.1016/j.tcs.2015.06.048
Theory of Deep Learning III: explaining the non-overfitting puzzle. (2017).
CBMM-Memo-073.pdf (2.65 MB)
CBMM Memo 073 v2 (revised 1/15/2018) (2.81 MB)
CBMM Memo 073 v3 (revised 1/30/2018) (2.72 MB)
CBMM Memo 073 v4 (revised 12/30/2018) (575.72 KB)
Theory III: Dynamics and Generalization in Deep Networks. (2018).
Original, intermediate versions are available under request (2.67 MB)
CBMM Memo 90 v12.pdf (4.74 MB)
Theory_III_ver44.pdf Update Hessian (4.12 MB)
Theory_III_ver48 (Updated discussion of convergence to max margin) (2.56 MB)
fixing errors and sharpening some proofs (2.45 MB)
Theory I: Why and When Can Deep Networks Avoid the Curse of Dimensionality?. (2016).
CBMM-Memo-058v1.pdf (2.42 MB)
CBMM-Memo-058v5.pdf (2.45 MB)
CBMM-Memo-058-v6.pdf (2.74 MB)
Proposition 4 has been deleted (2.75 MB)
Symmetry Regularization. (2017).
CBMM-Memo-063.pdf (6.1 MB)
Scalable Causal Discovery with Score Matching. NeurIPS 2022 (2022). at <https://openreview.net/forum?id=v56PHv_W2A>
Phone Classification by a Hierarchy of Invariant Representation Layers. INTERSPEECH 2014 - 15th Annual Conf. of the International Speech Communication Association (International Speech Communication Association (ISCA), 2014). at <http://www.isca-speech.org/archive/interspeech_2014/i14_2346.html>
An Optimal Structured Zeroth-order Algorithm for Non-smooth Optimization. 37th Conference on Neural Information Processing Systems (NeurIPS 2023) (2023). at <https://proceedings.neurips.cc/paper_files/paper/2023/file/7429f4c1b267cf619f28c4d4f1532f99-Paper-Conference.pdf>
Notes on Hierarchical Splines, DCLNs and i-theory. (2015).
CBMM Memo 037 (1.83 MB)
Less is More: Nyström Computational Regularization. NIPS 2015 (2015). at <https://papers.nips.cc/paper/5936-less-is-more-nystrom-computational-regularization>
Less is More- Nystr ̈om Computational Regularization_1507.04717v4.pdf (287.14 KB)
Learning with incremental iterative regularization. NIPS 2015 (2015). at <https://papers.nips.cc/paper/6015-learning-with-incremental-iterative-regularization>
Learning with Incremental Iterative Regularization_1405.0042v2.pdf (504.66 KB)
Learning manifolds with k-means and k-flats. Advances in Neural Information Processing Systems 25 (NIPS 2012) (2012). at <https://papers.nips.cc/paper/2012/hash/b20bb95ab626d93fd976af958fbc61ba-Abstract.html>
Learning An Invariant Speech Representation. (2014).
CBMM-Memo-022-1406.3884v1.pdf (1.81 MB)
Empirical Inference 59 - 69 (Springer Berlin Heidelberg, 2013). doi:10.1007/978-3-642-41136-610.1007/978-3-642-41136-6_7
Author's Version (147.25 KB)
I-theory on depth vs width: hierarchical function composition. (2015).
cbmm_memo_041.pdf (1.18 MB)
Computational and Cognitive Neuroscience of Vision 85-104 (Springer, 2017).
On invariance and selectivity in representation learning. Information and Inference: A Journal of the IMA iaw009 (2016). doi:10.1093/imaiai/iaw009
imaiai.iaw009.full_.pdf (267.87 KB)
]