All Publications
2025
CBMM Memo No.
159
, “Position: A Theory of Deep Learning Must Include Compositional Sparsity”. 2025.
CBMM Memo 159.pdf (676.35 KB)
CBMM Funded
CBMM Memo No.
158
, “Multiplicative Regularization Generalizes Better Than Additive Regularization”. 2025.
CBMM Memo 158.pdf (4.8 MB)
CBMM Funded
CBMM Memo No.
156
, “On efficiently computable functions, deep networks and sparse compositionality”. 2025.
Deep_sparse_networks_approximate_efficiently_computable_functions.pdf (223.15 KB)
CBMM Funded
, “The Indoor-Training Effect: unexpected gains from distribution shifts in the transition function”. 2025.
CBMM Related
, “What if Eye..? Computationally Recreating Vision Evolution”, arXiv, 2025.
2501.15001v1.pdf (5.2 MB)
CBMM Funded
2024
CBMM Memo No.
152
, “Self-Assembly of a Biologically Plausible Learning Circuit”. 2024.
CBMM-Memo-152.pdf (1.84 MB)
CBMM Funded
CBMM Memo No.
151
, “On Generalization Bounds for Neural Networks with Low Rank Layers”. 2024.
CBMM-Memo-151.pdf (697.31 KB)
CBMM Funded
CBMM Memo No.
150
, “Formation of Representations in Neural Networks”. 2024.
CBMM-Memo-150.pdf (4.03 MB)
CBMM Funded
CBMM Memo No.
149
, “On the Power of Decision Trees in Auto-Regressive Language Modeling”. 2024.
CBMM-Memo-149.pdf (2.11 MB)
CBMM Funded
CBMM Memo No.
148
, “For HyperBFs AGOP is a greedy approximation to gradient descent”. 2024.
CBMM-Memo-148.pdf (1.06 MB)
CBMM Funded
, “Benchmarking Out-of-Distribution Generalization Capabilities of DNN-based Encoding Models for the Ventral Visual Cortex”, in NeurIPS 2024, 2024.
CBMM Related
, “Compositional sparsity of learnable functions”, Bulletin of the American Mathematical Society, vol. 61, pp. 438-456, 2024.
CBMM Funded
CBMM Memo No.
145
, “Compositional Sparsity of Learnable Functions”. 2024.
This is an update of the AMS paper (230.72 KB)
CBMM Funded
, “Top-tuning: A study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methods”, Image and Vision Computing, vol. 142, p. 104894, 2024.
CBMM Related
, “How does the primate brain combine generative and discriminative computations in vision?”, arXiv, 2024.
2023
CBMM Memo No.
144
, “The Janus effects of SGD vs GD: high noise and low rank”. 2023.
Updated with appendix showing empirically that the main results extend to deep nonlinear networks (2.95 MB)
Small updates...typos... (616.82 KB)
CBMM Funded
, “Norm-based Generalization Bounds for Sparse Neural Networks”, in NeurIPS 2023, New Orleans, 2023.
NeurIPS-2023-norm-based-generalization-bounds-for-sparse-neural-networks-Paper-Conference.pdf (577.69 KB)
CBMM Funded
, “Strong and Precise Modulation of Human Percepts via Robustified ANNs”, in NeurIPS 2023, 2023.
CBMM Funded
, “How to Guess a Gradient”, arXiv, 2023.
CBMM Funded
CBMM Funded
, Cervelli menti algoritmi. Sperling & Kupfer, 2023, p. 272.
CBMM Funded
CBMM Memo No.
143
, “A Homogeneous Transformer Architecture”. 2023.
CBMM Memo 143 v2 (1.1 MB)
CBMM Funded
, “System Identification of Neural Systems: If We Got It Right, Would We Know?”, Proceedings of the 40th International Conference on Machine Learning, PMLR, vol. 202. pp. 12430-12444, 2023.
han23d.pdf (797.48 KB)
CBMM Funded
CBMM Memo No.
142
, “Skip Connections Increase the Capacity of Associative Memories in Variable Binding Mechanisms”. 2023.
CBMM-Memo-142.pdf (1.64 MB)
CBMM Funded
, “Catalyzing next-generation Artificial Intelligence through NeuroAIAbstract”, Nature Communications, vol. 14, no. 1, 2023.
CBMM Funded