Publication

Found 10 results
Author Title Type [ Year(Desc)]
Filters: Author is Tomer Galanti  [Clear All Filters]
2021
Xu, M. et al. Dynamics and Neural Collapse in Deep Classifiers trained with the Square Loss. (2021).PDF icon v1.0 (4.61 MB)PDF icon v1.4corrections to generalization section (5.85 MB)PDF icon v1.7Small edits (22.65 MB)
2022
Galanti, T. & Galanti, L. On the Implicit Bias Towards Minimal Depth of Deep Neural Networks. arXiv (2022). at <https://arxiv.org/abs/2202.09028>PDF icon 2202.09028.pdf (2 MB)
Galanti, T. & Poggio, T. SGD Noise and Implicit Low-Rank Bias in Deep Neural Networks. (2022).PDF icon Implicit Rank Minimization.pdf (1.76 MB)
2023
Rangamani, A., Lindegaard, M., Galanti, T. & Poggio, T. Feature learning in deep classifiers through Intermediate Neural Collapse. (2023).PDF icon Feature_Learning_memo.pdf (2.16 MB)
Xu, M. et al. The Janus effects of SGD vs GD: high noise and low rank. (2023).PDF icon Updated with appendix showing empirically that the main results extend to deep nonlinear networks (2.95 MB)PDF icon Small updates...typos... (616.82 KB)
Galanti, T., Xu, M., Galanti, L. & Poggio, T. Norm-Based Generalization Bounds for Compositionally Sparse Neural Networks. (2023).PDF icon Norm-based bounds for convnets.pdf (1.2 MB)
Galanti, T., Xu, M., Galanti, L. & Poggio, T. Norm-based Generalization Bounds for Sparse Neural Networks. NeurIPS 2023 (2023). at <https://proceedings.neurips.cc/paper_files/paper/2023/file/8493e190ff1bbe3837eca821190b61ff-Paper-Conference.pdf>PDF icon NeurIPS-2023-norm-based-generalization-bounds-for-sparse-neural-networks-Paper-Conference.pdf (577.69 KB)
Galanti, T., Siegel, Z., Gupte, A. & Poggio, T. SGD and Weight Decay Provably Induce a Low-Rank Bias in Deep Neural Networks. (2023).PDF icon Low-rank bias.pdf (2.38 MB)
2024
Ziyin, L., Chuang, I., Galanti, T. & Poggio, T. Formation of Representations in Neural Networks. (2024).PDF icon CBMM-Memo-150.pdf (4.03 MB)
Gan, Y., Galanti, T., Poggio, T. & Malach, E. On the Power of Decision Trees in Auto-Regressive Language Modeling. (2024).PDF icon CBMM-Memo-149.pdf (2.11 MB)