Implicit dynamic regularization in deep networks

TitleImplicit dynamic regularization in deep networks
Publication TypeCBMM Memos
Year of Publication2020
AuthorsPoggio, T, Liao, Q, Xu, M
Date Published08/2020
Abstract

Square loss has been observed to perform well in classification tasks, at least as well as crossentropy. However, a theoretical justification is lacking. Here we develop a theoretical analysis for the square loss that  complements the existing asymptotic analysis for the exponential loss.
DSpace@MIT

https://hdl.handle.net/1721.1/126653
Download:  PDF icon v1.2 PDF icon v.59 Update on rank
CBMM Memo No:  112

Associated Module: 

CBMM Relationship: 

  • CBMM Funded