Implicit dynamic regularization in deep networks

TitleImplicit dynamic regularization in deep networks
Publication TypeCBMM Memos
Year of Publication2020
AuthorsPoggio, T, Liao, Q, Xu, M
Date Published08/2020

Square loss has been observed to perform well in classification tasks, at least as well as crossentropy. However, a theoretical justification is lacking. Here we develop a theoretical analysis for the square loss that  complements the existing asymptotic analysis for the exponential loss.


CBMM Memo No:  112

Associated Module: 

CBMM Relationship: 

  • CBMM Funded