9.520/6.860, Class 09

Class 09: Learning with Stochastic Gradients

Instructor: Lorenzo Rosasco


We will introduce online learning from different perspectives, such as stochastic approximation and incremental emprical risk minimization. We introduce recursive (incremental) and online algorithms for optimizing RLS, and compare their merits.

Class Reference Material

L. Rosasco, T. Poggio, Machine Learning: a Regularization Approach, MIT-9.520 Lectures Notes, Manuscript, Dec. 2017

Chapter 7 - Online Learning

Note: The course notes, in the form of the circulated book draft is the reference material for this class. Related and older material can be accessed through previous year offerings of the course.

Further Reading