Using language to understand vision and vision to understand language

Using language to understand vision and vision to understand language

Date Posted: 

July 14, 2016

Date Recorded: 

July 13, 2016

CBMM Speaker(s): 

  • CBMM Summer Lecture Series

Associated CBMM Pages: 

Description: 

Andrei Barbu, Research Scientist at MIT, discusses using language to understand vision and vision to understand language. He shows how the simple ability to compare an English sentence and a video clip can form the basis for many tasks such as recognition, image and video retrieval, generation of video captions, question answering, language disambiguation, language learning, paraphrasing, translation between languages, and planning.

Resources:

Associated Research Thrust: