How does an AI "see" what's in a photo?

How does an AI "see" what's in a photo?

Date Posted:  August 29, 2023
Date Recorded:  August 29, 2023
Speaker(s):  Yousif Kashef Alghetaa
  • All Captioned Videos
  • #TeachMeSomething

KRIS: Hey, Yousif. Teach me something.

YOUSIF KASHEF ALGHETAA: All righty. Did you know that you could have an AI try to predict what's in an image? For example, if you showed it this image, it would say this is a bear. But you don't really know why it's a bear, and there are methods of finding out what it thought was important about an image. For example, one method uses occlusion, and that means I'm going to cover up little parts of the image and ask it whether it was a bear and see how good it guesses.

For instance, I could cover this little part and say, hey, AI, is this a bear, and it would say, yes, this is a bear. But you could cover up a part that's important like this and ask it is this a bear, and it'll say dog. And if you do this for enough times, it will remember the parts where the AI had trouble guessing what exactly was happening and construct a little heat map of what thought was important. And that is how AI makes decisions about what it thought was important.

Description: 

#MITTeachMeSomething

Yousif Kashef Ghetaa, MS Computer Vision in Neuroscience, York University

Want to learn more? https://teachmesomething.mit.edu/tms/how-does-ai-see-whats-photo

#MITTeachMeSomethingTuesday #MIT #TeachMeSomething #TeachMeSomethingTuesday #AI #occlusion #imageprocessing #imagerecognition #neuralnetworks