Abstract:

We aim to model the process of ‘full interpretation’ of object images, which is the ability to identify and localize all semantic features and parts that are recognized by human observers. We model the interpretation process by identifying primitive components and relations that play a useful role in full interpretation by humans. To identify useful components and relations used in the interpretation process, we consider  the interpretation of 'minimal configurations’, namely reduced local regions that are minimal in the sense that further reduction will turn them unrecognizable and uninterpretable. We describe experimental results of our model, and discuss approaches of interpretation modeling to recognize human activities and human interactions, which are beyond the scope of current models of visual recognition.