%0 Journal Article %J Cognition %D 2023 %T Non-commitment in mental imagery %A Bigelow, Eric J. %A McCoy, John P. %A Ullman, Tomer D. %X

We examine non-commitment in the imagination. Across 5 studies (N > 1, 800), we find that most people are non-committal about basic aspects of their mental images, including features that would be readily apparent in real images. While previous work on the imagination has discussed the possibility of non-commitment, this paper is the first, to our knowledge, to examine this systematically and empirically. We find that people do not commit to basic properties of specified mental scenes (Studies 1 and 2), and that people report non-commitment rather than uncertainty or forgetfulness (Study 3). Such non-commitment is present even for people with generally vivid imaginations, and those who report imagining the specified scene very vividly (Studies 4a, 4b). People readily confabulate properties of their mental images when non-commitment is not offered as an explicit option (Study 5). Taken together, these results establish non-commitment as a pervasive component of mental imagery.

%B Cognition %V 238 %P 105498 %8 09/2023 %G eng %U https://linkinghub.elsevier.com/retrieve/pii/S0010027723001324 %! Cognition %R 10.1016/j.cognition.2023.105498 %0 Journal Article %J Open Mind %D 2022 %T Dangerous Ground: One-Year-Old Infants are Sensitive to Peril in Other Agents’ Action PlansAbstract %A Liu, Shari %A Pepe, Bill %A Ganesh Kumar, Manasa %A Ullman, Tomer D. %A Tenenbaum, Joshua B. %A Spelke, Elizabeth S. %K action understanding %K agency %K cognitive development %K infancy %K open data %K open materials %K pre-registered %X

Do infants appreciate that other people’s actions may fail, and that these failures endow risky actions with varying degrees of negative utility (i.e., danger)? Three experiments, including a pre-registered replication, addressed this question by presenting 12- to 15-month-old infants (N = 104, 52 female, majority White) with an animated agent who jumped over trenches of varying depth towards its goals. Infants expected the agent to minimize the danger of its actions, and they learned which goal the agent preferred by observing how much danger it risked to reach each goal, even though the agent’s actions were physically identical and never failed. When we tested younger, 10-month-old infants (N = 102, 52 female, majority White) in a fourth experiment, they did not succeed consistently on the same tasks. These findings provide evidence that one-year-old infants use the height that other agents could fall from in order to explain and predict those agents’ actions.

%B Open Mind %V 6 %P 211 - 231 %8 10/2022 %G eng %U https://direct.mit.edu/opmi/article/doi/10.1162/opmi_a_00063/113342/Dangerous-Ground-One-Year-Old-Infants-are %R 10.1162/opmi_a_00063 %0 Journal Article %J Cognitive Science %D 2022 %T What Could Go Wrong: Adults and Children Calibrate Predictions and Explanations of Others' Actions Based on Relative Reward and Danger %A Gjata, Nensi N. %A Ullman, Tomer D. %A Spelke, Elizabeth S. %A Liu, Shari %X

When human adults make decisions (e.g., wearing a seat belt), we often consider the negative consequences that would ensue if our actions were to fail, even if we have never experienced such a failure. Do the same considerations guide our understanding of other people's decisions? In this paper, we investigated whether adults, who have many years of experience making such decisions, and 6- and 7-year-old children, who have less experience and are demonstrably worse at judging the consequences of their own actions, conceive others' actions as motivated both by reward (how good reaching one's intended goal would be), and by what we call “danger” (how badly one's action could end). In two pre-registered experiments, we tested whether adults and 6- and 7-year-old children tailor their predictions and explanations of an agent's action choices to the specific degree of danger and reward entailed by each action. Across four different tasks, we found that children and adults expected others to negatively appraise dangerous situations and minimize the danger of their actions. Children's and adults' judgments varied systematically in accord with both the degree of danger the agent faced and the value the agent placed on the goal state it aimed to achieve. However, children did not calibrate their inferences about how much an agent valued the goal state of a successful action in accord with the degree of danger the action entailed, and adults calibrated these inferences more weakly than inferences concerning the agent's future action choices. These results suggest that from childhood, people use a degree of danger and reward to make quantitative, fine-grained explanations and predictions about other people's behavior, consistent with computational models on theory of mind that contain continuous representations of other agents' action plans.

%B Cognitive Science %V 46 %8 06/2022 %G eng %U https://onlinelibrary.wiley.com/toc/15516709/46/7 %N 7 %! Cognitive Science %R 10.1111/cogs.v46.710.1111/cogs.13163 %0 Journal Article %J Cognitive Science %D 2021 %T Plans or Outcomes: How Do We Attribute Intelligence to Others? %A Marta Kryven %A Ullman, Tomer D. %A Cowan, William %A Joshua B. Tenenbaum %B Cognitive Science %V 45 %8 09/2021 %G eng %U https://onlinelibrary.wiley.com/toc/15516709/45/9 %N 9 %! Cognitive Science %R 10.1111/cogs.v45.910.1111/cogs.13041 %0 Conference Paper %B Thirtieth International Joint Conference on Artificial Intelligence {IJCAI-21}Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence %D 2021 %T Temporal and Object Quantification Networks %A Mao, Jiayuan %A Luo, Zhezheng %A Gan, Chuang %A Joshua B. Tenenbaum %A Wu, Jiajun %A Kaelbling, Leslie Pack %A Ullman, Tomer D. %E Zhou, Zhi-Hua %Y Gini, Maria %X

We present Temporal and Object Quantification Networks (TOQ-Nets), a new class of neuro-symbolic networks with a structural bias that enables them to learn to recognize complex relational-temporal events. This is done by including reasoning layers that implement finite-domain quantification over objects and time. The structure allows them to generalize directly to input instances with varying numbers of objects in temporal sequences of varying lengths. We evaluate TOQ-Nets on input domains that require recognizing event-types in terms of complex temporal relational patterns. We demonstrate that TOQ-Nets can generalize from small amounts of data to scenarios containing more objects than were present during training and to temporal warpings of input sequences.

%B Thirtieth International Joint Conference on Artificial Intelligence {IJCAI-21}Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence %C Montreal, Canada %8 06/2021 %G eng %U https://www.ijcai.org/proceedings/2021 %R 10.24963/ijcai.2021/386 %0 Journal Article %J Annual Review of Developmental Psychology %D 2020 %T Bayesian Models of Conceptual Development: Learning as Building Models of the World %A Ullman, Tomer D. %A Joshua B. Tenenbaum %B Annual Review of Developmental Psychology %V 2 %P 533 - 558 %8 12/2021 %G eng %U https://www.annualreviews.org/doi/10.1146/annurev-devpsych-121318-084833 %N 1 %! Annu. Rev. Dev. Psychol. %R 10.1146/annurev-devpsych-121318-084833 %0 Conference Paper %B Cognitive Science Society %D 2019 %T People's perceptions of others’ risk preferences. %A Shari Liu %A John P. McCoy %A Ullman, Tomer D. %B Cognitive Science Society %G eng %0 Journal Article %J Cognitive Psychology %D 2018 %T Learning physical parameters from dynamic scenes. %A Ullman, Tomer D. %A Stuhlmüller, Andreas %A Noah D. Goodman %A Joshua B. Tenenbaum %K intuitive physics %K intuitive theory %K learning %K physical reasoning %K probabilistic inference %X

Humans acquire their most basic physical concepts early in development, and continue to enrich and expand their intuitive physics throughout life as they are exposed to more and varied dynamical environments. We introduce a hierarchical Bayesian framework to explain how people can learn physical parameters at multiple levels. In contrast to previous Bayesian models of theory acquisition (Tenenbaum et al., 2011), we work with more ex- pressive probabilistic program representations suitable for learning the forces and properties that govern how objects interact in dynamic scenes unfolding over time. We compare our model to human learners on a challenging task of estimating multiple physical parameters in novel microworlds given short movies. This task requires people to reason simultane- ously about multiple interacting physical laws and properties. People are generally able to learn in this setting and are consistent in their judgments. Yet they also make systematic errors indicative of the approximations people might make in solving this computationally demanding problem with limited computational resources. We propose two approximations that complement the top-down Bayesian approach. One approximation model relies on a more bottom-up feature-based inference scheme. The second approximation combines the strengths of the bottom-up and top-down approaches, by taking the feature-based inference as its point of departure for a search in physical-parameter space.

%B Cognitive Psychology %V 104 %P 57-82 %8 8/2018 %G eng %U https://www-sciencedirect-com.libproxy.mit.edu/science/article/pii/S0010028517301822 %R 10.1016/j.cogpsych.2017.05.006 %0 Journal Article %J Cognition %D 2018 %T Lucky or clever? From changed expectations to attributions of responsibility %A Tobias Gerstenberg %A Ullman, Tomer D. %A Nagel, Jonas %A Max Kleiman-Weiner %A D. A. Lagnado %A Joshua B. Tenenbaum %B Cognition %8 08/2018 %G eng %0 Journal Article %J Journal of Experimental Social Psychology %D 2018 %T A Minimal Turing Test %A John P. McCoy %A Ullman, Tomer D. %K Meta-stereotypes %K Mind perception %K Natural language processing %K Stereotypes %K Turing Test %X

We introduce the Minimal Turing Test, an experimental paradigm for studying perceptions and meta-perceptions of different social groups or kinds of agents, in which participants must use a single word to convince a judge of their identity. We illustrate the paradigm by having participants act as contestants or judges in a Minimal Turing Test in which contestants must convince a judge they are a human, rather than an artificial intelligence. We embed the production data from such a large-scale Minimal Turing Test in a semantic vector space, and construct an ordering over pairwise evaluations from judges. This allows us to identify the semantic structure in the words that people give, and to obtain quantitative measures of the importance that people place on different attributes. Ratings from independent coders of the production data provide additional evidence for the agency and experience dimensions discovered in previous work on mind perception. We use the theory of Rational Speech Acts as a framework for interpreting the behavior of contestants and judges in the Minimal Turing Test.

%B Journal of Experimental Social Psychology %V 79 %P 1 - 8 %8 11/2018 %G eng %U https://linkinghub.elsevier.com/retrieve/pii/S0022103117303980 %! Journal of Experimental Social Psychology %R 10.1016/j.jesp.2018.05.007 %0 Journal Article %J Trends in Cognitive Science %D 2017 %T Mind Games: Game Engines as an Architecture for Intuitive Physics %A Ullman, Tomer D. %A Elizabeth S Spelke %A Battaglia, Peter %A Joshua B. Tenenbaum %B Trends in Cognitive Science %V 21 %P 649 - 665 %8 09/2017 %G eng %U https://www.cell.com/trends/cognitive-sciences/fulltext/S1364-6613(17)30113-4 %N 9 %) Printer online: June 26, 2017 %& 649 %R 10.1016/j.tics.2017.05.012 %0 Journal Article %J Science %D 2017 %T Ten-month-old infants infer the value of goals from the costs of actions %A Shari Liu %A Ullman, Tomer D. %A Joshua B. Tenenbaum %A Elizabeth S Spelke %X

Infants understand that people pursue goals, but how do they learn which goals people prefer? We tested whether infants solve this problem by inverting a mental model of action planning, trading off the costs of acting against the rewards actions bring. After seeing an agent attain two goals equally often at varying costs, infants expected the agent to prefer the goal it attained through costlier actions. These expectations held across three experiments that conveyed cost through different physical path features (height, width, and incline angle), suggesting that an abstract variable—such as “force,” “work,” or “effort”—supported infants’ inferences. We modeled infants’ expectations as Bayesian inferences over utility-theoretic calculations, providing a bridge to recent quantitative accounts of action understanding in older children and adults.

%B Science %V 358 %P 1038-1041 %8 11/2017 %G eng %& 1038