%0 Journal Article %J psyArXiv %D 2022 %T An approximate representation of objects underlies physical reasoning %A Yichen Li %A YingQiao Wang %A Tal Boger %A Kevin A Smith %A Samuel J Gershman %A Tomer Ullman %X
People make fast and reasonable predictions about the physical behavior of everyday objects. To do so, people may be using principled approximations, similar to models developed by engineers for the purposes of real-time physical simulations. We hypothesize that people use simplified object approximations for tracking and action (the "body" representation), as opposed to fine-grained forms for recognition (the "shape" representation). We used three classic psychophysical tasks (causality perception, collision detection, and change detection) in novel settings that dissociate body and shape. People's behavior across tasks indicates that they rely on approximate bodies for physical reasoning, and that this approximation lies between convex hulls and fine-grained shapes.
%B psyArXiv %8 03/2022 %G eng %U https://psyarxiv.com/vebu5/ %0 Generic %D 2021 %T AGENT: A Benchmark for Core Psychological Reasoning %A Tianmin Shu %A Abhishek Bhandwaldar %A Chuang Gan %A Kevin A Smith %A Shari Liu %A Dan Gutfreund %A Elizabeth S Spelke %A Joshua B. Tenenbaum %A Tomer D. Ullman %B Proceedings of the 38th International Conference on Machine Learning %8 07/2021 %0 Journal Article %J bioRxiv %D 2021 %T Meta-strategy learning in physical problem solving: the effect of embodied experience %A Kelsey Allen %A Kevin A Smith %A Laura Bird %A Joshua B. Tenenbaum %A Tamar Makin %A Dorothy Cowie %XEmbodied cognition suggests that our experience in our bodies -- including our motor experiences -- shape our cognitive and perceptual capabilities broadly. Much work has studied how differences in the physical body (either natural or manipulated) can impact peoples cognitive and perceptual capacities, but often these judgments relate directly to those body differences. Here we focus instead on how natural embodied experience affects what kinds of abstract physical problem-solving strategies people use in a virtual task. We compare how groups with different embodied experience -- children and adults with congenital limb differences versus those born with two hands -- perform on this task, and find that while there is no difference in overall accuracy or time to complete the task, the groups use different meta-strategies to come to solutions. Specifically, both children and adults born with limb differences take a longer time to think before acting, and as a result take fewer overall actions to reach solutions to physical reasoning problems. Conversely, the process of development affects the particular actions children use as they age regardless of how many hands they were born with, as well as their persistence with their current strategy. Taken together, our findings suggest that differences in embodied experience drive the acquisition of different meta-strategies for balancing acting with thinking, deciding what kinds of actions to try, and deciding how persistent to be with a current action plan.
%B bioRxiv %8 08/2021 %G eng %0 Journal Article %J psyArXiv %D 2021 %T Partial Mental Simulation Explains Fallacies in Physical Reasoning %A Illona Bass %A Kevin A Smith %A Elizabeth Bonawitz %A Tomer Ullman %XPeople can reason intuitively, efficiently, and accurately about everyday physical events. Recent accounts suggest that people use mental simulation to make such intuitive physical judgments. But mental simulation models are computationally expensive; how is physical reasoning relatively accurate, while maintaining computational tractability? We suggest that people make use of partial simulation, mentally moving forward in time only parts of the world deemed relevant. We propose a novel partial simulation model, and test it on the physical conjunction fallacy, a recently observed phenomenon (Ludwin-Peery, Bramley, Davis, & Gureckis, 2020) that poses a challenge for full simulation models. We find an excellent fit between our model's predictions and human performance on a set of scenarios that build on and extend those used by Ludwin-Peery et al. (2020), quantitatively and qualitatively accounting for a deviation from optimal performance. Our results suggest more generally how we allocate cognitive resources to efficiently represent and simulate physical scenes.
%B psyArXiv %8 11/2021 %G eng %U https://psyarxiv.com/y4a8x %0 Conference Paper %B International Conference on Learning Representations %D 2021 %T Unsupervised Discovery of 3D Physical Objects %A Yilun Du %A Kevin A Smith %A Tomer Ullman %A Joshua B. Tenenbaum %A Jiajun Wu %XWe study the problem of unsupervised physical object discovery. Unlike existing frameworks that aim to learn to decompose scenes into 2D segments purely based on each object's appearance, we explore how physics, especially object interactions,facilitates learning to disentangle and segment instances from raw videos, and to infer the 3D geometry and position of each object, all without supervision. Drawing inspiration from developmental psychology, our Physical Object Discovery Network (POD-Net) uses both multi-scale pixel cues and physical motion cues to accurately segment observable and partially occluded objects of varying sizes, and infer properties of those objects. Our model reliably segments objects on both synthetic and real scenes. The discovered object properties can also be used to reason about physical events.
%B International Conference on Learning Representations %8 07/2020 %G eng %U https://openreview.net/forum?id=lf7st0bJIA5 %0 Conference Paper %B Proceedings of the 42th Annual Meeting of the Cognitive Science Society - Developing a Mind: Learning in Humans, Animals, and Machines, CogSci 2020, virtual, July 29 - August 1, 2020 %D 2020 %T The fine structure of surprise in intuitive physics: when, why, and how much? %A Kevin A Smith %A Lingjie Mei %A Shunyu Yao %A Jiajun Wu %A Elizabeth S Spelke %A Joshua B. Tenenbaum %A Tomer D. Ullman %E Stephanie Denison %E Michael Mack %E Yang Xu %E Blair C. Armstrong %B Proceedings of the 42th Annual Meeting of the Cognitive Science Society - Developing a Mind: Learning in Humans, Animals, and Machines, CogSci 2020, virtual, July 29 - August 1, 2020 %G eng %U https://cogsci.mindmodeling.org/2020/papers/0761/index.html %0 Journal Article %J Proceedings of the National Academy of Sciences %D 2020 %T Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoning %A Kelsey Allen %A Kevin A Smith %A Joshua B. Tenenbaum %K intuitive physics %K physical problem solving %K tool use %XMany animals, and an increasing number of artificial agents, display sophisticated capabilities to perceive and manipulate objects. But human beings remain distinctive in their capacity for flexible, creative tool use—using objects in new ways to act on the world, achieve a goal, or solve a problem. To study this type of general physical problem solving, we introduce the Virtual Tools game. In this game, people solve a large range of challenging physical puzzles in just a handful of attempts. We propose that the flexibility of human physical problem solving rests on an ability to imagine the effects of hypothesized actions, while the efficiency of human search arises from rich action priors which are updated via observations of the world. We instantiate these components in the “sample, simulate, update” (SSUP) model and show that it captures human performance across 30 levels of the Virtual Tools game. More broadly, this model provides a mechanism for explaining how people condense general physical knowledge into actionable, task-specific plans to achieve flexible and efficient physical problem solving.
%B Proceedings of the National Academy of Sciences %P 201912341 %8 11/2021 %G eng %U http://www.pnas.org/lookup/doi/10.1073/pnas.1912341117 %! Proc Natl Acad Sci USA %R 10.1073/pnas.1912341117 %0 Conference Proceedings %B 33rd Conference on Neural Information Processing Systems (NeurIPS 2019) %D 2019 %T Modeling Expectation Violation in Intuitive Physics with Coarse Probabilistic Object Representations %A Kevin A Smith %A Lingjie Mei %A Shunyu Yao %A Jiajun Wu %A Elizabeth S Spelke %A Joshua B. Tenenbaum %A Tomer D. Ullman %XFrom infancy, humans have expectations about how objects will move and interact. Even young children expect objects not to move through one another, teleport, or disappear. They are surprised by mismatches between physical expectations and perceptual observations, even in unfamiliar scenes with completely novel objects. A model that exhibits human-like understanding of physics should be similarly surprised, and adjust its beliefs accordingly. We propose ADEPT, a model that uses a coarse (approximate geometry) object-centric representation for dynamic 3D scene understanding. Inference integrates deep recognition networks, extended probabilistic physical simulation, and particle filtering for forming predictions and expectations across occlusion. We also present a new test set for measuring violations of physical expectations, using a range of scenarios derived from de- velopmental psychology. We systematically compare ADEPT, baseline models, and human expectations on this test set. ADEPT outperforms standard network architectures in discriminating physically implausible scenes, and often performs this discrimination at the same level as people.
%B 33rd Conference on Neural Information Processing Systems (NeurIPS 2019) %C Vancouver, Canada %8 11/2019 %G eng %U http: //physadept.csail.mit.edu/ %0 Conference Proceedings %B Robotics: Science and Systems 2018 %D 2018 %T Differentiable physics and stable modes for tool-use and manipulation planning %A Marc Toussaint %A Kelsey Allen %A Kevin A Smith %A Joshua B. Tenenbaum %XWe consider the problem of sequential manipulation and tool-use planning in domains that include physical interactions such as hitting and throwing. The approach integrates a Task And Motion Planning formulation with primitives that either impose stable kinematic constraints or differentiable dynamical and impulse exchange constraints at the path optimization level. We demonstrate our approach on a variety of physical puzzles that involve tool use and dynamic interactions. We then compare manipulation sequences generated by our approach to human actions on analogous tasks, suggesting future directions and illuminating current limitations.
%B Robotics: Science and Systems 2018 %8 06/2018 %G eng %0 Generic %D 2018 %T End-to-end differentiable physics for learning and control %A Filipe de Avila Belbute-Peres %A Kevin A Smith %A Kelsey Allen %A Joshua B. Tenenbaum %A Zico Kolter %B Advances in Neural Information Processing Systems 31 (NIPS 2018) %0 Conference Proceedings %B Proceedings of the 39th Annual Conference of the Cognitive Science Society %D 2017 %T Faulty Towers: A counterfactual simulation model of physical support %A Tobias Gerstenberg %A Liang Zhou %A Kevin A Smith %A Joshua B. Tenenbaum %K causality %K counterfactual %K intuitive physics %K mental simulation %K support %XIn this paper we extend the counterfactual simulation model (CSM) – originally developed to capture causal judgments about dynamic events (Gerstenberg, Goodman, Lagnado, & Tenenbaum, 2014) – to explain judgments of physical support. The CSM predicts that people judge physical support by men- tally simulating what would happen if the object of interest were removed. Two experiments test the model by asking par- ticipants to evaluate the extent to which one brick in a tower is responsible for the rest of the bricks staying on the table. The results of both experiments show a very close correspon- dence between counterfactual simulations and responsibility judgments. We compare three versions of the CSM which dif- fer in how they model people’s uncertainty about what would have happened. Participants’ selections of which bricks would fall are best explained by assuming that counterfactual inter- ventions only affect some aspects while leaving the rest of the scene unchanged.
%B Proceedings of the 39th Annual Conference of the Cognitive Science Society %8 07/2017 %G eng %0 Generic %D 2016 %T Rapid Physical Predictions from Convolutional Neural Networks %A Filipe Peres %A Kevin A Smith %A Joshua B. Tenenbaum %B Neural Information Processing Systems, Intuitive Physics Workshop %U http://phys.csail.mit.edu/papers/9.pdf %0 Generic %D 2014 %T Abstracts of the 2014 Brains, Minds, and Machines Summer Course %A Nadav Amir %A Tarek R. Besold %A Raffaello Camoriano %A Goker Erdogan %A Thomas Flynn %A Grant Gillary %A Jesse Gomez %A Ariel Herbert-Voss %A Gladia Hotan %A Jonathan Kadmon %A Scott W. Linderman %A Tina T. Liu %A Andrew Marantan %A Joseph Olson %A Garrick Orchard %A Dipan K. Pal %A Giulia Pasquale %A Honi Sanders %A Carina Silberer %A Kevin A Smith %A Carlos Stein N. de Briton %A Jordan W. Suchow %A M. H. Tessler %A Guillaume Viejo %A Drew Walker %A Leila Wehbe %A Andrei Barbu %A Leyla Isik %A Emily Mackevicius %A Yasmine Meroz %XA compilation of abstracts from the student projects of the 2014 Brains, Minds, and Machines Summer School, held at Woods Hole Marine Biological Lab, May 29 - June 12, 2014.
http://hdl.handle.net/1721.1/100189