Andrei Barbu

Past Advisees

Allison Fu - Graduate Student
Nazar Ilamanov - UROP
Houssam Kherraz - UROP
David Mayo - Graduate Student
Battushig Myanganbayar - UROP

Projects

Grounded language acquisition
Grounded question answering
Investigating neural signals underlying language processing in the human brain
Multi-sentence event recognition
Objects and hands in context

CBMM Publications

Y. - L. Kuo, Huang, X., Barbu, A., McGill, S. G., Katz, B., Leonard, J. J., and Rosman, G., “Trajectory Prediction with Linguistic Representations”. 2022.
R. Tejwani, Kuo, Y. - L., Shu, T., Stankovits, B., Gutfreund, D., Tenenabum, J. B., Katz, B., and Barbu, A., “Incorporating Rich Social Interactions Into MDPs”. 2022.
A. Netanyahu, Shu, T., Katz, B., Barbu, A., and Tenenabum, J. B., “PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception”, in AAAI-21, 2021.
Y. - L. Kuo, Katz, B., and Barbu, A., “Compositional Networks Enable Systematic Generalization for Grounded Language Understanding”. 2021.
R. Tejwani, Kuo, Y. - L., Shu, T., Katz, B., and Barbu, A., “Social Interactions as Recursive MDPs”. 2021.
C. Ross, Katz, B., and Barbu, A., “Measuring Social Biases in Grounded Vision and Language Embeddings”, NAACL (Annual Conference of the North American Chapter of the Association for Computational Linguistics). 2021.
C. Conwell, Mayo, D., Buice, M. A., Katz, B., Alvarez, G. A., and Barbu, A., “Neural Regression, Representational Similarity, Model Zoology Neural Taskonomy at Scale in Rodent Visual Cortex”. 2021.
C. Ross, Barbu, A., and Katz, B., “Measuring Social Biases in Grounded Vision and Language Embeddings”. 2021.
C. Conwell, Mayo, D., Buice, M., Katz, B., Alvarez, G., and Barbu, A., “Large-scale benchmarking of deep neural network models in mouse visual cortex reveals patterns similar to those observed in macaque visual cortex”, Cosyne. 2021.
B. Wang, Mayo, D., Deza, A., Barbu, A., and Conwell, C., “On the use of Cortical Magnification and Saccades as Biological Proxies for Data Augmentation”, in Shared Visual Representations in Human and Machine Intelligence (SVRHM) Workshop at NeurIPS, 2021.
Y. - L. Kuo, Barbu, A., and Katz, B., “Compositional RL Agents That Follow Language Commands in Temporal Logic”. 2021.
I. Palmer, Rouditchenko, A., Barbu, A., Katz, B., and Glass, J., “Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset”. 2021.
A. Netanyahu, Shu, T., Katz, B., Barbu, A., and Tenenbaum, J. B., “PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception”. 2021.
A. Uri Yaari, Sherman, M., Priebe, O. Clarke, Loh, P. - R., Katz, B., Barbu, A., and Berger, B., “Multi-resolution modeling of a discrete stochastic process identifies causes of cancer”, in International Conference on Learning Representations, 2021.
Y. - L. Kuo, Katz, B., and Barbu, A., “Encoding formulas as deep networks: Reinforcement learning for zero-shot execution of LTL formulas”. 2020.
Y. - L. Kuo, Katz, B., and Barbu, A., “Deep compositional robotic planners that follow natural language commands”. 2020.
Y. - L. Kuo, Katz, B., and Barbu, A., “Deep compositional robotic planners that follow natural language commands ”, in International Conference on Robotics and Automation (ICRA), Palais des Congrès de Paris, Paris, France, 2020.
C. Wang, Ross, C., Kuo, Y. - L., Katz, B., and Barbu, A., “Learning a natural-language to LTL executable semantic parser for grounded robotics”. 2020.
C. Wang, Ross, C., Kuo, Y. - L., Katz, B., and Barbu, A., “Learning a Natural-language to LTL Executable Semantic Parser for Grounded Robotics”, Proceedings of Conference on Robot Learning (CoRL-2020), 2020.
A. Netanyahu, Shu, T., Katz, B., Barbu, A., and Tenenbaum, J. B., “PHASE: PHysically-grounded Abstract Social Eventsfor Machine Social Perception”, in Shared Visual Representations in Human and Machine Intelligence (SVRHM) workshop at NeurIPS 2020, 2020.
A. Barbu, Banda, D., and Katz, B., “Deep video-to-video transformations for accessibility with an application to photosensitivity”, Pattern Recognition Letters, 2019.
A. Barbu, Mayo, D., Alverio, J., Luo, W., Wang, C., Gutfreund, D., Tenenbaum, J. B., and Katz, B., “ObjectNet: A large-scale bias-controlled dataset for pushing the limits of object recognition models”, Neural Information Processing Systems (NeurIPS 2019). Vancouver, Canada, 2019.
C. Ross, Berzak, Y., Katz, B., and Barbu, A., “Learning Language from Vision.”, in Workshop on Visually Grounded Interaction and Language (ViGIL) at the Thirty-third Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver Convention Center, Vancouver, Canada, 2019.
Y. - L. Kuo, Katz, B., and Barbu, A., “Deep Compositional Robotic Planners that Follow Natural Language Commands.”, Workshop on Visually Grounded Interaction and Language (ViGIL) at the Thirty-third Annual Conference on Neural Information Processing Systems (NeurIPS). Vancouver Convention Centre, Vancouver, Canada, 2019.
Y. - L. Kuo, Barbu, A., and Katz, B., “Deep sequential models for sampling-based planning”, in The IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018), Madrid, Spain, 2018.
C. Ross, Barbu, A., Berzak, Y., Myanganbayar, B., and Katz, B., “Grounding language acquisition by training semantic parsersusing captioned videos”, in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), , Brussels, Belgium, 2018.
B. Myanganbayar, Mata, C., Dekel, G., Katz, B., Ben-Yosef, G., and Barbu, A., “Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation”, in The 14th Asian Conference on Computer Vision (ACCV 2018), 2018.
B. Myanganbayar, Mata, C., Dekel, G., Katz, B., Ben-Yosef, G., and Barbu, A., “Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation”. 2018.
R. Paul, Barbu, A., Felshin, S., Katz, B., and Roy, N., “Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context”, in Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI 2017), Melbourne, Australia, 2017.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Language and Vision Ambiguities (LAVA) Corpus”. 2016.
Y. Berzak, Huang, Y., Barbu, A., Korhonen, A., and Katz, B., “Anchoring and Agreement in Syntactic Annotations”. 2016.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Do You See What I Mean? Visual Resolution of Linguistic Ambiguities”. 2016.
B. Katz and Barbu, A., “A look back at the June 2016 BMM Workshop in Sestri Levante, Italy”. 2016.
H. Yu, Siddharth, N., Barbu, A., and Siskind, J. Mark, “A Compositional Framework for Grounding Language Inference, Generation, and Acquisition in Video”. 2015.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Do You See What I Mean? Visual Resolution of Linguistic Ambiguities”, in Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal. , 2015.
A. Barbu, Barrett, D., Chen, W., Siddharth, N., Xiong, C., Corso, J. J., Fellbaum, C. D., Hanson, C., Hanson, S. José, Helie, S., Malaia, E., Pearlmutter, B. A., Siskind, J. Mark, Talavage, T. Michael, and Wilbur, R. B., “Seeing is worse than believing: Reading people’s minds better than computer-vision methods recognize actions”, in Computer Vision – ECCV 2014, Lecture Notes in Computer Science, vol. 8693, Zurich, Switzerland: Springer International Publishing, 2014, pp. 612–627.
N. Siddharth, Barbu, A., and Siskind, J. Mark, “Seeing what you're told, sentence guided activity recognition in video”, Appeared at CVPR. IEEE, 2014.
N. Siddharth, Barbu, A., and Siskind, J. Mark, “Seeing What You’re Told: Sentence-Guided Activity Recognition In Video.”. 2014.
A. Barbu, Barrett, D., Chen, W., Siddharth, N., Xiong, C., Corso, J. J., Fellbaum, C. D., Hanson, C., Hanson, S. José, Helie, S., Malaia, E., Pearlmutter, B. A., Siskind, J. Mark, Talavage, T. Michael, and Wilbur, R. B., “The Compositional Nature of Event Representations in the Human Brain”. 2014.
N. Siddharth, Barbu, A., and Siskind, J. Mark, “Seeing What You’re Told: Sentence-Guided Activity Recognition In Video”, in CVPR, Columbus, Ohio, 2014.
N. Amir, Besold, T. R., Camoriano, R., Erdogan, G., Flynn, T., Gillary, G., Gomez, J., Herbert-Voss, A., Hotan, G., Kadmon, J., Linderman, S. W., Liu, T. T., Marantan, A., Olson, J., Orchard, G., Pal, D. K., Pasquale, G., Sanders, H., Silberer, C., Smith, K. A., de Briton, C. Stein N., Suchow, J. W., Tessler, M. H., Viejo, G., Walker, D., Wehbe, L., Barbu, A., Isik, L., Mackevicius, E., and Meroz, Y., “Abstracts of the 2014 Brains, Minds, and Machines Summer Course”. 2014.
A. Barbu, Barrett, D., Chen, W., Siddharth, N., Xiong, C., Corso, J. J., Fellbaum, C. D., Hanson, C., Hanson, S. José, Helie, S., Malaia, E., Pearlmutter, B. A., Siskind, J. Mark, Talavage, T. Michael, and Wilbur, R. B., “Seeing is Worse than Believing: Reading People’s Minds Better than Computer-Vision Methods Recognize Actions”. 2014.