Andrei Barbu

Current Advisees

Allison Fu - Graduate Student
Nazar Ilamanov - UROP
David Mayo - Graduate Student

Past Advisees

Houssam Kherraz - UROP
Battushig Myanganbayar - UROP

Projects

Grounded language acquisition
Grounded question answering
Investigating neural signals underlying language processing in the human brain
Multi-sentence event recognition
Objects and hands in context

CBMM Publications

Y. - L. Kuo, Katz, B., and Barbu, A., “Deep compositional robotic planners that follow natural language commands ”, in International Conference on Robotics and Automation (ICRA), Palais des Congrès de Paris, Paris, France, 2020.
A. Netanyahu, Shu, T., Katz, B., Barbu, A., and Tenenabum, J. B., “PHASE: PHysically-grounded Abstract Social Eventsfor Machine Social Perception”, in Shared Visual Representations in Human and Machine Intelligence (SVRHM) workshop at NeurIPS 2020, 2020.
A. Barbu, Mayo, D., Alverio, J., Luo, W., Wang, C., Gutfreund, D., Tenenabum, J. B., and Katz, B., “ObjectNet: A large-scale bias-controlled dataset for pushing the limits of object recognition models”, Neural Information Processing Systems (NeurIPS 2019). Vancouver, Canada, 2019.
Y. - L. Kuo, Katz, B., and Barbu, A., “Deep Compositional Robotic Planners that Follow Natural Language Commands.”, Workshop on Visually Grounded Interaction and Language (ViGIL) at the Thirty-third Annual Conference on Neural Information Processing Systems (NeurIPS). Vancouver Convention Centre, Vancouver, Canada, 2019.
C. Ross, Berzak, Y., Katz, B., and Barbu, A., “Learning Language from Vision.”, in Workshop on Visually Grounded Interaction and Language (ViGIL) at the Thirty-third Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver Convention Center, Vancouver, Canada, 2019.
Y. - L. Kuo, Barbu, A., and Katz, B., “Deep sequential models for sampling-based planning”, in The IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2018), Madrid, Spain, 2018.
C. Ross, Barbu, A., Berzak, Y., Myanganbayar, B., and Katz, B., “Grounding language acquisition by training semantic parsersusing captioned videos”, in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), , Brussels, Belgium, 2018.
B. Myanganbayar, Mata, C., Dekel, G., Katz, B., Ben-Yosef, G., and Barbu, A., “Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation”. 2018.
B. Myanganbayar, Mata, C., Dekel, G., Katz, B., Ben-Yosef, G., and Barbu, A., “Partially Occluded Hands: A challenging new dataset for single-image hand pose estimation”, in The 14th Asian Conference on Computer Vision (ACCV 2018), 2018.
R. Paul, Barbu, A., Felshin, S., Katz, B., and Roy, N., “Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context”, in Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI 2017), Melbourne, Australia, 2017.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Language and Vision Ambiguities (LAVA) Corpus”. 2016.
Y. Berzak, Huang, Y., Barbu, A., Korhonen, A., and Katz, B., “Anchoring and Agreement in Syntactic Annotations”. 2016.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Do You See What I Mean? Visual Resolution of Linguistic Ambiguities”. 2016.
B. Katz and Barbu, A., “A look back at the June 2016 BMM Workshop in Sestri Levante, Italy”. 2016.
H. Yu, Siddharth, N., Barbu, A., and Siskind, J. Mark, “A Compositional Framework for Grounding Language Inference, Generation, and Acquisition in Video”. 2015.
Y. Berzak, Barbu, A., Harari, D., Katz, B., and Ullman, S., “Do You See What I Mean? Visual Resolution of Linguistic Ambiguities”, in Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal. , 2015.
A. Barbu, Barrett, D., Chen, W., Siddharth, N., Xiong, C., Corso, J. J., Fellbaum, C. D., Hanson, C., Hanson, S. José, Helie, S., Malaia, E., Pearlmutter, B. A., Siskind, J. Mark, Talavage, T. Michael, and Wilbur, R. B., “Seeing is worse than believing: Reading people’s minds better than computer-vision methods recognize actions”, in Computer Vision – ECCV 2014, Lecture Notes in Computer Science, vol. 8693, Zurich, Switzerland: Springer International Publishing, 2014, pp. 612–627.
N. Siddharth, Barbu, A., and Siskind, J. Mark, “Seeing what you're told, sentence guided activity recognition in video”, Appeared at CVPR. IEEE, 2014.
N. Siddharth, Barbu, A., and Siskind, J. Mark, “Seeing What You’re Told: Sentence-Guided Activity Recognition In Video.”. 2014.
A. Barbu, Barrett, D., Chen, W., Siddharth, N., Xiong, C., Corso, J. J., Fellbaum, C. D., Hanson, C., Hanson, S. José, Helie, S., Malaia, E., Pearlmutter, B. A., Siskind, J. Mark, Talavage, T. Michael, and Wilbur, R. B., “The Compositional Nature of Event Representations in the Human Brain”. 2014.
N. Siddharth, Barbu, A., and Siskind, J. Mark, “Seeing What You’re Told: Sentence-Guided Activity Recognition In Video”, in CVPR, Columbus, Ohio, 2014.
N. Amir, Besold, T. R., Camoriano, R., Erdogan, G., Flynn, T., Gillary, G., Gomez, J., Herbert-Voss, A., Hotan, G., Kadmon, J., Linderman, S. W., Liu, T. T., Marantan, A., Olson, J., Orchard, G., Pal, D. K., Pasquale, G., Sanders, H., Silberer, C., Smith, K. A., de Briton, C. Stein N., Suchow, J. W., Tessler, M. H., Viejo, G., Walker, D., Wehbe, L., Barbu, A., Isik, L., Mackevicius, E., and Meroz, Y., “Abstracts of the 2014 Brains, Minds, and Machines Summer Course”. 2014.
A. Barbu, Barrett, D., Chen, W., Siddharth, N., Xiong, C., Corso, J. J., Fellbaum, C. D., Hanson, C., Hanson, S. José, Helie, S., Malaia, E., Pearlmutter, B. A., Siskind, J. Mark, Talavage, T. Michael, and Wilbur, R. B., “Seeing is Worse than Believing: Reading People’s Minds Better than Computer-Vision Methods Recognize Actions”. 2014.