Prof. Joshua Tenenbaum (CBMM Research Thrust Leader) and Tejas Kulkarni (CBMM Siemens Graduate Fellow) are helping to organize the NIPS 2015 Workshop on Black Box Learning and Inference.

Overview

Probabilistic models have traditionally co-evolved with tailored algorithms for efficient learning and inference. One of the exciting developments of recent years has been the resurgence of black box methods, which make relatively few assumptions about the model structure, allowing application to broader model families.

In probabilistic programming systems, black box methods have greatly improved the capabilities of inference back ends. Similarly, the design of connectionist models has been simplified by the development of black box frameworks for training arbitrary architectures. These innovations open up opportunities to design new classes of models that smoothly negotiate the transition from low-level features of the data to high-level structured representations that are interpretable and generalize well across examples.

This workshop brings together developers of black box inference technologies, probabilistic programming systems, and connectionist computing frameworks. The goal is to formulate a shared understanding of how black box methods can enable advances in the design of intelligent learning systems. Topics of discussion will include:

• Black box techniques for gradient ascent, variational inference, Markov chain- and sequential Monte Carlo.
• Implementation of black box techniques in probabilistic programming systems and computing frameworks for connectionist model families.
• Models that integrate top-down and bottom-up model representations to perform amortized inference: variational autoencoders, deep latent Gaussian models, restricted Boltzmann machines, neural network based proposals in MCMC.
• Applications to vision, speech, reinforcement learning, motor control, language learning.

Keynote talks

• Josh Tenenbaum
• Geoff Hinton

Research talks

• Durk Kingma
• Alp Kucukelbir
• Jan-Willem van de Meent

Systems spotlights

• Koray Kavukcuoglu (Torch)
• Alp Kucukelbir (Stan)
• Yi Wu (BLOG)
• Avi Pfeffer (Figaro)
• Vikash Mansinghka (Venture)
• Tejas Kulkarni (Picture)

Organizers

• Josh Tenenbaum (MIT)
• Jan-Willem van de Meent (Oxford)
• Tejas Kulkarni (MIT)
• Ali Eslami (Google DeepMind)
• Brooks Paige (Oxford)
• Frank Wood (Oxford)
• Zoubin Ghahramani (Cambridge)

News Link: http://www.blackboxworkshop.org/