Rapid Physical Predictions from Convolutional Neural Networks