Xue in MLFL Thursday Nov. 3 at noon

Tianfan Xue will present “Visual Dynamics Probabilistic Future Frame Synthesis Via Cross Convolutional Networks” in the Machine Learning and Friends Lunch this Thursday at noon. Details, abstract and short bio are below.

What is it? A gathering of students/faculty/staff with broad interest in the methods and applications of machine learning.
When is it? Thursdays 12:00pm to 1:00pm, unless otherwise noted. Arrive at 11:45 to get pizza.
Where is it? CS150
Who is invited? Everyone is welcome.
Is there food? Yes! Pizza is provided.

Visual Dynamics Probabilistic Future Frame Synthesis Via Cross Convolutional Networks

Abstract:
We study the problem of synthesizing a number of likely future frames from a single input image. In contrast to traditional methods, which have tackled this problem in a deterministic or non-parametric way, we propose to model future frames in a probabilistic manner. Our probabilistic model makes it possible for us to sample and synthesize many possible future frames from a single input image. To synthesize realistic movement of objects, we propose a novel network structure, namely a Cross Convolutional Network; this network encodes image and motion information as feature maps and convolutional kernels, respectively. In experiments, our model performs well on synthetic data, such as 2D shapes and animated game sprites, as well as on real-world video frames. Please refer to our website for more details: http://visualdynamics.csail.mit.edu/.

Short bio:
Tianfan Xue is currently a fifth-year Ph.D. student in MIT CSAIL, working with William T. Freeman. Before that, he received his B.E. degree from Tsinghua Universtiy, and M.Phil. degree from The Chinese University of Hong Kong. His research interests include computer vision, image processing, and machine learning. Specifically, he is interested in motion estimation and image and video processing based on the motion information.