Events

Learning to See the World in 3D

Humans can effortlessly construct rich mental representations of the 3D world from sparse input, such as a single image. This is a core aspect of intelligence that helps us understand and interact with our surroundings and with each other. Ayush Tewari’s research aims to build similar computational models–artificial intelligence methods that can perceive properties of the 3D structured world from images and videos. Despite remarkable progress in 2D computer vision, 3D perception remains an open problem due to some unique challenges, such as limited 3D training data and uncertainties in reconstruction.

In this talk, Tewari will discuss these challenges and explain how his research addresses them by posing vision as an inverse problem, and by designing machine learning models with physics-inspired inductive biases. Tewari will demonstrate techniques for reconstructing 3D faces and objects, and for reasoning about uncertainties in scene reconstruction using generative models. He will then discuss how these efforts advance us toward scalable and generalizable visual perception and how they advance application domains such as computer graphics and robotics.