Image-Based Rendering of Dynamic Scenes

Speaker:	Dr. Sing Bing Kang
		Researcher
		Microsoft Corporation

Title:		"Image-Based Rendering of Dynamic Scenes"

Date:		Friday, 14 October 2005

Time:		3:00pm - 4:00pm

Venue:		Room 2404 (via lift nos. 17/18)
		HKUST


Abstract:

Enabling interactive viewpoint control of a video is an exciting
application of image-based rendering. Our goal is high-quality rendering
of dynamic scenes using a relatively small number of video cameras. In
this talk, I will describe how we achieved this goal using multiple
synchronized video streams combined with novel image-based modeling and
rendering algorithms. Once these video streams have been processed, we can
synthesize any intermediate view between cameras at any time, with the
potential for space-time manipulation. In our approach, we first use a
color segmentation-based stereo algorithm to generate high-quality
photoconsistent correspondences across all camera views. Mattes for areas
near depth discontinuities are then automatically extracted to reduce
artifacts during view synthesis. Finally, a new temporal two-layer
compressed representation that handles matting is developed for rendering
at interactive rates. This work was done with Larry Zitnick, Matthew U
yttendaele, Simon Winder, and Richard Szeliski, and was presented at
SIGGRAPH'04.



************************
Biography:

Sing Bing Kang received his Ph.D. in robotics from Carnegie Mellon
University (Pittsburgh, PA) in 1994. He is currently a researcher at
Microsoft Corporation working on environment modeling from images. His
paper on the Complex Extended Gaussian Image won the IEEE Computer Society
Outstanding Paper award at CVPR'91. His IEEE Transactions on Robotics and
Automation article on human-to-robot hand mapping was awarded the 1997
King-Sun Fu Memorial Best Transaction Paper award. Sing Bing has published
about 25 refereed journal papers and about 50 refereed conference papers,
mostly on stereo and image-based rendering. He also holds 16 US patents
and has co-edited two books in computer vision ("Panoramic Vision" in 2001
and "Emerging Topics in Computer Vision" in 2004).

More details can be found at:

http://www.research.microsoft.com/~sbkang/
http://www.research.microsoft.com/~sbkang/