Site   Web

August 11, 2014

Microsoft Tackles Dull First-Person Videos With New Algorithm

Microsoft is taking first-person videos from dry to interesting with a new project that turns long uneventful clips into smooth hyperlapse sequences.

The new technology will be especially useful for mountain climbers, cyclists and other athletes who have taken to wearing a helmet camera to capture their experiences.

Microsoft researchers Johannes Kopf, Michael Cohen and Richard Szeliski, who are heading up the project, said the tool runs first-person videos through its algorithms to create a new, smoother picture.

“Our algorithm first reconstructs the 3D input camera path as well as dense, per-frame proxy geometries,” reads a post. “We then optimize a novel camera path for the output video (shown in red) that is smooth and passes near the input cameras while ensuring that the virtual camera looks in directions that can be rendered well from the input. Next, we compute geometric proxies for each input frame. These allow us to render the frames from the novel viewpoints on the optimized path.

“Finally, we generate the novel smoothed, time-lapse video by rendering, stitching, and blending appropriately selected source frames for each output frame. We present a number of results for challenging videos that cannot be processed using traditional techniques.”

The researchers said the technology should soon be translated into an app for Windows.

Check out a video from the researchers offering a more detailed explanation:


Jennifer Cowan is the Managing Editor for SiteProNews.