University of Washington Researchers Demo Ability to Generate 3D Augmented Reality Content from 2D Images

University of Washington Researchers Demo Ability to Generate 3D Augmented Reality Content from 2D Images


After joining Google and Huawei in underwriting the UW Reality Lab at the University of Washington in January, it appears Facebook is already seeing a return on its donation.

According to results published earlier this month through Cornell University's arXiv service in a paper titled, "Photo Wake-Up: 3D Character Animation from a Single Photo," a team of Facebook and University of Washington researchers have developed a method of generating animated 3D models in augmented reality using only a photograph.

The dynamic works by fitting a morphable body model to an image and estimating a body map on that model. With the mapped model, the system constructs a 3D mesh, applies textures to the mesh that match the body map, and integrates a skeletal rig for controlling the motion of the figure. From this reconstruction, the system can appear to extract a 3D figure from a photo. The research team claims that the system works with photos, cartoon figures, and even abstract paintings

The demo video for the system shows a HoloLens user watching a figure from a Picasso painting escape from the canvas, an extreme athlete bursting forth from an advertisement, and Paul McCartney strutting out of the album cover of the Beatles album Help! Read more 






Questions?
Click here to chat with us

Live Now
Irine

Live Now : Irine

_