New 3D tech could give you a live makeover on Skype

In recent years, we've become used to seeing actors like Andy Serkis filmed and then turned into apes, monsters and wide-eyed aliens using motion capture (as shown below).

Motion capture as practised at Andy Serkis's studio The Imaginarium

Motion capture as practised at Andy Serkis's studio The Imaginarium

However tired or hungover you were, you could give yourself an instant makeover – just like kids cartoon The Jetsons imagined many decades ago:

Well we're not there yet - but Microsoft is currently demoing some intriguing new tech that could one day lead to just that kind of service. At SIGGRAPH 2014, it's been showing off a combined hardware and software solution for markerless reconstruction of non-rigidly deforming physical objects with arbitrary shape in real-time.

The system uses a single self-contained stereo camera unit built from off-the-shelf components and consumer graphics hardware to generate spatio-temporally coherent 3D models at 30 Hz. A new stereo matching algorithm estimates real-time RGB-D data.

Microsoft claims its system is an order of magnitude faster than state-of-the-art methods, while matching the quality and robustness of many offline algorithms.

Check out the video below, which shows how this tech can be used for interactive scenarios including re-texturing, online performance capture and preview, and real-time shape and motion re-targeting. And no pingpong balls need to be attached anywhere!

What applications can you see for this new technology? Share your vision with the community in the comments below.

Thank you for reading 5 articles this month* Join now for unlimited access

Enjoy your first month for just £1 / $1 / €1

*Read 5 free articles per month without a subscription

Join now for unlimited access

Try first month for just £1 / $1 / €1

TOPICS
Tom May
Freelance journalist and editor

Tom May is an award-winning journalist and author specialising in design, photography and technology. His latest book, The 50th Greatest Designers, was released in June 2025. He's also author of the Amazon #1 bestseller Great TED Talks: Creativity, published by Pavilion Books, Tom was previously editor of Professional Photography magazine, associate editor at Creative Bloq, and deputy editor at net magazine.