New 3D tech could give you a live makeover on Skype

In recent years, we've become used to seeing actors like Andy Serkis filmed and then turned into apes, monsters and wide-eyed aliens using motion capture (as shown below).

Motion capture as practised at Andy Serkis's studio The Imaginarium

Motion capture as practised at Andy Serkis's studio The Imaginarium

But what if you could similarly change your image, live, when chatting on Skype? Okay, most of us wouldn't want to appear as aliens, but what about a digital nip and tuck to smooth out those wrinkles or clear up those bloodshot eyes?

However tired or hungover you were, you could give yourself an instant makeover – just like kids cartoon The Jetsons imagined many decades ago:

Well we're not there yet - but Microsoft is currently demoing some intriguing new tech that could one day lead to just that kind of service. At SIGGRAPH 2014, it's been showing off a combined hardware and software solution for markerless reconstruction of non-rigidly deforming physical objects with arbitrary shape in real-time.

The system uses a single self-contained stereo camera unit built from off-the-shelf components and consumer graphics hardware to generate spatio-temporally coherent 3D models at 30 Hz. A new stereo matching algorithm estimates real-time RGB-D data.

Microsoft claims its system is an order of magnitude faster than state-of-the-art methods, while matching the quality and robustness of many offline algorithms.

Check out the video below, which shows how this tech can be used for interactive scenarios including re-texturing, online performance capture and preview, and real-time shape and motion re-targeting. And no pingpong balls need to be attached anywhere!

What applications can you see for this new technology? Share your vision with the community in the comments below.

Thank you for reading 5 articles this month* Join now for unlimited access

Enjoy your first month for just £1 / $1 / €1

*Read 5 free articles per month without a subscription

Join now for unlimited access

Try first month for just £1 / $1 / €1

Tom May

Tom May is an award-winning journalist and editor specialising in design, photography and technology. Author of the Amazon #1 bestseller Great TED Talks: Creativity, published by Pavilion Books, Tom was previously editor of Professional Photography magazine, associate editor at Creative Bloq, and deputy editor at net magazine. Today, he is a regular contributor to Creative Bloq and its sister sites Digital Camera World, T3.com and Tech Radar. He also writes for Creative Boom and works on content marketing projects.