Zuckerberg's new VR avatars are surprisingly realistic

3D Metaverse Codec Avatar of Mark Zuckerberg
(Image credit: Lex Fridman via YouTube)

Meta CEO Mark Zuckerberg has unveiled the latest advancement in Meta's VR technology, which is now capable of recreating a photorealistic rendition of the user's face. In an interview hosted by computer scientist and podcaster Lex Fridman, both parties sported Meta Quest Pro headsets and conversed entirely in VR, showcasing a huge improvement from Zuckerberg's previous adventures in the Metaverse. 

The sophisticated technology uses Meta’s extremely (and disturbingly) lifelike Codec avatars that are still in the prototype phase, but there are plans to develop the technology for general consumers in the near future. (If you want a taste of virtual reality, check out our collection of the best VR headsets).

Lex Fridman interviewing Mark Zuckerberg in VR

Fridman was extremely impressed by the technology, telling Zuckerberg that it felt as if they were "in the same room" (Image credit: Lex Fridman via YouTube)

Fridman began the interview by sharing his amazement at the technology, stating that the realism of the VR avatars was incredible, and it felt like he and Zuckerberg were in the same room. The room in question was a type of impenetrable black void – which will presumably be subject to development when the technology reaches general audiences – but in this case, it felt like the appropriate setting to display the sheer detail of the avatars.

The photorealistic renders feature high-definition details of the face, such as facial hair, skin texture and freckles, which all add to the immersive lifelike experience of the technology. The synching of the avatars effortlessly mimics natural facial movements and allows even the famously unexpressive Zuck, to show some character. 

Lex Fridman's VR Codec avatar

Fridman was extremely impressed with the technology's lifelike quality (Image credit: Lex Fridman via YouTube)

To create these intricate models, both Zuckerberg and Fridman underwent intensive facial scanning with over 100 cameras, to capture their likenesses in full photorealistic detail. Zuckerberg claims that currently, Meta will "probably need to over collect expressions," before it can work on a more user-friendly model that requires less extensive scans.

However, the CEO has shared plans to develop the technology, making it accessible to general Meta users."The goal, and we have a project working on this already, is just to do a very quick scan where you take your cell phone, kind of wave it in front of your face for a couple of minutes, say a few sentences, make a bunch of expressions," Zuckerberg shares.

Despite the clear groundbreaking detail of these VR renditions, the avatars have a slightly uncanny style of movement that makes them appear a little twitchy. As a viewer, it's hard to feel a sense of immersion when watching the video, but it's clear that the experience felt very real for Fridman, who said: "There's an uncanny valley that seems to have been crossed here." 

Before this sophisticated update, the Metaverse was the subject of ridicule, after Zuckerberg debuted the far less detailed Horizon Worlds – a cartoonish 3D avatar world. While the once legless floating entities of Horizon World have since had an appendage-adding update, its basic caricature style has never quite taken off with users.

Mark Zuckerberg's Horizon World selfie in front of the Eiffel Tower

Zuckerberg was heavily mocked after poster a selfie of his Horizon World avatar in front of the Eiffel Tower (Image credit: Mark Zuckerberg via Facebook)

Although it's a little while off, it seems that this updated technology is somewhat of a grand comeback for Zuckerberg, who's proven that Meta certainly has the technology and innovation to make the Metaverse into more than a juvenile 3D chatroom. 

Recently Zuck can't seem to stop, as he recently announced a host of celebrity AI chatbots that nobody asked for, and Meta's hot on the AI trend, introducing a free AI model that could take ChatGPT's crown. 

Thank you for reading 5 articles this month* Join now for unlimited access

Enjoy your first month for just £1 / $1 / €1

*Read 5 free articles per month without a subscription

Join now for unlimited access

Try first month for just £1 / $1 / €1

Natalie Fear
Staff Writer

Natalie is Creative Bloq's staff writer. With an eye for trending topics and a passion for internet culture, she brings you the latest in art and design news. A recent English Literature graduate, Natalie enjoys covering the lighter side of the news and brings a fresh and fun take to her articles. Outside of work (if she’s not glued to her phone), she loves all things music and enjoys singing sweet folky tunes.