Meta Files Patent for Mixed Reality Headsets with Facial Expression Technology

Meta, the parent company of Facebook, has filed a patent application for a new technology that could allow its wearable mixed reality headsets to mimic a feature found in Apple’s Vision Pro. The Apple device uses sensors inside the headset to display a user’s facial expressions on an external display, and Meta’s technology aims to achieve a similar effect.

According to the patent application, Meta’s technology uses sensors inside the mixed reality headset to track a user’s facial expressions in real-time. These sensors can detect the movement of facial muscles and map them to specific expressions, which are then used to control a virtual version of the user, known as an avatar.

The process begins when a user wears the headset and the sensor tracks the movement of their facial muscles. The sensor then determines the user’s current facial expression by mapping it to the movement of the muscle. There are 20 different facial expressions that can be detected, as illustrated in a diagram included in the patent application.

Once the device has determined the user’s facial expression, it will automatically adjust the avatar to match the expression. The modified avatar is then provided to an “immersive reality application” hosted on a remote server.

While the Apple Vision Pro displays a user’s facial expressions on an external display, Meta’s technology could enable more detailed and responsive avatars on other Meta products and services. The patent application also mentions the use of machine learning technology to associate the movement of facial muscles with the user’s expression.

While the patent application does not indicate when this feature may become available in a Meta product, its potential inclusion could lead to more advanced and interactive avatars in the future.