Meta recently revealed a big breakthrough in full-body avatars with moving legs and the only a Quest VR headset used for tracking.
Meta Reality Labs is making big strides in avatar rendering with the latest advances combining machine learning (ML) with sensor data from Quest VR headsets to show your full body, including arms, legs, torso, and head. The result is a very realistic and accurate representation of the poses and movements of a person wearing a Quest 2 headset.
This is quite amazing since only the positions and orientations of the Quest VR headset and its two controllers were used to estimate leg motion and position. There are no tracking bands placed on the legs and no external cameras used for this remarkable system. Meta Research Scientist Alexander Winkler shared several videos on Twitter along with links to the scientific paper on arXiv and a YouTube video with more detail.
In a scientific sense, this is known as motion tracking from sparse sensors and ML is particularly adept at extracting meaningful information from very little, if there are enough dependencies between what is known and unknown.
