Drag[en]gine Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
{{tag>motioncapture democap}}
<WRAP youarehere>
[[:start|Start Page]] >> [[main|DEMoCap: Drag[en]gine Motion Capture]] >> **Meta Quest HMD Support**
</WRAP>

{{ youtube>Bc3IjYuO_dc?800x473 }}
\\ 

====== Basic Support ======

DEMoCap can be used with Meta Quest HMDs to do limited motion capture. The following features can be captured depending on your Quest model:
  * Head tracking
  * Hand tracking (controller or hands only)
  * Eye tracking
  * Face tracking
  * Finger tracking
  * Upper body movement (body tracking enabled)
  * Lower body movement (body tracking enabled)

Right now DEMoCap does not yet run on the Quest itself. Instead you have to connect the Quest to your PC where DEMoCap runs. This connection can be either wired or wireless using one of these programs:
  * [[https://github.com/WiVRn/WiVRn|WiVRn]]: Wired and wireless for Linux.
  * SteamLink: Wireless for Windows and Linux.
  * ALVR: Wireless for Windows.
  * Occulus Link/AirLink: Wired and wireless for Windows.

The most stable out of these is WiVRn. There controller and hands only works good. SteamLink has problems with finger tracking breaking the capture on Linux. Occulus Link/AirLink pretty much can't do finger tracking at all. Hence with controller mode various solutions are working while with finger tracking WiVRn seems to be the most reliable one. You have to try for yourself what works for your setup.

To use body tracking you have to do the following:
- Enable body tracking in the Settings of your Quest
- Enable upper and lower body tracking in the WiVRn settings
- Enable body tracking in the WiVRn main menu (toggle icon at the top of the screen)

Body tracking is done on the Quest using an AI model applied on the cameras built into the headset. The software runs on the headset itself so DEMoCap does not have to do this processing itself. Nevertheless body tracking on the Quest does reduce performance to some degree.
====== Full Body Tracking ======

The Quest 3 (3S) supports estimated full body tracking. For this the Quest uses the cameras built into the HMD to estimate the full body pose using AI calculations running on the headset. These poses can be retrieved as skeleton over WiVRn. DEMoCap supports simulating trackers using this full body tracking to make it transparent to your existing setup. This section outlines how to best configure DEMoCap and your characters to get the most out of a Quest FBT setup.

===== Actor Setup =====

Since the Quest produces a simulated full body the actor proportions are not matching those of the actor as outlined in [[democap:tutorialcreateactor|Create Actor]]. While you can use your own body proportions the results are most likely off. Hence if you plan to use Quest FBT it is recommended to create a custom actor profile named "Quest FBT" or similar. This you can then use instead of your actor profile when working with Quest FBT.

Since the quest only can use reliably the floor distance of the headset it calculates the body proportions solely from it. In general the floor height of a Quest is your own height minus 8-10cm. Hence you can measure your own height and then fill in the values as follows:

  * Shoulder Level: ''Height'' - 0.4
  * Shoulder Width: (''Height'' - 0.09) * 0.25
  * Arm Length: (''Height'' - 0.09) * 0.45
  * Leg Length: (''Height'' - 0.09) * 0.6
  * Foot Distance: Same as ''Shoulder Width''

For example if you measure your height as 1.8m then you would enter the following values:

  * Shoulder Level: 1.4
  * Shoulder Width: 0.4275 (or rounded 0.42)
  * Arm Length: 0.7695 (or rounded 0.77)
  * Leg Length: 1.026 (or rounded 1)
  * Foot Distance: Same as ''Shoulder Width''

===== WiVRn =====

The stable and development branch of WiVRn does not yet contain support for Quest FBT. For this you have to use a separate feature branch. Packages for Linux and Quest you can find here:
  * [[https://github.com/WiVRn/WiVRn/actions/runs/23384815703/artifacts/6040835306|WiVRn APK]]. You have to side-load this APK onto your Quest. See WiVRn for information on how to do this.
  * [[https://github.com/WiVRn/WiVRn/actions/runs/23384815703/artifacts/6040832482|WiVRn Server Flatpak]]. For your Linux system to connect to the Quest.

For more informations have a look at the [[https://wivrn.github.io/|WiVRn Page]].
Drag[en]gine Wiki

User Tools

Site Tools

Page Tools
