Face and Eye Tracking (Setup)

This page contains changes which are not marked for translation.

This is for software/hardware setup, for avatar setup, see: Face and Eye Tracking (Avatar)

Resonite Supports a number of Face and Eye Tracking systems, via native integration, plugins or mods:

Vive Pro Eye - Eye Tracking
Vive Facial Tracker - Face Tracking
Quest Pro via Steam Link(Added Beta 2024.5.22.1274) or Virtual Desktop via OSC
Other headsets with eye tracking such as the Reverb G2 Omnicept (GH Link)
Project Babble(lower face) and newer Baballonia(face and eye) via OSC. (Added Beta 2025.8.27.954 and Beta 2026.3.3.1232)
BigScreen Beyond 2e eye tracking via Plugin.

If you're having issues with either of these systems please take a look and follow the general advice below.

Hardware

While written for the Vive Tracker these instructions are generic enough to cover most lower face tracking camera systems.

Make sure everything is plugged in. If you're unsure unplug and then re-plug all cables. A green or blue light should be present on all items.
Check all cables are intact and do not look frayed, damaged or kinked.

For non Vive Pro Eye headsets, you may need a USB-C to USB Adapter.

Face Tracker Mounting

For non-vive headsets, users have been sharing all sorts of mounting options. A short list of these is supplied below for reference.

Tape - Lots of tape and the Tracker sticks quite well. Any tape works.
Double Sided Velcro Tape - This provides a removable mounting option. Make sure it is heavy duty so it can support the weight of the tracker and the movement of your head.
3D Printing
- Simple Mount - A simple mount that can be stuck to the bottom of the headset with tape.
- Friction Mount - A mount that uses friction/clips between the mount and the Valve Index Frunk. This can fail if you are moving your head around too vigorously.
- Magnetic Mount - Uses the existing Valve Index Frunk Cover's Magnets to stick to the headset. This one will require magnets with the following dimensions: 1/8" dia. x 1/8" thick. Stuck to the print.
- Options for Project Babble cameras: https://www.printables.com/search/models?q=tag%3Ababble or https://www.thingiverse.com/search?q=Project+Babble&page=1

Software

Steam Link

Steam Link for Meta Quest(Steam) Steam Link for Meta Download(Meta)

Steam Link can handle both Eye and Face tracking for supported headsets and will work out of the box for Resonite.

To use it, you will need to ensure the following options on the side of SteamVR are enabled:

"Share eye tracking data to other apps on this PC via OSC"
"Share face tracking data to other apps on this PC via OSC"

Once those options are enabled, start Resonite using Steam Link, go in the settings menu, then "Devices", and at the very bottom, under "Steam Link", and make sure that the port is the same as in the SteamVR interface (9000 by default).

Make sure you are not running any OSC applications that may interfere.

Virtual Desktop

Another popular option instead of Steam Link is https://www.vrdesktop.net/

Mods are not officially supported. All issues must be reported to the mod creator.

To enable face tracking you will need VDFaceTracking which uses the OSC support. To install see: Installing mods

Meta Quest Link

While it does work and continues to be surported, Meta Quest Link is no longer recommended due to bad upstream support and bugs. See: GH# 6182

Babble/Baballonia

Install from https://store.steampowered.com/app/4091970/Project_Babble_Baballonia/ and set up as per https://docs.babble.diy/docs/babbleofficaltracker

If you wish to change the default port in Resonite: Settings -> Devices - Project Babble

For some headsets such as the Pimax Crystal or HP Reverb G2, https://github.com/ghostiam/BrokenEye is a another way to use this software.

BigScreen Beyond

This is a community surported device via a Plugin. See: ResoniteBeyond2eDriver (Eyetracking connector for Bigscreen Beyond 2e)

It can also be made to work with Baballonia. A version that might work Linux is: https://github.com/leon-costa/Baballonia (See: Here for why this is not merged and another option)

Vive Pro Eye and/or Vive face tracker

Both the Vive Pro Eye and Vive Face tracking cameras are surpported by either the native software or Project Baballonia.

For the Pro Eye, you will need https://github.com/Blue-Doggo/ReVision to work with Baballonia.

The rest of these instructions are for the native software.

Both Facial tracking and Eye tracking require the same software from HTC. You can download the software from the HTC Website. Once downloaded please find it within your Start Menu and run it. Once installed and ran it should place an icon in your system tray(the icons to the right side of your taskbar) which look like this:

If this icon appears, tracking will usually be functional.

Tracking Status

The icon(a robot), also communicates the status of the tracking:

The Eyes of the robot show the status of Eye Tracking
The mouth of the robot shows the status of Face Tracking

The color of the eyes or mouth tell you what is happening:

Black means the tracking is inactive
Orange means the tracking is idle/standby
Green means the tracking is active

About Window

If you right-click the robot icon, you will see a small menu, selecting about will bring up a window. This window will provide addtional information such as:

The Software Version
The Eye Tracker Version
The Face Tracker Version

If N/A is displayed in the Eye Camera or Lip camera portion it means that the software cannot detect your device. see Hardware for some troubleshooting steps.

The current version of the software is: 1.3.2.0. However it is recommended to use 1.3.1.1

Eye Tacking Calibration

The Vive Pro Eye, needs occasional Calibration to detect your eyes as best as it can. See HTC Vive Pro Eye Calibration for how to do this.

Additional Software / Hardware Help

As the Vive Headsets and Facial Trackers are made by HTC, they have their own help sections and support systems. Please see their resources for additional assistance:

Resonite

Once the software and hardware is setup, you should be able to just run Resonite and everything should work out ok. After Resonite starts and is running in your starting world.

For Vive:
- If you have Eye Tracking, the Robot Eyes should be green.
- If you have Facial Tracking, the Robot Mouth should be green.

Now, try equipping a Face/Eye Tracking Compatible avatar. Two easy examples are:

Issues with Resonite

If your tracking is not working in Resonite. Try:

Ensuring the Robot Icon is in your System Tray
Restarting Resonite
Restarting your Computer
Adding the relevant command line option, such as -ForceSRAnipal to your Command line arguments#Forcing specific hardware

If things are still not working. Please grab some logs and ask in #questions-help forum within the Resonite Discord.

Avatar

Once your software and hardware is working please see the guide on setting up your avatar. Face and Eye Tracking (Avatar)