Face and Eye Tracking (Setup)

This is for software/hardware setup, for avatar setup, see: Face and Eye Tracking (Avatar)

Resonite supports a number of Face and Eye Tracking systems, via native integration, plugins or mods:

System	Integration	Added
Vive Pro Eye - Eye Tracking	Native SRAnipal
Vive Facial Tracker - Face Tracking	Native SRAnipal
Quest Pro via Steam Link OSC	Native SteamVR OSC	Beta 2024.5.22.1274
HP Reverb G2 Omnicept	Native SteamVR OSC	GH Link
BigScreen Beyond 2e	Plugin (Older) or Baballonia (Current)
Project Babble (lower face only)	Native	Beta 2025.8.27.954
Baballonia (face and eye, recommended)	Native	Beta 2026.3.3.1232
Virual Desktop (generic)	Virtual Desktop (Mod)
PSVR2 Eye Tracking	TBD

Integration/Software

Steam Link

Steam Link for Quest Pro

Steam Link can handle both Eye and Face tracking for supported headsets and will work out of the box for Resonite.

To use it, you will need to ensure the following options on the side of SteamVR are enabled:

• "Share eye tracking data to other apps on this PC via OSC"
• "Share face tracking data to other apps on this PC via OSC"

Once those options are enabled, start Resonite using Steam Link, go in the settings menu, then "Devices", and at the very bottom, under "Steam Link", and make sure that the port is the same as in the SteamVR interface (9000 by default).

Make sure you are not running any OSC applications that may interfere.

Virtual Desktop

By enabling Virtual Desktop's Tracking Forwarding options you can use eye and face tracking from any headset that is supported.

Mods are not officially supported. All issues must be reported to the mod creator.

To enable face tracking you will need VDFaceTracking To install see: Installing mods

Babble/Baballonia

Install from https://store.steampowered.com/app/4091970/Project_Babble_Baballonia/ and set up as per https://docs.babble.diy/docs/babbleofficaltracker

For some headsets such as the Pimax Crystal or HP Reverb G2, https://github.com/ghostiam/BrokenEye is a another way to use this software.

For the Pro Eye, you can use https://github.com/Blue-Doggo/ReVision to work with Baballonia.

If you wish to change the default port in Resonite: Settings -> Devices - Project Babble. If this setting is present it means the Babble drivers have been loaded.

BigScreen Beyond 2e

The BigScreen Beyond 2e may also be used with a community Plugin. See: ResoniteBeyond2eDriver

It can also be made to work with Baballonia. A version that might work Linux is: https://github.com/leon-costa/Baballonia (See: Here for why this is not merged and another option)

Vive Pro Eye and/or Vive face tracker

Both the Vive Pro Eye and Vive Face tracking cameras are supported by either the native software or Project Baballonia.

For the Pro Eye, you will need https://github.com/Blue-Doggo/ReVision to work with Baballonia.

The rest of these instructions are for the native software.

Both Facial tracking and Eye tracking require the same software from HTC. You can download the software from the HTC Website. Once downloaded please find it within your Start Menu and run it. Once installed and ran it should place an icon in your system tray(the icons to the right side of your taskbar) which look like this:

If this icon appears, tracking will usually be functional.

Tracking Status

The icon(a robot), also communicates the status of the tracking:

• The Eyes of the robot show the status of Eye Tracking
• The mouth of the robot shows the status of Face Tracking

The color of the eyes or mouth tell you what is happening:

• Black means the tracking is inactive
• Orange means the tracking is idle/standby
• Green means the tracking is active

About Window

If you right-click the robot icon, you will see a small menu, selecting about will bring up a window. This window will provide addtional information such as:

• The Software Version
• The Eye Tracker Version
• The Face Tracker Version

• When connected to Resonite:
  • If you have Eye Tracking, the Robot Eyes should be green.
  • If you have Facial Tracking, the Robot Mouth should be green.

If N/A is displayed in the Eye Camera or Lip camera portion it means that the software cannot detect your device. see Hardware for some troubleshooting steps.

The current version of the software is: 1.3.2.0. However it is recommended to use 1.3.1.1

Eye Tacking Calibration

The Vive Pro Eye, needs occasional Calibration to detect your eyes as best as it can. See HTC Vive Pro Eye Calibration for how to do this.

Additional Software / Hardware Help

As the Vive Headsets and Facial Trackers are made by HTC, they have their own help sections and support systems. Please see their resources for additional assistance:

• Facial Tracker HTC Help
• Vive Pro Eye HTC Help
• HTC Vive Pro Eye Calibration

WiVRn

When connecting to WiVRn with a compatible headset such as the Quest Pro, it will automatically have the face and eye tracking data sent to it for foveated rendering but is unable to send that to other programs such as Resonite.

In order to send the data to Resonite over OSC you will need an external program running to pipe the data over to the OSC port such as Edrakon.

Not all Linux distributions will come with OpenXR installed, which is a requirement for Edrakon to run.

Now that face and eye data is being sent out via OSC, Resonite needs a way to accept the data as it does not know it is being sent. To do this, the mod "RemoveThatKinkFromSteamLink" must be installed to keep Resonite's OSC port active.

Resonite

Once the software and hardware is setup, you should be able to just run Resonite and if everything is working avatars that support facial tracking will automatically have facial movements.

For a first test try equipping a Face/Eye Tracking Compatible avatar. Two examples are:

• Default Avatar - No tongue but you will be in it by default.
• Face Tracking FaceBot Avatar World - Fully complete face tracking avatar

Issues with Resonite

If your tracking is not working in Resonite. Try:

• Ensuring your tracking software is working.
• Restarting Resonite
• Restarting your Computer
• Adding the relevant command line option, such as -ForceSRAnipal to your Command line arguments#Forcing specific hardware

If things are still not working. Please grab some logs and ask in #questions-help forum within the Resonite Discord.

It might also be worth looking to see if your problem is in: GitHub Search: Face Tracking or [1]GitHub Search: Eye Tracking and see if a solution has been found and upvote if you want it fixed quicker.

Logs

If you want to look for yourself, some lines to search for in the in the logs may include:

• Initializing Input Drivers
  • Is the start of the driver loading chain and can be used to read further for signs of problems.
• Registering Babble driver
  • Shows that Resonite has detected Babble running and loaded the drivers.
• Detect ViveProEye: False
  • Resonite has not detected a native ViveProEye.
• User [redacted] Role: , HasFingerTracking: True, HasEyeTracking: False, HasLipTracking: False
  • The user is all set up with Finger, but no lip or eye tracking

Avatar

Once your software and hardware is working, please see the guide on setting up your avatar:

Face and Eye Tracking (Avatar)