mNo edit summary |
Added a link here, in case a page is made for it. |
||
(12 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
< | <languages/> | ||
= Hardware = <!--T:3--> | <!--T:1--><translate><!--T:1--> Resonite Supports face and [[Eye Tracking]] with the following hardware currently:</translate> | ||
* Make sure everything is plugged in. If you're unsure unplug and then re-plug all cables. A green or blue light should be present on all items. | * <translate><!--T:2--> Vive Pro Eye - Eye Tracking</translate> | ||
* Check all cables are intact and do not look frayed, damaged or kinked. | * <translate><!--T:3--> Vive Facial Tracker - Face Tracking</translate> | ||
** <translate><!--T:4--> This doesn't require a Vive Headset. Users have had success with a variety of headsets and Tape.</translate> | |||
* Quest Pro via Steam Link | |||
<translate><!--T:5--> If you're having issues with either of these systems please take a look and follow the general advice below.</translate> | |||
== <translate><!--T:6--> Hardware</translate> == <!--T:3--> | |||
* <translate><!--T:7--> Make sure everything is plugged in. If you're unsure unplug and then re-plug all cables. A green or blue light should be present on all items.</translate> | |||
* <translate><!--T:8--> Check all cables are intact and do not look frayed, damaged or kinked.</translate> | |||
<!--T:4--> | <!--T:4--> | ||
For non Vive Pro Eye headsets, you may need a USB-C to USB Adapter. These look like this: | <translate><!--T:9--> For non Vive Pro Eye headsets, you may need a USB-C to USB Adapter. These look like this:</translate> | ||
<!--T:5--> | <!--T:5--> | ||
[[File:USBC_USBAdapter.jpg|250px|A USB-C to USB Adapter]] | [[File:USBC_USBAdapter.jpg|250px|<translate><!--T:10--> A USB-C to USB Adapter</translate>]] | ||
== Face Tracker Mounting == <!--T:23--> | === <translate><!--T:11--> Face Tracker Mounting</translate> === <!--T:23--> | ||
<!--T:24--> | <!--T:24--> | ||
For non-vive headsets, users have been sharing all sorts of mounting options. A short list of these is supplied below for reference. | <translate><!--T:12--> For non-vive headsets, users have been sharing all sorts of mounting options. A short list of these is supplied below for reference.</translate> | ||
<!--T:25--> | <!--T:25--> | ||
* '''Tape''' - Lots of tape and the Tracker sticks quite well. Any tape works. | * <translate><!--T:13--> '''Tape''' - Lots of tape and the Tracker sticks quite well. Any tape works.</translate> | ||
* '''Double Sided Velcro Tape''' - This provides a removable mounting option. Make sure it is heavy duty so it can support the weight of the tracker and the movement of your head. | * <translate><!--T:14--> '''Double Sided Velcro Tape''' - This provides a removable mounting option. Make sure it is heavy duty so it can support the weight of the tracker and the movement of your head.</translate> | ||
* 3D Printing | * <translate><!--T:15--> 3D Printing</translate> | ||
** '''[https://www.thingiverse.com/thing:4798891 Simple Mount]''' - A simple mount that can be stuck to the bottom of the headset with tape. | ** <translate><!--T:16--> '''[https://www.thingiverse.com/thing:4798891 Simple Mount]''' - A simple mount that can be stuck to the bottom of the headset with tape.</translate> | ||
** '''[https://www.thingiverse.com/thing:4806854 Friction Mount]''' - A mount that uses friction/clips between the mount and the Valve Index Frunk. This can fail if you are moving your head around too vigorously. | ** <translate><!--T:17--> '''[https://www.thingiverse.com/thing:4806854 Friction Mount]''' - A mount that uses friction/clips between the mount and the Valve Index Frunk. This can fail if you are moving your head around too vigorously.</translate> | ||
** '''[https://www.thingiverse.com/thing:4807214 Magnetic Mount]''' - Uses the existing Valve Index Frunk Cover's Magnets to stick to the headset. This one will require magnets with the following dimensions: 1/8" dia. x 1/8" thick. Stuck to the print. | ** <translate><!--T:18--> | ||
'''[https://www.thingiverse.com/thing:4807214 Magnetic Mount]''' - Uses the existing Valve Index Frunk Cover's Magnets to stick to the headset. This one will require magnets with the following dimensions: 1/8" dia. x 1/8" thick. Stuck to the print. | |||
</translate> | |||
== <translate><!--T:19--> Software</translate> == <!--T:6--> | |||
=== Steam Link === | |||
Steam Link can handle both Eye and Face tracking for supported headsets and will work out of the box for Resonite. | |||
To change the port that Resonite is listening on for Steam Link face/eye tracking. Go to Settings > Devices while using Steam Link. | |||
Make sure you are not running any OSC applications that may interfere. | |||
[https://www.meta.com/en-gb/experiences/5841245619310585/ Steam Link for Meta Download] | |||
=== <translate><!--T:20--> Installing the Software for Vive hardware only.</translate> === | |||
<!-- To update, HTC discontinued silently the software and is hard to get now --> | |||
<translate><!--T:21--> Both Facial tracking and Eye tracking require the same software from HTC. You can download the software from the [https://www.vive.com/setup/facial-tracker HTC Website]. Once downloaded please find it within your Start Menu and run it. Once installed and ran it should place an icon in your system tray(the icons to the right side of your taskbar) which look like this:</translate> | |||
Both Facial tracking and Eye tracking require the same software from HTC. You can download the software from the [https://www.vive.com/setup/facial-tracker HTC Website]. Once downloaded please find it within your Start Menu and run it. Once installed and ran it should place an icon in your system tray(the icons to the right side of your taskbar) which look like this: | |||
<!--T:7--> | <!--T:7--> | ||
[[File:SRAnipal_Icon.png|100px|SRAnipal's System Tray Icon]] | [[File:SRAnipal_Icon.png|100px|<translate><!--T:22--> SRAnipal's System Tray Icon</translate>]] | ||
<!--T:8--> | <!--T:8--> | ||
If this icon appears, tracking will usually be functional. | <translate><!--T:23--> If this icon appears, tracking will usually be functional.</translate> | ||
== Tracking Status == <!--T:9--> | === <translate><!--T:24--> Tracking Status</translate> === <!--T:9--> | ||
The icon(a robot), also communicates the status of the tracking: | <translate><!--T:25--> The icon(a robot), also communicates the status of the tracking:</translate> | ||
* The Eyes of the robot show the status of Eye Tracking | * <translate><!--T:26--> The Eyes of the robot show the status of Eye Tracking</translate> | ||
* The mouth of the robot shows the status of Face Tracking | * <translate><!--T:27--> The mouth of the robot shows the status of Face Tracking</translate> | ||
<!--T:10--> | <!--T:10--> | ||
The color of the eyes or mouth tell you what is happening: | <translate><!--T:28--> The color of the eyes or mouth tell you what is happening:</translate> | ||
* Black means the tracking is inactive | * <translate><!--T:29--> Black means the tracking is inactive</translate> | ||
* Orange means the tracking is idle/standby | * <translate><!--T:30--> Orange means the tracking is idle/standby</translate> | ||
* Green means the tracking is active | * <translate><!--T:31--> Green means the tracking is active</translate> | ||
== About Window == <!--T:11--> | === <translate><!--T:32--> About Window</translate> === <!--T:11--> | ||
If you right-click the robot icon, you will see a small menu, selecting about will bring up a window. This window will provide addtional information such as: | <translate><!--T:33--> If you right-click the robot icon, you will see a small menu, selecting about will bring up a window. This window will provide addtional information such as:</translate> | ||
* The Software Version | * <translate><!--T:34--> The Software Version</translate> | ||
* The Eye Tracker Version | * <translate><!--T:35--> The Eye Tracker Version</translate> | ||
* The Face Tracker Version | * <translate><!--T:36--> The Face Tracker Version</translate> | ||
<!--T:12--> | <!--T:12--> | ||
If N/A is displayed in the Eye Camera or Lip camera portion it means that the software cannot detect your device. see [[#Hardware| Hardware]] for some troubleshooting steps. | <translate><!--T:37--> If N/A is displayed in the Eye Camera or Lip camera portion it means that the software cannot detect your device. see [[#Hardware| Hardware]] for some troubleshooting steps.</translate> | ||
<!--T:13--> | <!--T:13--> | ||
The current version of the software is: '''1.3.2.0'''. | <translate><!--T:38--> The current version of the software is: '''1.3.2.0'''. However it is recommended to use 1.3.1.1</translate> | ||
== Eye Tacking Calibration == <!--T:14--> | === <translate><!--T:39--> Eye Tacking Calibration</translate> === <!--T:14--> | ||
The Vive Pro Eye, needs occasional Calibration to detect your eyes as best as it can. See [https://www.vive.com/us/support/vive-pro-eye/category_howto/calibrating-eye-tracking.html HTC Vive Pro Eye Calibration] for how to do this. | <translate><!--T:40--> The Vive Pro Eye, needs occasional Calibration to detect your eyes as best as it can. See [https://www.vive.com/us/support/vive-pro-eye/category_howto/calibrating-eye-tracking.html HTC Vive Pro Eye Calibration] for how to do this.</translate> | ||
== Additional Software / Hardware Help == <!--T:15--> | === <translate><!--T:41--> Additional Software / Hardware Help</translate> === <!--T:15--> | ||
As the Vive Headsets and Facial Trackers are made by HTC, they have their own help sections and support systems. Please see their resources for additional assistance: | <translate><!--T:42--> As the Vive Headsets and Facial Trackers are made by HTC, they have their own help sections and support systems. Please see their resources for additional assistance:</translate> | ||
* [https://www.vive.com/us/support/facial-tracker/category_howto/tracker.html Facial Tracker HTC Help] | * <translate><!--T:43--> [https://www.vive.com/us/support/facial-tracker/category_howto/tracker.html Facial Tracker HTC Help]</translate> | ||
* [https://www.vive.com/us/support/vive-pro-eye/ Vive Pro Eye HTC Help] | * <translate><!--T:44--> [https://www.vive.com/us/support/vive-pro-eye/ Vive Pro Eye HTC Help]</translate> | ||
* [https://www.vive.com/us/support/vive-pro-eye/category_howto/calibrating-eye-tracking.html HTC Vive Pro Eye Calibration] | * <translate><!--T:45--> [https://www.vive.com/us/support/vive-pro-eye/category_howto/calibrating-eye-tracking.html HTC Vive Pro Eye Calibration]</translate> | ||
= Resonite = <!--T:16--> | == <translate><!--T:46--> Resonite</translate> == <!--T:16--> | ||
<!--T:17--> | <!--T:17--> | ||
Once the software and hardware is setup, you should be able to just run Resonite and everything should work out ok. After Resonite starts and is running in your starting world. | <translate><!--T:47--> Once the software and hardware is setup, you should be able to just run Resonite and everything should work out ok. After Resonite starts and is running in your starting world.</translate> | ||
<!--T:18--> | <!--T:18--> | ||
If you have Eye Tracking, the Robot Eyes should be green. | <translate><!--T:48--> If you have Eye Tracking, the Robot Eyes should be green.</translate> | ||
If you have Facial Tracking, the Robot Mouth should be green. | <translate><!--T:49--> If you have Facial Tracking, the Robot Mouth should be green.</translate> | ||
<!--T:19--> | <!--T:19--> | ||
Now, try equipping a Face/Eye Tracking Compatible avatar. | <translate><!--T:50--> Now, try equipping a Face/Eye Tracking Compatible avatar.</translate> | ||
== Issues with Resonite == <!--T:20--> | === <translate><!--T:51--> Issues with Resonite</translate> === <!--T:20--> | ||
If your tracking is not working in Resonite. Try: | <translate><!--T:52--> If your tracking is not working in Resonite. Try:</translate> | ||
* Ensuring the Robot Icon is in your System Tray | * <translate><!--T:53--> Ensuring the Robot Icon is in your System Tray</translate> | ||
* Restarting Resonite | * <translate><!--T:54--> Restarting Resonite</translate> | ||
* Restarting your Computer | * <translate><!--T:55--> Restarting your Computer</translate> | ||
* Adding <code>-ForceSRAnipal</code> to your [[Command_Line_Arguments#How_to_use_command_line_arguments| Command Line Arguments]] | * <translate><!--T:56--> Adding <code>-ForceSRAnipal</code> to your [[Command_Line_Arguments#How_to_use_command_line_arguments| Command Line Arguments]]</translate> | ||
<!--T:21--> | <!--T:21--> | ||
If things are still not working. Please [[Frequently Asked Questions#Regular_Log_Files|grab some logs]] and ask in #questions-help forum within the Resonite Discord. | <translate><!--T:57--> If things are still not working. Please [[Frequently Asked Questions#Regular_Log_Files|grab some logs]] and ask in #questions-help forum within the Resonite Discord.</translate> | ||
== Shape Keys and Setup == <!--T:22--> | === <translate><!--T:58--> Shape Keys and Setup</translate> === <!--T:22--> | ||
Once your avatar is working please see the guide on setting up your avatar. TODO: THIS NEEDS TO BE WRITTEN. | <translate><!--T:59--> Once your avatar is working please see the guide on setting up your avatar. TODO: THIS NEEDS TO BE WRITTEN.</translate> | ||
<!--T:26--> | <!--T:26--> |
Latest revision as of 07:46, 27 August 2024
Resonite Supports face and Eye Tracking with the following hardware currently:
- Vive Pro Eye - Eye Tracking
- Vive Facial Tracker - Face Tracking
- This doesn't require a Vive Headset. Users have had success with a variety of headsets and Tape.
- Quest Pro via Steam Link
If you're having issues with either of these systems please take a look and follow the general advice below.
Hardware
- Make sure everything is plugged in. If you're unsure unplug and then re-plug all cables. A green or blue light should be present on all items.
- Check all cables are intact and do not look frayed, damaged or kinked.
For non Vive Pro Eye headsets, you may need a USB-C to USB Adapter. These look like this:
Face Tracker Mounting
For non-vive headsets, users have been sharing all sorts of mounting options. A short list of these is supplied below for reference.
- Tape - Lots of tape and the Tracker sticks quite well. Any tape works.
- Double Sided Velcro Tape - This provides a removable mounting option. Make sure it is heavy duty so it can support the weight of the tracker and the movement of your head.
- 3D Printing
- Simple Mount - A simple mount that can be stuck to the bottom of the headset with tape.
- Friction Mount - A mount that uses friction/clips between the mount and the Valve Index Frunk. This can fail if you are moving your head around too vigorously.
- Magnetic Mount - Uses the existing Valve Index Frunk Cover's Magnets to stick to the headset. This one will require magnets with the following dimensions: 1/8" dia. x 1/8" thick. Stuck to the print.
Software
Steam Link
Steam Link can handle both Eye and Face tracking for supported headsets and will work out of the box for Resonite.
To change the port that Resonite is listening on for Steam Link face/eye tracking. Go to Settings > Devices while using Steam Link.
Make sure you are not running any OSC applications that may interfere.
Installing the Software for Vive hardware only.
Both Facial tracking and Eye tracking require the same software from HTC. You can download the software from the HTC Website. Once downloaded please find it within your Start Menu and run it. Once installed and ran it should place an icon in your system tray(the icons to the right side of your taskbar) which look like this:
If this icon appears, tracking will usually be functional.
Tracking Status
The icon(a robot), also communicates the status of the tracking:
- The Eyes of the robot show the status of Eye Tracking
- The mouth of the robot shows the status of Face Tracking
The color of the eyes or mouth tell you what is happening:
- Black means the tracking is inactive
- Orange means the tracking is idle/standby
- Green means the tracking is active
About Window
If you right-click the robot icon, you will see a small menu, selecting about will bring up a window. This window will provide addtional information such as:
- The Software Version
- The Eye Tracker Version
- The Face Tracker Version
If N/A is displayed in the Eye Camera or Lip camera portion it means that the software cannot detect your device. see Hardware for some troubleshooting steps.
The current version of the software is: 1.3.2.0. However it is recommended to use 1.3.1.1
Eye Tacking Calibration
The Vive Pro Eye, needs occasional Calibration to detect your eyes as best as it can. See HTC Vive Pro Eye Calibration for how to do this.
Additional Software / Hardware Help
As the Vive Headsets and Facial Trackers are made by HTC, they have their own help sections and support systems. Please see their resources for additional assistance:
Resonite
Once the software and hardware is setup, you should be able to just run Resonite and everything should work out ok. After Resonite starts and is running in your starting world.
If you have Eye Tracking, the Robot Eyes should be green. If you have Facial Tracking, the Robot Mouth should be green.
Now, try equipping a Face/Eye Tracking Compatible avatar.
Issues with Resonite
If your tracking is not working in Resonite. Try:
- Ensuring the Robot Icon is in your System Tray
- Restarting Resonite
- Restarting your Computer
- Adding
-ForceSRAnipal
to your Command Line Arguments
If things are still not working. Please grab some logs and ask in #questions-help forum within the Resonite Discord.
Shape Keys and Setup
Once your avatar is working please see the guide on setting up your avatar. TODO: THIS NEEDS TO BE WRITTEN.
This article or section is a Stub. You can help the Resonite Wiki by expanding it.