OSC: Difference between revisions

From Resonite Wiki
No edit summary
Added a warning note about port collision.
 
(9 intermediate revisions by 4 users not shown)
Line 7: Line 7:
* Face and Eye Tracking
* Face and Eye Tracking
* Macro Pads/Shortcut pads
* Macro Pads/Shortcut pads
== Prerequisities ==
While OSC makes it much easier to get data in and out of Resonite, it is still a network protocol which means that there are some prerequisites:
* Basic knowledge about [[wikipedia:IP_address|IP Addresses]] and [[wikipedia:Port_(computer_networking)|Network Ports]].
* For receiving:
** An open port on the computer running Resonite.
** The IP Address of the computer running Resonite.
* For sending:
** An OSC Server reachable by Resonite on the network
* Some sort of OSC Application/Tool. See [[#Tools|tools]] for some examples.
{{Note|Resonite will port collide (In other words: Take ownership of the port number given) with other applications when using OSC, make sure to pick a port you are not using.|warning}}


== Components ==
== Components ==
Line 28: Line 40:


Many OSC Applications send data purely as Floats.
Many OSC Applications send data purely as Floats.
== Multi-Dimensional Values ==
OSC Supports values which have multiple values. This is very similar to Resonite's Type system that has types such as [[Type:Float3|Float3]].
For example, an application might send a rotational value as a Multi-Dimensional value, when this occurs you can use the <code>ArgumentIndex</code> to control which value you are interacting with:
{| class="wikitable"
|-
! Path !! Argument Index !! Value !! Description
|-
| /osc/rotation || 0 || 90 ||The Pitch value of a rotation
|-
| /osc/rotation || 1 || 180 ||The Yaw value of a rotation
|-
| /osc/rotation || 2 || 0 ||The Roll value of a rotation
|}
The structure of OSC messages and data is up to the Sender, as such some applications or tools send this data in different ways.
== Tools ==
A number of tools that support OSC already exist and are compatible with Resonite's implementation:
* [https://play.google.com/store/apps/details?id=com.ffsmultimedia.osccontroller OSC Controller] - Control Sliders, Buttons etc on your phone and send the data via OSC
* [https://f-droid.org/en/packages/org.sensors2.osc/ Sensors2OSC] - Send Android Sensor data over OSC
* [https://github.com/Yellow-Dog-Man/Basic-OSC-Example Basic-OSC-Example] - A very simple OSC app written in C#. Used for testing OSC Connectivity.
* [[GigglePuck]] - A haptic device, that vibrates in response to Resonite based Interactions
* [https://github.com/Andymann/ofxOscMidi ofxOscMidi] - A program to receive MIDI messages from a source such as a hardware MIDI controller or software DAW and convert them to OSC messages which Resonite can understand. Can also receive OSC input from Resonite and send to MIDI output.


== Examples ==
== Examples ==
Line 36: Line 74:
** [https://youtu.be/l2RmJc9Ek_A Frooxius testing OSC Support]
** [https://youtu.be/l2RmJc9Ek_A Frooxius testing OSC Support]
** [https://www.youtube.com/watch?v=gvbZV_x9cak Tutorial by ProbablePrime]
** [https://www.youtube.com/watch?v=gvbZV_x9cak Tutorial by ProbablePrime]
[[Category:Features]]

Latest revision as of 03:54, 28 September 2024

OSC requires the use of third party applications to send/receive data beyond Resonite, please use your best judgement when downloading 3rd party applications.

Open Sound Control(OSC) is a network protocol that allows software and hardware to send and receive data. It is traditionally used for controlling Sound related equipment such as DJ Equipment, Musical Instruments and Sliders/Faders.

However, OSC itself can be used for basically any purpose where you need to send structured data over the network. In Resonite, we're seeing this used for:

  • Haptics
  • Face and Eye Tracking
  • Macro Pads/Shortcut pads

Prerequisities

While OSC makes it much easier to get data in and out of Resonite, it is still a network protocol which means that there are some prerequisites:

  • Basic knowledge about IP Addresses and Network Ports.
  • For receiving:
    • An open port on the computer running Resonite.
    • The IP Address of the computer running Resonite.
  • For sending:
    • An OSC Server reachable by Resonite on the network
  • Some sort of OSC Application/Tool. See tools for some examples.
Resonite will port collide (In other words: Take ownership of the port number given) with other applications when using OSC, make sure to pick a port you are not using.

Components

OSC has the following Resonite Components:

Data

OSC Supports many data types, but Resonite supports:

  • Float
  • Double
  • Int
  • Long
  • String
  • Color
  • ColorX (Will convert to sRGB)
  • DateTime
  • Byte

Many OSC Applications send data purely as Floats.

Multi-Dimensional Values

OSC Supports values which have multiple values. This is very similar to Resonite's Type system that has types such as Float3.

For example, an application might send a rotational value as a Multi-Dimensional value, when this occurs you can use the ArgumentIndex to control which value you are interacting with:

Path Argument Index Value Description
/osc/rotation 0 90 The Pitch value of a rotation
/osc/rotation 1 180 The Yaw value of a rotation
/osc/rotation 2 0 The Roll value of a rotation

The structure of OSC messages and data is up to the Sender, as such some applications or tools send this data in different ways.

Tools

A number of tools that support OSC already exist and are compatible with Resonite's implementation:

  • OSC Controller - Control Sliders, Buttons etc on your phone and send the data via OSC
  • Sensors2OSC - Send Android Sensor data over OSC
  • Basic-OSC-Example - A very simple OSC app written in C#. Used for testing OSC Connectivity.
  • GigglePuck - A haptic device, that vibrates in response to Resonite based Interactions
  • ofxOscMidi - A program to receive MIDI messages from a source such as a hardware MIDI controller or software DAW and convert them to OSC messages which Resonite can understand. Can also receive OSC input from Resonite and send to MIDI output.

Examples