Component:VisemeAnalyzer: Difference between revisions

From Resonite Wiki
← Older edit
Visual
Add some info. Not ready to tackle this rn
add see also
 
(One intermediate revision by the same user not shown)
Line 3: Line 3:
|Name=Viseme Analyzer
|Name=Viseme Analyzer
}}
}}
The '''VisemeAnalyzer''' can be used to analyze the sounds from a user's voice, a video, an audio clip player, or any other sound source. The component does analyzing of audio to discern Viseme sounds. For more info on what Visemes are, which is outside the scope of this wiki page please see [https://en.m.wikipedia.org/wiki/Viseme Wikipedia on Visemes]
The '''VisemeAnalyzer''' can be used to analyze the sounds from a user's voice, a video, an audio clip player, or any other sound source. The component does analyzing of audio to discern Viseme sounds.  


== Fields ==
== Fields ==
{{Table ComponentFields
{{Table ComponentFields
|Source|IAudioSource|
|Source|IAudioSource| The audio source to analyze the audio and extract live viseme data for.
|RemoteSource|'''[[Type:MultiValueStream`1|MultiValueStream`1]]<[[Type:Float|Float]]>'''|TypeAdv1=true|
|RemoteSource|'''[[Type:MultiValueStream`1|MultiValueStream`1]]<[[Type:Float|Float]]>'''|TypeAdv1=true| An alternative source of raw data for viseme data.
|Smoothing|Float|
|Smoothing|Float| How much to smooth lerp all the outputs.
|Silence|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv3=true|
|Silence|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv3=true| How quiet the audio is in general.
|PP|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv4=true|  
|PP|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv4=true| Outputs the amount that the source audio is making a "Puh" sound.
|FF|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv5=true|
|FF|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv5=true| Outputs the amount that the source audio is making a "efff" sound.
|TH|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv6=true|
|TH|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv6=true|Outputs the amount that the source audio is making a "thuh" sound.
|DD|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv7=true|
|DD|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv7=true|Outputs the amount that the source audio is making a "deh" or "duh" sound.
|kk|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv8=true|
|kk|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv8=true|Outputs the amount that the source audio is making a "kay" sound.
|CH|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv9=true|
|CH|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv9=true|Outputs the amount that the source audio is making a "cuh" sound.
|SS|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv10=true|
|SS|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv10=true|Outputs the amount that the source audio is making a "ess" sound.
|nn|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv11=true|
|nn|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv11=true|Outputs the amount that the source audio is making a "enm" sound.
|RR|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv12=true|
|RR|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv12=true|Outputs the amount that the source audio is making a "erh" sound.
|aa|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv13=true|
|aa|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv13=true|Outputs the amount that the source audio is making a "ah" sound.
|E|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv14=true|
|E|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv14=true|Outputs the amount that the source audio is making a "eee" sound.
|ih|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv15=true|
|ih|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv15=true|Outputs the amount that the source audio is making a "eh" sound.
|oh|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv16=true|
|oh|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv16=true|Outputs the amount that the source audio is making a "oah" sound.
|ou|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv17=true|
|ou|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv17=true|Outputs the amount that the source audio is making a "ooh" sound.
|LaughterProbability|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv18=true|
|LaughterProbability|{{RootFieldType|RawOutput`1|[[Type:Float|Float]]}}|TypeAdv18=true| How likely it is that the audio source is playing laughter sounds.
}}
}}
[[Category:ComponentStubs]]
 
== Usage ==
This should not need to be used directly by the user.
 
== Examples ==
{{stub}}
 
== See Also ==
* [[Component:DirectVisemeDriver]]
* [[Visemes]]
* [https://en.m.wikipedia.org/wiki/Viseme Wikipedia on Visemes]
 
[[Category:Components{{#translation:}}|Viseme Analyzer]]
[[Category:Components{{#translation:}}|Viseme Analyzer]]
[[Category:Components:Media:Utility{{#translation:}}|Viseme Analyzer]]
[[Category:Components:Media:Utility{{#translation:}}|Viseme Analyzer]]

Latest revision as of 23:21, 12 January 2025

Component image 
File:VisemeAnalyzerComponent.png
Viseme Analyzer component as seen in the Scene Inspector

The VisemeAnalyzer can be used to analyze the sounds from a user's voice, a video, an audio clip player, or any other sound source. The component does analyzing of audio to discern Viseme sounds.

Fields

Fields
Name Type Description
persistent Bool Determines whether or not this item will be saved to the server.
UpdateOrder Int Controls the order in which this component is updated.
Enabled Bool Controls whether or not this component is enabled. Some components stop their functionality when this field is disabled, but some don't.
Source IAudioSource The audio source to analyze the audio and extract live viseme data for.
RemoteSource MultiValueStream`1<Float> An alternative source of raw data for viseme data.
Smoothing Float How much to smooth lerp all the outputs.
Silence raw output of Float How quiet the audio is in general.
PP raw output of Float Outputs the amount that the source audio is making a "Puh" sound.
FF raw output of Float Outputs the amount that the source audio is making a "efff" sound.
TH raw output of Float Outputs the amount that the source audio is making a "thuh" sound.
DD raw output of Float Outputs the amount that the source audio is making a "deh" or "duh" sound.
kk raw output of Float Outputs the amount that the source audio is making a "kay" sound.
CH raw output of Float Outputs the amount that the source audio is making a "cuh" sound.
SS raw output of Float Outputs the amount that the source audio is making a "ess" sound.
nn raw output of Float Outputs the amount that the source audio is making a "enm" sound.
RR raw output of Float Outputs the amount that the source audio is making a "erh" sound.
aa raw output of Float Outputs the amount that the source audio is making a "ah" sound.
E raw output of Float Outputs the amount that the source audio is making a "eee" sound.
ih raw output of Float Outputs the amount that the source audio is making a "eh" sound.
oh raw output of Float Outputs the amount that the source audio is making a "oah" sound.
ou raw output of Float Outputs the amount that the source audio is making a "ooh" sound.
LaughterProbability raw output of Float How likely it is that the audio source is playing laughter sounds.

Usage

This should not need to be used directly by the user.

Examples

This article or section is a Stub. You can help the Resonite Wiki by expanding it.

See Also

Retrieved from "https://wiki.resonite.com/index.php?title=Component:VisemeAnalyzer&oldid=94338"