ifm-osc-vrc

Connect between iFacialMocap and VRChat via OSC

https://twitter.com/0b5vr/status/1494808098649030656

⚠ This sucks. I just made for myself. Expect nothing.

Prerequisite

• iPhone or iPad
  • with ARKit face tracking capability
• iFacialMocap
• PC
  • which can emit and receive UDP
• Node.js
  • and yarn (npm i -g yarn)
• An avatar with Perfect Sync capability
  • Sample VRM Model by hinzka
  • Unity blend shape names must be in camelCase format e.g. browDownLeft

Converting VRM

• I recommend VRoid Studio and HANA_Tool combo
• VRM files can be imported into Unity using UniVRM
• and imported VRM can be converted for VRChat uses using VRM Converter for VRChat
  • Don't forget to install VRChat SDK in prior of course

Usage

ifm-osc (Node.js side)

cd ifm-osc
yarn
node index.js

This is completely unrelated but there are also websocket.js and you can test it on my Glitch project

osc-vrc (Unity side)

• Put osc-vrc/Assets/0b5vr/Editor/Scripts/SetupPerfectSync.cs into your Unity project
• Select 0b5vr/Setup PerfectSync Animator from menu bar (the very top of your Unity Editor window)
• Set appropriate values for each fields and click "LFG"
• Expect nothing
• If it goes smooth by any chance, copy the JSON and paste into your OSC config file
• Upload your avatar and test on VRChat

License

MIT