Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shapekeys/Blendshape naming layout #91

Open
Dragonbutteth opened this issue Sep 24, 2024 · 4 comments
Open

Shapekeys/Blendshape naming layout #91

Dragonbutteth opened this issue Sep 24, 2024 · 4 comments

Comments

@Dragonbutteth
Copy link

Hi, I'm the Technical lead over at Cstud.io
We are a VRM Character creator and our VRM's 52 ARkit blendshapes do not register on your program. Can you make a public list of what names you call them. Just incase we have a "Basis"/"Neutral" issue or other naming issue causing them to not work.
I just want to rule out low level issues before I dig into the threejs exporter. Our VRMs work in Warudo/Vseeface. I was asked to look into this issue by our marketer from some feedback from a user.
Thank you.
PS
Also drop me a line @ techsupport@Cstud.io if you'd like to get sponsored for some stuff too. We love working with creators who have an in-depth knowledge of the Eco space

@ButzYung
Copy link
Owner

ButzYung commented Sep 24, 2024

@Dragonbutteth

  1. Load your VRM model on XR Animator and press START.
  2. Click the tray menu icon on Windows taskbar, click DevTools and the Console tab (on browser version, the equivalent is Developer Tools => Console).
  3. Enter MMD_SA.THREEX.get_model(0).model.expressionManager._expressionMap and let me know the expression name list of your model as read by XR Animator.

@Dragonbutteth
Copy link
Author

Genuinely doesn't recognize anything at all. Even the 7 basic AIEOU and Blink L/R don't work
{
"neutral": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "ddbca082-3191-4e64-8930-a67527ed3685",
"type": "VRMExpression",
"name": "VRMExpression_neutral",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"aa": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "9e9855bf-8148-417b-b506-53ffdd4a6aeb",
"type": "VRMExpression",
"name": "VRMExpression_aa",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"ih": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "37de930f-58a6-48c8-a5fb-c0748b257779",
"type": "VRMExpression",
"name": "VRMExpression_ih",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"ou": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "bcb03c53-9059-45e2-8355-6a507662ca89",
"type": "VRMExpression",
"name": "VRMExpression_ou",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"ee": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "a995640d-66fc-49b7-befd-2e252a832507",
"type": "VRMExpression",
"name": "VRMExpression_ee",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"oh": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "c81975c6-343a-42db-addc-486b7c31830e",
"type": "VRMExpression",
"name": "VRMExpression_oh",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"blink": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "b61a883e-878a-4a73-b2bc-ca74308fea9f",
"type": "VRMExpression",
"name": "VRMExpression_blink",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"happy": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "f3daed92-3257-4594-96d6-bd0d01db5119",
"type": "VRMExpression",
"name": "VRMExpression_happy",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"angry": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "afebfecc-56e8-4cfe-85b1-0eb0186ea342",
"type": "VRMExpression",
"name": "VRMExpression_angry",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"sad": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "ea662387-f052-40bd-99d6-e736be7df954",
"type": "VRMExpression",
"name": "VRMExpression_sad",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"relaxed": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "edd91895-25c1-4952-b54c-f7bc08dd206a",
"type": "VRMExpression",
"name": "VRMExpression_relaxed",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"blinkLeft": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "c45263b4-54b5-4874-838c-0c82743f274c",
"type": "VRMExpression",
"name": "VRMExpression_blinkLeft",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
},
"blinkRight": {
"metadata": {
"version": 4.6,
"type": "Object",
"generator": "Object3D.toJSON"
},
"object": {
"uuid": "3838e7d2-06f8-439d-b1be-573744795108",
"type": "VRMExpression",
"name": "VRMExpression_blinkRight",
"visible": false,
"frustumCulled": false,
"layers": 5,
"matrix": [
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1,
0,
0,
0,
0,
1
],
"up": [
0,
1,
0
]
}
}
}

@ButzYung
Copy link
Owner

So it seems for some unknown reasons the ARKit blendshapes are not there. I guess this may be some VRM exporting issues, but I am not familiar with making VRM models or using VRoid so I am not sure. You can go to the Console agin, enter MMD_SA.THREEX.get_model(0).model (this is basically the VRM model object) and see if you may get any hint there.

XR Animator uses the official three-vrm plugin to read VRM model. If you can't solve the problem on your side, you can raise an issue there and see if they can help.

@Dragonbutteth
Copy link
Author

TY, We have a similar issue with Vroid Hub and I wondered if this might ne the central issue. TY for your time

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants