Hi, how to convert emoca expression latent code to AppleARKit 52 blendshapes?

[lucasjinreal]

Hi, how to convert emoca expression latent code to AppleARKit 52 blendshapes?

[radekd91]

Hi, I have never used AppleARKit so I don't know what their blendshapes are exactly but if they are a standard 3DMM, I'm afraid there's no easy way to do it. Their mesh will have a different topology. You would have to predict the FLAME mesh with EMOCA and then fit your AppleARKit model into it.

[lucasjinreal]

@radekd91 thanks for replying. The main reason for I asking this, is because actually in industrial, there are many 3d models using apple standared as blendhsapes, so, if emoca can predict 3dmm from single rgb image, it can be used to driven the 3d model directly.

Currently, do u think is there a possible way to do it if I have a apple 52 blendshapes based model already?

[radekd91]

It is possible. You if you have both blendshapes available, you can of course fit it to a mesh that is an output of the other. The fitting itself is a non-trivial process but is of course possible.

[Daksitha]

Hi @jinfagang, did you find a way to achieve this by converting FLAME (3DMM) to AppleARKit 52? Thanks

[semchan]

hi，did you find the way to achieve this? thanks a lot.

[lucasjinreal]

no