Animated Emoji scene [inProgress]

Nuitrack SDK Unity3D
1

IndexOutOfRangeException: Index was outside the bounds of the array.
NuitrackSDK.Tutorials.FaceTracker.BlendshapeWeights.getJawOpenYRatio (UnityEngine.Vector2[] points) (at Assets/NuitrackSDK/Tutorials/FaceTracker/BlendshapeWeights.cs:118)
NuitrackSDK.Tutorials.FaceTracker.BlendshapeWeights.GetJawOpen (nuitrack.Face face) (at Assets/NuitrackSDK/Tutorials/FaceTracker/BlendshapeWeights.cs:22)
NuitrackSDK.Tutorials.AnimatedEmoji.FaceAnimController.UpdateFace (nuitrack.Face face, NuitrackSDK.UserData+SkeletonData+Joint headJoint) (at Assets/NuitrackSDK/Tutorials/Animated Emoji/Final Assets/Scripts/FaceAnimController.cs:60)
NuitrackSDK.Tutorials.AnimatedEmoji.FaceAnimManager.Update () (at Assets/NuitrackSDK/Tutorials/Animated Emoji/Final Assets/Scripts/FaceAnimManager.cs:45)

Face detection (face landmark) is limited to 21 points, but the BlendshapeWeights script is waiting for 31 points, which gives the error IndexOutOfRangeException. Is there a solution to this problem ?

2

Hello @xxx
Try this script: Dropbox - BlendshapeWeights.cs - Simplify your life
Or this unity package (beta): Dropbox - NuitrackSDKBeta.unitypackage - Simplify your life

3

What is the method to modify facial feature points to 31 points

4

Face detection (facial landmark) waiting for 21 points is not very effective for blinking. Is there any way to modify it to waiting for 31 points

5

I think then it’s better to try on an older version of nuitrack and unity package, for example 0.35.15
https://github.com/3DiVi/nuitrack-sdk/tree/v0.35.15

6

Thank you, but version 0.35.15 of tbb.dll cannot be downloaded. Is there any solution

7

Thank you, but version 0.35.15 of tbb.dll cannot be downloaded. Is there any solution

8

@xxx
Hmm… Try Nuitrack 0.35.15 with this version of the package, there are no problems with tbb.dll ?
https://github.com/3DiVi/nuitrack-sdk/blob/master/Unity3D/NuitrackSDK.unitypackage

9

Hello @xxx
Has your problem been solved?

10

No, the effect is not particularly good

11

@xxx Do you mean a problem with tbb or the accuracy of face tracking?

13

Mainly due to the inability to blink

14

Mainly due to the inability to blink，Single blink action

15

Unfortunately, Nuitrack is not very good at tracking blinks.