Nuitrack Avatar Mannequin Head Joint Broken

The latest information about custom models is here:

https://community.nuitrack.com/t/unreal-engine-custom-models/4136/2

It describes in general terms how animation works in a custom model (in fact, in the worst case, you need to change the names of the bones of the model in two files BP and AnimBP). The plugin also has several models (not a metahuman) for self-study.

But for now, it’s recommended to just use Epic Skeleton (as in metahuman). Then all models adhere to the same system and the process of replacing them becomes very simple.

How do I get the head to move

What is meant by “move"? The head should follow the rest of the body by itself. And if you want to add a rotation, you need to use face tracking. By the way, you haven’t answered the question. “Is there the same problem at the Metahuman level in the new project?”

Also, I am using a custom built face tracker, but I should I use your guys instead for head movement?

Depending on your requirements. Now Nuitrack face tracking is a set of face points, and face rotation (pitch, roll, yaw) (as well as age and mood) in json format. And it only works if the person is standing in front of the camera and the skeleton tracking has started.

To do this, enable face tracking in C:\Program Files\Nuitrack\nuitrack\nuitrack\data\nuitrack.config Faces → “ToUse”: true.

And use this node to get the values