Unstable and jittery skeleton tracking in Unreal Engine with Nuitrack AI (Kinect v2)

Nuitrack SDK Unreal Engine
1

Hello,
I’m using Nuitrack AI with Kinect v2 inside Unreal Engine, and I’m facing a persistent issue with the skeleton tracking quality. The movements are jittery, unstable, and delayed, even when the environment and lighting conditions are optimal.

To illustrate the problem, I’ve attached:

  • a file recorded directly from Unreal Engine showing the tracking in real time,

  • and a recording file from the Nuitrack application, showing how the same movement looks smoother there.

This suggests that the issue is related not to the sensor itself, but to how Nuitrack data is processed or streamed into Unreal Engine.

System setup:

  • Sensor: Kinect v2

  • Nuitrack version: 0.38.5

  • Unreal Engine version: 5.6

  • OS: Windows 11

  • Connection: USB 3.0 (verified via Kinect Configuration Verifier)

Problem details:

  • Skeleton data in Unreal Engine is jerky, with visible delays and micro-shaking of joints.

  • Sometimes tracking “jumps” or freezes for a few frames, then catches up.

  • Nuitrack standalone app shows much smoother skeleton motion under the same conditions.

  • I’ve tried different USB ports and recalibration - the issue persists.

Questions:

  1. Is there a recommended way to synchronize or filter skeleton data in Unreal to reduce jitter?

  2. Should I modify the nuitrack.config file?

  3. Is this behavior related to the AI mode in Nuitrack, or a known issue with the Unreal plugin?

  4. Are there specific parameters for smoothing, latency, or frame interpolation that can be adjusted?

Check please! Any suggestions or configuration examples would be greatly appreciated.
Thank you in advance for your help!

2

Hello @potapova.xenya
The video shows how to use nuitrack.exe and ue5 simultaneously, but you shouldn’t do this as it can cause undefined issues.
As for the other issues/questions, we will look at your dump and get back to you soon.

1 Like
3

We recorded a short video using two programs just to clearly demonstrate the problem. During testing, we only use Unreal Engine itself, but the problem still persists.
The movements remain jerky and unstable across all Sample Levels.

Increasing the Smooth Move value only makes the situation worse :frowning:

We also experienced project crashes earlier, but those were resolved after switching the build configuration to Platform → Windows → Shipping.

We’re looking forward to your feedback on how to fix the issue with jittery and torn motion.
If any additional information is needed, I’m always available and happy to provide it.

Waiting for updates! Thank you in advance!