Hello, I’ve got this strange issue whenever I turn on AI Mode in UE 5.4. I’m running ORBBEC Femto Bolt with subscription license. It works well in Nuitrack demo but completely turn wonky when running in UE 5.4. The skeletal mesh is not following the bones (seems like going opposite direction) and the bones also moving very strangely sometimes (very wonky movement and some of the bones are disappearing and appearing repeatedly). It will also think there’s a second person sometimes and show a second skeleton even though I’m only one person in the room… I guess? (don’t scare me XD)
Hello @Virion
Sorry for the long reply
At the moment, AI tracking in the plugin is under active development, so in some cases it may work worse than the “Classical” mode. Could you please send a video so that our team can better understand your case.
And also fill out this short form, it will greatly help in the development of the plugin. https://docs.google.com/forms/d/1_V4iSpwwOQxC6sHEyPenIj7j0uFGU4zjsHW1J4ChP2g/viewform?edit_requested=true
I did some tests on both Unity 2022 and UE 5.4
Device: Femto Bolt
UE version: 5.4
Mirror: enabled
Remark: A bit slow/laggy because of recording. It has the same issue when running smooth.
Video 1: https://youtu.be/xmaIsDltrgM (AI: enabled)
Video 2: https://youtu.be/tDs1jtRtveE (AI: disabled)
Device: Femto Bolt
Unity version: 2022.3.42f1
Mirror: N/A
AI: enabled
Remark: The hands are always jumping around, the other body parts are doing OK
Video 1: https://youtu.be/A-uzexKEbkY
Everything looks fine on Nuitrack demo, just doesn’t translate well into the game engines.
Hello @Virion
Thank you for recording the video
In the current version of AI mode is not very suitable for 3D, it is better to use the “Classical” (default) mode for this. Ai is better suited for 2D