Orbbec Femto Bolt Initialization Error - Nuitrack 0.38.1

Hi @Stepan.Reuk, following on from the prior Orbbec conversation.

On 0.38.1 when I start the “Try Nuitrack” demo with the Femto Bolt selected, the window loads for a few seconds, I see the red IR(?) sensor activate on the camera, the window goes grey for a few seconds, then crashes with the following:

------------------
Starting test...
    3D sensor serial number: 
    3D sensor provider name: OrbbecSDKDepthProvider
Test failure!
NuitrackException (TerminateException): Device returned timestamps of frames with diff more 500ms
------------------

The firmware version is 1.1.2 which seems to be the latest.
The Orbbec Viewer works well, I’m using SDK Version 1.10.18.

Hope this is helpful, I’ll be available for more troubleshooting!

Hi @AC_TK,

We apologize for this inconvenience. This is a known issue and we are working on a fix.
As a workaround, please set this option to “nuitrack”.

Did this solve your problem?

Hi @vadim.bazhin, updating the nuitrack.config file works for the Nuitrack demo app.

However, I have these errors in the UE5 sample projects:

LogTemp: Error: No connected sensors detected. Connect the sensor!
LogTemp: Error: Nuitrack Start Fail!
LogTemp: Error: 1.Is Nuitrack installed at all?
LogTemp: Error: 2.If Nuitrack is already installed, then try to install to the 0.38.1 version (https://github.com/3DiVi/nuitrack-sdk/releases/tag/v0.38.1)
LogTemp: Error: 3.To use Nuitrack, you need activate AI Subscription. https://nuitrack.com/#pricing (Perpetual and Trial are not supported in UE)
LogTemp: Error: 4.Sensor connected? Is the connection stable? Are the wires okay? If you use RealSense, then USB 3.0 is required for it to work. If the sensor is connected and you see this error, then check the sensor, the wire and the USB ports.
LogTemp: Error: 5.Try restart PC
LogTemp: Error: 6.Check your Environment Variables in Windows settings.
LogTemp: Error: There should be two variables "NUITRACK_HOME" with a path to "Nuitrack\nuitrack\nutrack" and a "Path" with a path to NUITRACK_HOME\bin 
LogTemp: Error: Maybe the installation probably did not complete correctly, in this case, look Troubleshooting Page. https://github.com/3DiVi/nuitrack-sdk/tree/master/doc
LogTemp: Error: 7. Check the read\write permissions for the folder where Nuitrack Runtime is installed, as well as for all subfolders and files. Can you create text-file in NUITRACK_HOME\middleware folder? Try allow Full controll permissions for Users.

So it seems that the UE5 Fab plugin is still in need of an update to work with 0.38.2, is this correct?

Hi @AC_TK,

Please try to use the latest Nuitrack version with the latest UE5 plugin version, it should work.
Does it help?

Thanks @vadim.bazhin, I took the following steps and it now works, but the tracking has a low FPS.

  1. Uninstall Nuitrack for a fresh install of 0.38.2
  2. Remove the Nuitrack plugin from UE 5.4 and re-import to library.
  3. Create a new blank project and enable the Nuitrack plugin.
  4. Re-enter the Activation Key for the Bolt (this was most likely my issue before)
  5. Test with the SkeletonJoints sample level.

In the SkeletonJoints example, the two depth panels and the skeleton itself run at a significant delay of over one second with a noticeably low FPS. The central RGB display has only a slight delay and runs smoothly. The game window was central and active in the tests.

This PC has high specs with a 4090 GPU, i9-12900K CPU, 64GB RAM, on Windows 11. The RealSense D435i ran well, aside from the sensor being weaker than the Orbbec.

Hope this helps in troubleshooting!

Hi @AC_TK,

Could you please test Nuitrack.exe, is there the same behavior? Or it happen only into UE?

Dear @AC_TK ,

Hope you’re doing well. Please let me know if this issue is still relevant for you.
Thanks.