Skeleton based on Depth Sensor only

Hello. I am new to Nuitracker. I have a trial version.

Is it possible to get skeleton data and use skeleton tracking module if RGB sensor is disabled? The idea is that I would like to track skeleton in the low lighting conditions, where data from the RGB sensor is unreliable.

Best,
Anton.

You can use a 3D sensor in the dark if it has an infrared sensor.
You can disable the RGB stream by changing the nuitrack.config file:

Open %NUITRACK_HOME%/data/nuitrack.config in a text editor;
In the “DepthProvider” section, find the “RGB” parameter and set it to “Off”.

Some parameters, such as DepthProvider.RGB, can be overridden using the Nuitrack :: setConfigValue function immediately after Nuitrack :: init (). For example:

...
Nuitrack::init();
Nuitrack::setConfigValue("DepthProvider.RGB", "Off");
...

I’ve been trying it out with the RealSense D435 and running into issues as well.
The moment I disable the RGB stream via the nuitrack.config skeletal tracking stops working completely.

I was hoping to rely purely on the depth stream, especially for dark environments, but tracking seems to fail entirely if I turn off the lights. From what I understand, the D435 uses an active IR projector for depth sensing, so it should work in the dark.

Has anyone actually gotten skeletal tracking to work purely with depth data on a RealSense D435? If so, would love to know what configuration or steps you used to get it working.

Hi @EdiciusPenguin, sorry for processing delay.
We could say for sure that Nuitrack previous versions didn’t require RGB for a classical engine, but being a rare demand this isn’t controlled on a regular basis (as basically all modern sensors has RGB sensor in addition to a Depth sensor), so could be artificially bound to a RGB stream (basically broken),
but essentially classical engine still doesn’t use it anyhow (so it shouldn’t be the issue in the dark, if depth data is still presented).

  • If you principally have to disable an RGB stream - you could try some of the older versions.
  • If disabling RGB stream isn’t what you really need and you just wanted to make it work in a darkness - please make a few screenshots of latest NuitrackViewer in these conditions and contact us directly at support-nuitrack@3divi.com