Skeleton Reset data option

Hello,

We’re developing a game using your software, and planning to deploy it at various retail locations.

We’ve been using Orbbec persee G1 cameras for development on Unity with descent skeletal tracking results, but often hand tracking (raising hand, waving etc) gestures seem to glitchy at best, sometimes overly sensitive, sometimes not sensitive at all.

I would like to know if this might be a camera or software issue.
Other issue is with the restart mechanism.
During Restart process, if the user leaves the perimeter/range created by camera then the camera locks the skeleton in a position where it was left and runs the application in loop until a new user is detected by camera.
Is there any way to reset the skeleton data so that I can reset it during restart process and make sure that application doesn’t runs in a loop.

Thanks!

Hi @JawadJD,

but often hand tracking (raising hand, waving etc) gestures seem to glitchy at best, sometimes overly sensitive, sometimes not sensitive at all

Are you using the latest version of Nuitrack? Is Linux or Android installed on your Orbbec persee?

During Restart process, if the user leaves the perimeter/range created by camera then the camera locks the skeleton in a position where it was left and runs the application in loop until a new user is detected by camera.

Does this happen only on Unity or in nuitrack_sample.exe too? (located in the %NUITRACK_HOME%\bin folder)
In which of our Unity scenes do you observe this behavior?

Looking forward to your response.

Are you using the latest version of Nuitrack? Is Linux or Android installed on your Orbbec persee?

  • No, I’m not using the latest version and Android is installed in Orbbec Persee.
    How do we upgrade it to the latest version bcoz I don’t see any option in the nuitrack app.

Does this happen only on Unity or in nuitrack_sample.exe too? (located in the %NUITRACK_HOME%\bin folder)
In which of our Unity scenes do you observe this behavior?

  • Yes only in unity.
  • Skeleton side view of the user has some glitch and it doesn’t produce skeleton data or any other frame data when wifi is connected

Hello @JawadJD

camera locks the skeleton in a position where it was left

try running the RGBandSkeletons scene (from this tutorial nuitrack-sdk/Unity_RGB_Skeletons.md at master · 3DiVi/nuitrack-sdk · GitHub). Does the skeleton get stuck there?

Hi @JawadJD,

Regarding the unexpected behavior of gestures, could you record the problem using NIViewer and send us this record? This will help us reproduce your issue on our side.

NiViewer you can download here.

Looking forward to your record.

Hi @JawadJD,

How are you? Has your issue been solved?
Would be great if you could provide some reply/feedback, we will be ready to help.
Thanks.

Hi @vadim.bazhin

Sorry for late reply.

We are working on it and will update you asap.

Hi @JawadJD,
Thank you, we will be waiting for updates from you.

Hi @vadim.bazhin

Sorry for the late reply.

Currently we are using 0.23 version of nuitrack in orbbec persee ( andriod version - 5.1)

Can we the reduce the range or the perimeter created by the camera and if possible we can increase the sensitivity of the camera.

will provide the video in 2 days

Hi @JawadJD,

Can you describe in a little more detail what you mean?

Thank you, we will wait for updates.

Hi @vadim.bazhin

Please provide your email address to pass on the video.

Maximum distance range to and from the camera. Can we decrease the x and y axis perimeter of the camera range so that it doesn’t accommodate multiple users in a single frame.

Skeleton tracking data doesn’t work when wifi is connected .

Hi @JawadJD,

Sorry for the delay.

Please provide your email address to pass on the video.

You can send the video to this email: vadim@3divi.com

Maximum distance range to and from the camera. Can we decrease the x and y axis perimeter of the camera range so that it doesn’t accommodate multiple users in a single frame.

You can reduce value in the parameter Skeletonization.MaxDistance (in the nuitrack.config file) to reduce the maximum detection distance. But filtering on the x and y axes is not implemented on our side.

Skeleton tracking data doesn’t work when wifi is connected .

Do you use TVico.apk or Nuitrack.apk on your persee?

Hi @JawadJD,

Sorry for the delay.

I got your email with the video (*.mov file and screenshot).
Could you record an *.oni file using NIViewer by setting (1) and starting recording using the button (2):

On this recording, we ask you to demonstrate the gestures with which you have problems in Nuitrack (just as you did them in Nuitrack).

Having an .oni file, we will be able to run it through Nuitrack on our side, as well as use it for tuning the algorithm (.mov/*.mp4 files are not suitable for this).

Thanks.

Dear @JawadJD,

Hope you’re doing well. Please let me know if this issue is still relevant for you.
Thanks.