Sensor for small distances (Case Study)

Hi there,

I’m working on a skeletal tracking project. The use case is a large (80" +) portrait touchscreen with skeletal tracking of a user interacting with it. I only need the skeletal data for the waist upwards.

Previously I’ve used Mediapipe with a wide FOV webcam - this works nicely but the tracking is less robust than I’d like.

I’ve been experimenting with Nuitrack and an Orbbec Astra+ both in landscape and portrait orientation. When the user is sufficiently in frame, the tracking is fantastic, I’m really happy with it. However, it sort of starts to fail when the user is closer to the screen - this is expected, as the camera can’t see enough of them. It’s sort-of-usable - with a screen that size, users don’t want to be too close anyway - but I’m wondering if using a camera with a wider FOV will help here.

The Persee 2 and Femto Bolt seem to have the widest FOV out of the supported sensors - has anyone got any experience using these cameras at a distance of around 0.75cm - 1m? I’m fully prepared to accept that this is too small a distance for the sensor tech/Nuitrack to operate under, but clients being clients, you show them it working at 1 metre and they want it working at 90cm!

Any help much appreciated,

Thanks!
Matt

Hi @msct,

We will test these sensors in the environment you describe and get back to you with the results.
Thanks.

Hi @msct,

We have done several tests with Nuitrack on the sensors you mentioned at close range (1-0.75 meters). And we got the following results:

  1. Orbbec Gemini 2L (Persee 2 has this sensor inside) | Depth FOV: H91° V66°
  2. Orbbev Femto Bolt | Depth FOV: 640X576@30fps (NFOV)
  3. Orbbev Femto Bolt | Depth FOV: 1024X1024@15fps (WFOV)
    • Due to the larger viewing angle, it should work better than Gemini 2L at close range, but currently there are problems with tracking in this mode due to the non-standard frame resolution (will be fixed in the near future).

Thus, at the moment, the Gemini 2L sensor is the best choice for close range.
Is there anything else we can help you with?

1 Like