Best depth camera to work with Nuitrack and Unreal Engine?

Nuitrack SDK Unreal Engine
1

Hello all,

I am working on an interactive art installation that will use full body / hand tracking to manipulate the Unreal Engine built .exe file projected on a wall. I typically work with Blueprints in UE and have experience with livelink for face tracking with regular cameras. I imagine real time body/hand tracking should be similar with nuitrack and depth camera. I would like to use nuitrack with Blueprints and want to make a good choice on the camera(s) that would work most reliably with my software & display setup.

The work needs to let visitors manipulate projected scene (and objects in it) through different gestures ( arms / hands) and general body motion. ( moving objects around, activating sound, changing materials etc)

I am planning to use a three-projector setup with ~30 ft length of the combined projectors.

What would be your recommendation for the camera best suitable for this task?

Should I use a single camera for this?

What are the considerations I should be aware of?

Thank you very much, any input is very appreciated.

2

Hello @alin

It’s quite an interesting case, it’s hard to say exactly how to do it best in your case.

As for the camera, we usually recommend sensors with the appropriate label in this table (realsense does not have the best quality for these purposes) Notion

Also consider the recommendations from here nuitrack-sdk/doc/General_preparations.md at master · 3DiVi/nuitrack-sdk · GitHub . I think the main thing to consider is the tracking range of 2-4 meters