[Feature Request] Nuitrack and touchdesigner

Hi @TAG,

Not the OP, but would love to see this implemented into touchdesigner as well.

  • what was the inspiration/source of idea to use Nuitrack with TouchDesigner ?
    There is currently no way for the Intel Realsense to do skeletal tracking in touchdesigner as Intel dropped the cubmos sdk a couple of months ago.

  • what the primary use-cases for such combination?
    Interactive installations, art, etc.

Thank you and I hope this can be implemented very soon as I know a number of artists and designers are incredibly frustrated by the lack of skeletal tracking for the realsense in TouchDesigner.

2 Likes

Also not the OP, but I would also love to see TouchDesigner integration.

  • Inspiration
    Currently there are two primary means of skeletal tracking in the interactive art/attraction space right now, Kinect (which is heavily bottlenecked by sensor production, but has good yet limited body tracking integrated in TD), and sensors supported by Nuitrack (sensors are more widely produced and available, tracking is supreme, but no TD integration)
  • Primary use case:
    Immersive / interactive art museums and other attractions are a booming industry despite the pandemic. As a studio I would happily license 10+ clients per year, most with multiple sensors/machines, and I know plenty of others who are looking to do the same.

Please support TouchDesigner asap.

Hi all, thank you for all the thoughtful insights on TouchDesigner support (any additional ones would be also appreciated).

TouchDesigner is planned for the next two quarters (but as usually could be shifted by a paid customization projects).
If you have some urgent need in this integration and specific volume demand - please let us know (by messaging tag@3divi.com directly).

2 Likes

Hello
I’m also interested in a TouchDesigner for Nuitrack. Hope it will be soon released :slight_smile:

1 Like

Hi,
Interested in touchdesigner integration. That could bring body tracking other than kinect.
Thanks

1 Like

Checking back on this and adding my +1. Would love to have skeletal tracking with RealSense in Touchdesigner. It seems the range and accuracy of the RealSense is better perhaps than Kinect?
For use in Immersive Interactive art performance.
Looking forward to this!

2 Likes

@TAG

Any update on TouchDesigner integration?

Hi there,
We’re at a final stage of releasing first revision of TouchDesigner integration and have a special proposal for early adopters.
It’s important for us to get familiar with TouchDesigner users, so we prepared a short feedback form - you are welcome to fill it by the link. We’ll be sending a release candidate to try it out and free Nuitrack licenses (for TouchDesigner) to the most informative responders.

3 Likes

fyi @anna, @Kalm, @JoshuahJest, @icall, @thierry, @Michae, @JoshuahJest

Hi @here, thank for those who sent a feedback through our survey form.

We urge those interested who haven’t done it yet to do that, as the amount of “traction” and useful insights greatly impacts the future of Nuitrack plugin for Touch Designer.

Image20230620161250

Hi @here!
This is the Nuitrack Team, we are excited to announce the :rocket:beta testing of the Nuitrack Skeleton Tracking plugin for TouchDesigner.
If you’re interested in Skeleton Tracking :man_dancing: with Orbbec, RealSense or Kinect sensors (v1, v2, Azure) :movie_camera:, you’re welcome to try out package :package:

Thank You! That is a lifesaver, I bought a realsense D354 cam for an interactive exhibition I just find out that there is no more skeleton tracking SDK available online. Wow, such a good moment to release this plugin with an integration to TD!
Is there any plans to integrate AI object detection and facial expression data to Touchdesigner Plugin as well? That would be awesome, imagine interactive and immersive art exhibition where visuals are generated based on people belonings and clothes! That will be sick! :star_struck:

1 Like

Hello guys, I want to test out this TD integration of Nuitrack for Realsesne. Can you please help me figure out how to get my hands on this and do a trial? I downloaded the available version I found through TD Forum, but unfortunately, that didn’t work out.

Please help!

Hello @Nayan

Please download the latest version from our github.

Thank you for your reply @irakli. I am running into the same error even with the git hub chop file as I did with the previous ones.

I tried opening your sample .toe file and I am getting this error (check the attached image)

Please help me figure out whats going wrong.
.

  1. Have you deleted the previous plugin?
  2. Have you installed the latest version of Nuitrack?

Keep in mind that the plugin only works with an annual subscription.

Hello @anna

My suggestion is Yes, you can link Nutriak to TouchDesigner using the SDK samples. Capture the gesture data and send it to TouchDesigner via OSC or MIDI. You can check Nutriak SDK for examples & set up TouchDesigner to receive the data. :slightly_smiling_face:

Hello @Melissa, thank you for bringing up these options (as we at Nuitrack haven’t had a firsthand experience with the OSC yet).
As we now have an official Nuitrack plugin for Touch Designer (so you just have to import a plugin) - are there any benefits with OSC / MIDI approach ?

The benefits of using OSC/MIDI could be Integrates with more software and hardware & Allows for specific use cases & seamlessly works with existing MIDI setups :slightly_smiling_face: