How to Make Costume Follow User Movement in Nuitrack SDK + Unity

Hi everyone,

I am currently working on an R&D project for a virtual fitting room using Nuitrack SDK and Unity. I’ve successfully implemented the virtual fitting room, but I need help with one more feature.

How can I make the costume follow the user’s movements when they turn left, right, front, and back? Is this possible with Nuitrack SDK? If so, how can it be achieved?

Any guidance or suggestions would be greatly appreciated.

Thank you!

Hello @amalin

Could you send me a video of what the problem is?
The “classic mode” of tracking is focused on working with a person in a frontal pose, small turns also work well
The “AI mode” allows you to make large turns (even 360 degrees), but it does not always work well with 3D tracking (you can try, check the AI on the NuitrackManager component)

Virtual Fitting Room

I’ve added a costume with rigging, but I’m facing an issue where the costume doesn’t match correctly on the user’s body.

Additionally, when the user turns around, the costume doesn’t follow their movement properly. I’ve attached a screen recording of my project to better illustrate the problem.

Does anyone know how to fix this issue? Any help or guidance would be greatly appreciated.

Thanks!

Maybe that’s the problem. Try to set your avatar positiom in 0,0,0

Updated Virtual Fitting Room Repositioning

This is the updated video. I’ve set the avatar position to (0,0,0). But when I set the scale to1.0, the body looks small. Also, why isn’t the costume sticking to the body? It looks like it’s floating instead of fitting properly, not like the avatar is actually wearing it. Plus, it doesn’t follow the user’s size. How can I make the costume fit the body properly and adjust to the user’s size? Can you help? Thank you.

It is more convenient to check the models in the Fitting Room Tool
There are recommendations in the Readme
image

You can increase or decrease model size, this is normal, it’s better to focus closer to the size in the real world (the main thing is not to change the size of the individual bones inside, they should be 1.1.1). Perhaps the model is not too well attached to the bones. Try enabling skeleton mapping in the Fitting Room Tool to understand exactly where Nuitrack joints (and, accordingly, the bones of the model) are currently located. Also, if you are using Nuitrack Avatar, the Alignment Body Length option must be enabled.