Hi everyone,
I am currently working on an R&D project for a virtual fitting room using Nuitrack SDK and Unity. I’ve successfully implemented the virtual fitting room, but I need help with one more feature.
How can I make the costume follow the user’s movements when they turn left, right, front, and back? Is this possible with Nuitrack SDK? If so, how can it be achieved?
Any guidance or suggestions would be greatly appreciated.
Thank you!
Hello @amalin
Could you send me a video of what the problem is?
The “classic mode” of tracking is focused on working with a person in a frontal pose, small turns also work well
The “AI mode” allows you to make large turns (even 360 degrees), but it does not always work well with 3D tracking (you can try, check the AI on the NuitrackManager component)
I’ve added a costume with rigging, but I’m facing an issue where the costume doesn’t match correctly on the user’s body.
Additionally, when the user turns around, the costume doesn’t follow their movement properly. I’ve attached a screen recording of my project to better illustrate the problem.
Does anyone know how to fix this issue? Any help or guidance would be greatly appreciated.
Thanks!
Updated Virtual Fitting Room Repositioning
This is the updated video. I’ve set the avatar position to (0,0,0). But when I set the scale to1.0, the body looks small. Also, why isn’t the costume sticking to the body? It looks like it’s floating instead of fitting properly, not like the avatar is actually wearing it. Plus, it doesn’t follow the user’s size. How can I make the costume fit the body properly and adjust to the user’s size? Can you help? Thank you.
It is more convenient to check the models in the Fitting Room Tool
There are recommendations in the Readme
You can increase or decrease model size, this is normal, it’s better to focus closer to the size in the real world (the main thing is not to change the size of the individual bones inside, they should be 1.1.1). Perhaps the model is not too well attached to the bones. Try enabling skeleton mapping in the Fitting Room Tool to understand exactly where Nuitrack joints (and, accordingly, the bones of the model) are currently located. Also, if you are using Nuitrack Avatar, the Alignment Body Length option must be enabled.
This is the updated video, I followed the fitting room sample and successfully linked the clothing bones to the mannequin bones. However, I encountered an issue where the clothing appears to shrink or deform incorrectly. It looks like the costume is not following the skeleton properly. Any advice on fixing this would be appreciated. Thank you.
Here is the link for project zipped
Here is path for the scene: Asset > Scenes > Scene 1
Thank you.
Hi, is there any update on the analysis about my project?
Thank you.
Hello @amalin. Sorry for late reply
It is desirable that all the default bone sizes are one (I think you can just re-import the model, and in the import window specify the desired size or make changes using the 3D editor)
The torso bone (for the torso joint) should be in the center of the torso.
