[Solved] "nuitrack_sample show only a empty window

Hi,
Your software looks really cool and I would love to try it out.
My current problem is that when I start “nuitrack_sample” it shows an empty window.
I am using ubuntu 16.04. I have the D435 with the newest firmware 05.10.06.00 and it works fine with realsense-viewer. (All resolutions seem to work, so it is connected to a usb3).

So in general I guess the D435 setup is good, but I have trouble with the nuitrack itself.
As I said when I start “nuitrack_sample” I only get an empty window.
The console output is

nuitrack_sample
UVCVideoCapture::open ERROR: can't find device
Can't find video camera!
Can't find Depth camera!
ERROR: Can't create DepthSensor module
AstraProPerseeDepthProvider: Can't create RGB Stream (can't open video capture)
KinectDepthProvider: Devices not found
OpenNI2DepthProvider: Can't open device (       DeviceOpen using default: no devices found
)
OpenNIDepthProvider: Can't create OpenNI DepthGenerator (OpenNI Status: Can't create any node of the requested type!)
set_xu(...). xioctl(UVCIOC_CTRL_QUERY) failed Last Error: Inappropriate ioctl for device

Can't create DepthSensor module
AstraProPerseeDepthProvider: Can't create RGB Stream (can't open video capture)
KinectDepthProvider: Devices not found
OpenNI2DepthProvider: Can't open device (       DeviceOpen using default: no devices found
)
OpenNIDepthProvider: Can't create OpenNI DepthGenerator (OpenNI Status: Can't create any node of the requested type!)
set_xu(...). xioctl(UVCIOC_CTRL_QUERY) failed Last Error: Inappropriate ioctl for device

I am not really sure where to look next to solve this issue.
Thanks for your help.

Hi SGSSGene,

  1. Do you connect only one sensor to a PC?
  2. What Nuitrack Runtime version do you use? You can check the version using the following command:

dpkg -l nuitrack

Yes, I have a single D435 attached. (Only device on that usb bus).

dpkg -l nuitrack show following output:

$ dpkg -l nuitrack
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name                     Version           Architecture      Description
+++-========================-=================-=================-=====================================================
ii  nuitrack                 0.24.0            amd64             Project built using CMake

I actually also tried it with ubuntu 18.04 and arch linux, they all show same behavior.
Is there anything like a docker container? Which one could download to check the differences to find the error?

Please run the following commands and provide us with the console output:

ldd /usr/local/lib/nuitrack/libnuitrack.so
ldd /usr/local/lib/nuitrack/libmiddleware.so
ldd /usr/local/lib/nuitrack/librealsense2.so.2
ldd /usr/etc/nuitrack/middleware/libNuitrackModule.so

Here is the output:

$ ldd /usr/local/lib/nuitrack/libnuitrack.so
	linux-vdso.so.1 =>  (0x00007ffe2fb2a000)
	libmiddleware.so => /usr/local/lib/nuitrack/libmiddleware.so (0x00007f91543a3000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f9154186000)
	libopencv_core.so.2.4 => /usr/local/lib/nuitrack/libopencv_core.so.2.4 (0x00007f9153ce5000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f9153959000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f9153650000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f9153438000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f915306e000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f9152e66000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f9152c62000)
	libbluetooth.so.3 => /usr/lib/x86_64-linux-gnu/libbluetooth.so.3 (0x00007f9152a40000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f91548ac000)
	libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f9152826000)

$ ldd /usr/local/lib/nuitrack/libmiddleware.so
	linux-vdso.so.1 =>  (0x00007ffea41d4000)
	libopencv_core.so.2.4 => /usr/local/lib/nuitrack/libopencv_core.so.2.4 (0x00007f9180e80000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f9180c78000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f9180a74000)
	libbluetooth.so.3 => /usr/lib/x86_64-linux-gnu/libbluetooth.so.3 (0x00007f9180852000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f9180635000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f91802a9000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f9180091000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f917fcc7000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f9181584000)
	libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f917faad000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f917f7a4000)

$ ldd /usr/local/lib/nuitrack/librealsense2.so.2
	linux-vdso.so.1 =>  (0x00007ffe879ad000)
	libusb-1.0.so.0 => /usr/local/lib/nuitrack/libusb-1.0.so.0 (0x00007f5e53fac000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f5e53c20000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f5e53917000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f5e536ff000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f5e534e2000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f5e53118000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f5e549d2000)
	libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 (0x00007f5e54bbb000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f5e52f10000)

$ ldd /usr/etc/nuitrack/middleware/libNuitrackModule.so
	linux-vdso.so.1 =>  (0x00007ffd1f7de000)
	libmiddleware.so => /usr/local/lib/nuitrack/libmiddleware.so (0x00007f35b7d2c000)
	libOpenNI.so => /usr/local/lib/nuitrack/libOpenNI.so (0x00007f35b7a73000)
	libopencv_imgproc.so.2.4 => /usr/local/lib/nuitrack/libopencv_imgproc.so.2.4 (0x00007f35b7588000)
	libOpenNI2.so => /usr/local/lib/nuitrack/libOpenNI2.so (0x00007f35b730e000)
	librealsense2.so.2 => /usr/local/lib/nuitrack/librealsense2.so.2 (0x00007f35b6b00000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f35b68e3000)
	libopencv_highgui.so.2.4 => /usr/local/lib/nuitrack/libopencv_highgui.so.2.4 (0x00007f35b65b7000)
	libopencv_video.so.2.4 => /usr/local/lib/nuitrack/libopencv_video.so.2.4 (0x00007f35b635d000)
	libopencv_core.so.2.4 => /usr/local/lib/nuitrack/libopencv_core.so.2.4 (0x00007f35b5ebc000)
	libopencv_calib3d.so.2.4 => /usr/local/lib/nuitrack/libopencv_calib3d.so.2.4 (0x00007f35b5c20000)
	libopencv_features2d.so.2.4 => /usr/local/lib/nuitrack/libopencv_features2d.so.2.4 (0x00007f35b5972000)
	libopencv_objdetect.so.2.4 => /usr/local/lib/nuitrack/libopencv_objdetect.so.2.4 (0x00007f35b56ee000)
	libopencv_ml.so.2.4 => /usr/local/lib/nuitrack/libopencv_ml.so.2.4 (0x00007f35b5468000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f35b50dc000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f35b4dd3000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f35b4bbb000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f35b47f1000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f35b880f000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f35b45e9000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f35b43e5000)
	libbluetooth.so.3 => /usr/lib/x86_64-linux-gnu/libbluetooth.so.3 (0x00007f35b41c3000)
	libusb-1.0.so.0 => /usr/local/lib/nuitrack/libusb-1.0.so.0 (0x00007f35b3fab000)
	libpng12.so.0 => /lib/x86_64-linux-gnu/libpng12.so.0 (0x00007f35b3d86000)
	libgtk-x11-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgtk-x11-2.0.so.0 (0x00007f35b373b000)
	libgdk-x11-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgdk-x11-2.0.so.0 (0x00007f35b3486000)
	libgobject-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0 (0x00007f35b3233000)
	libglib-2.0.so.0 => /lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f35b2f22000)
	libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f35b2d08000)
	libopencv_flann.so.2.4 => /usr/local/lib/nuitrack/libopencv_flann.so.2.4 (0x00007f35b2a95000)
	libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 (0x00007f35b89f0000)
	libgmodule-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0 (0x00007f35b2891000)
	libpangocairo-1.0.so.0 => /usr/lib/x86_64-linux-gnu/libpangocairo-1.0.so.0 (0x00007f35b2684000)
	libX11.so.6 => /usr/lib/x86_64-linux-gnu/libX11.so.6 (0x00007f35b234a000)
	libXfixes.so.3 => /usr/lib/x86_64-linux-gnu/libXfixes.so.3 (0x00007f35b2144000)
	libatk-1.0.so.0 => /usr/lib/x86_64-linux-gnu/libatk-1.0.so.0 (0x00007f35b1f1f000)
	libcairo.so.2 => /usr/lib/x86_64-linux-gnu/libcairo.so.2 (0x00007f35b1c0b000)
	libgdk_pixbuf-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgdk_pixbuf-2.0.so.0 (0x00007f35b19e9000)
	libgio-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0 (0x00007f35b1661000)
	libpangoft2-1.0.so.0 => /usr/lib/x86_64-linux-gnu/libpangoft2-1.0.so.0 (0x00007f35b144b000)
	libpango-1.0.so.0 => /usr/lib/x86_64-linux-gnu/libpango-1.0.so.0 (0x00007f35b11ff000)
	libfontconfig.so.1 => /usr/lib/x86_64-linux-gnu/libfontconfig.so.1 (0x00007f35b0fbc000)
	libXrender.so.1 => /usr/lib/x86_64-linux-gnu/libXrender.so.1 (0x00007f35b0db2000)
	libXinerama.so.1 => /usr/lib/x86_64-linux-gnu/libXinerama.so.1 (0x00007f35b0baf000)
	libXi.so.6 => /usr/lib/x86_64-linux-gnu/libXi.so.6 (0x00007f35b099f000)
	libXrandr.so.2 => /usr/lib/x86_64-linux-gnu/libXrandr.so.2 (0x00007f35b0794000)
	libXcursor.so.1 => /usr/lib/x86_64-linux-gnu/libXcursor.so.1 (0x00007f35b058a000)
	libXcomposite.so.1 => /usr/lib/x86_64-linux-gnu/libXcomposite.so.1 (0x00007f35b0387000)
	libXdamage.so.1 => /usr/lib/x86_64-linux-gnu/libXdamage.so.1 (0x00007f35b0184000)
	libXext.so.6 => /usr/lib/x86_64-linux-gnu/libXext.so.6 (0x00007f35aff72000)
	libffi.so.6 => /usr/lib/x86_64-linux-gnu/libffi.so.6 (0x00007f35afd6a000)
	libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f35afafa000)
	libfreetype.so.6 => /usr/lib/x86_64-linux-gnu/libfreetype.so.6 (0x00007f35af850000)
	libxcb.so.1 => /usr/lib/x86_64-linux-gnu/libxcb.so.1 (0x00007f35af62e000)
	libpixman-1.so.0 => /usr/lib/x86_64-linux-gnu/libpixman-1.so.0 (0x00007f35af386000)
	libxcb-shm.so.0 => /usr/lib/x86_64-linux-gnu/libxcb-shm.so.0 (0x00007f35af182000)
	libxcb-render.so.0 => /usr/lib/x86_64-linux-gnu/libxcb-render.so.0 (0x00007f35aef78000)
	libselinux.so.1 => /lib/x86_64-linux-gnu/libselinux.so.1 (0x00007f35aed56000)
	libresolv.so.2 => /lib/x86_64-linux-gnu/libresolv.so.2 (0x00007f35aeb3b000)
	libharfbuzz.so.0 => /usr/lib/x86_64-linux-gnu/libharfbuzz.so.0 (0x00007f35ae8dd000)
	libthai.so.0 => /usr/lib/x86_64-linux-gnu/libthai.so.0 (0x00007f35ae6d4000)
	libexpat.so.1 => /lib/x86_64-linux-gnu/libexpat.so.1 (0x00007f35ae4ab000)
	libXau.so.6 => /usr/lib/x86_64-linux-gnu/libXau.so.6 (0x00007f35ae2a7000)
	libXdmcp.so.6 => /usr/lib/x86_64-linux-gnu/libXdmcp.so.6 (0x00007f35ae0a1000)
	libgraphite2.so.3 => /usr/lib/x86_64-linux-gnu/libgraphite2.so.3 (0x00007f35ade7b000)
	libdatrie.so.1 => /usr/lib/x86_64-linux-gnu/libdatrie.so.1 (0x00007f35adc73000)

Thank you for your help so far.
I have installed a VM with ubuntu 16.04 and everything works fine.
The issue seems to be my setup with archlinux + docker which runs ubuntu 16.04. Something doesn’t work properly in this setup.
I guess this can be marked as “fixed” now. Thank you again.