NVJPEG does not work, -d nvjpeg does not show anything #4211

Rush-iam · 2024-05-02T22:59:38Z

Rush-iam
May 2, 2024

I am upgrading from Xpra 5.0.3 to 6.0.
I found NVJPEG compression is not working for me in 6.0.
I remember it can be debugged with -d nvjpeg, but it does not produce any debug output.
-d compress shows basic jpeg/webp compression codecs are used.
-d nvenc works fine and passes all the checks and I also see this successful init in the start-up log:

2024-05-02 22:52:15,570 CUDA initialization (this may take a few seconds)       
2024-05-02 22:52:15,667 loaded 2 start menu entries from 1 sub-menus in 0.4 seconds                                                                             
2024-05-02 22:52:15,695 CUDA 11.2.0 / PyCUDA 2024.1, found 1 devices:           
2024-05-02 22:52:15,695   + Tesla T4 @ 0000:00:1E.0 (memory: 99% free, compute: 7.5)                                                                            
2024-05-02 22:52:15,764 NVidia driver version 470.182.3                         
2024-05-02 22:52:15,900 NVENC v11 successfully initialized with codecs: h264, h265

Answered by Rush-iam

May 7, 2024

I googled it more, it looks like libnvjpeg.so.12 is from CUDA 12, while I have CUDA 11.
So, looks like CUDA 11 support was dropped by Xpra... I guess starting from Xpra 5.0.4.

View full answer

totaam · 2024-05-03T07:57:00Z

totaam
May 3, 2024
Maintainer

Please include more details as per https://github.com/Xpra-org/xpra/wiki/Reporting-Bugs
The output of xpra encoding and xpra video would help.

2 replies

Rush-iam May 6, 2024
Author

6.0 xpra encoding:

CUDA initialization (this may take a few seconds)
CUDA 11.2.0 / PyCUDA 2024.1, found 1 devices:
  + Tesla T4 @ 0000:00:1E.0 (memory: 99% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
Error querying drm devices: -2
modules found:
* csc_cython           : No module named 'xpra.codecs.csc_cython'
* csc_libyuv           : No module named 'xpra.codecs.libyuv'
* dec_avif             : No module named 'xpra.codecs.avif'
* dec_gstreamer        : No module named 'xpra.codecs.gstreamer'
* dec_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/decoder.cpython-310-x86_64-linux-gnu.so
* dec_nvjpeg           : libnvjpeg.so.12: cannot open shared object file: No such file or directory
* dec_openh264         : /usr/lib/python3/dist-packages/xpra/codecs/openh264/decoder.cpython-310-x86_64-linux-gnu.so
* dec_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/decoder.py
* dec_spng             : No module named 'xpra.codecs.spng'
* dec_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/decoder.cpython-310-x86_64-linux-gnu.so
* dec_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/decoder.cpython-310-x86_64-linux-gnu.so
* drm                  : /usr/lib/python3/dist-packages/xpra/codecs/drm/drm.cpython-310-x86_64-linux-gnu.so
* enc_avif             : No module named 'xpra.codecs.avif'
* enc_gstreamer        : No module named 'xpra.codecs.gstreamer'
* enc_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/encoder.cpython-310-x86_64-linux-gnu.so
* enc_nvjpeg           : libnvjpeg.so.12: cannot open shared object file: No such file or directory
* enc_openh264         : /usr/lib/python3/dist-packages/xpra/codecs/openh264/encoder.cpython-310-x86_64-linux-gnu.so
* enc_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/encoder.py
* enc_rgb              : /usr/lib/python3/dist-packages/xpra/codecs/argb/encoder.py
* enc_spng             : No module named 'xpra.codecs.spng'
* enc_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/encoder.cpython-310-x86_64-linux-gnu.so
* enc_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/encoder.cpython-310-x86_64-linux-gnu.so
* enc_x264             : /usr/lib/python3/dist-packages/xpra/codecs/x264/encoder.cpython-310-x86_64-linux-gnu.so
* evdi                 : No module named 'xpra.codecs.evdi'
* nvdec                : No module named 'xpra.codecs.nvidia.nvdec'
* nvenc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvenc/encoder.cpython-310-x86_64-linux-gnu.so
* nvfbc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvfbc/capture_linux.cpython-310-x86_64-linux-gnu.so
* v4l2                 : /usr/lib/python3/dist-packages/xpra/codecs/v4l2/virtual.cpython-310-x86_64-linux-gnu.so

codecs versions:
* drm                             : 4.4
* jpeg                            : 1.0
* numpy                           : 1.22.3
* nvenc                           : 11.0
* nvfbc                           : 1.7
* openh264                        : 2.2.0
* pillow                          : 9.5.0
* rgb                             : 6.0
* v4l2                            : 1.0
* vpx                             : 1.11.0
* webp                            : 1.2.2
* x264                            : 163

6.0 xpra video:

CUDA 11.2.0 / PyCUDA 2024.1, found 1 devices:
  + Tesla T4 @ 0000:00:1E.0 (memory: 99% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
* csc
* decoding
  - h264_to_YUV420P               : openh264
  - vp8_to_YUV420P                : vpx
  - vp9_to_YUV420P                : vpx
  - vp9_to_YUV444P                : vpx
* encoding
  - ARGB_to_h264                  : nvenc
  - ARGB_to_h265                  : nvenc
  - BGR48_to_h264                 : x264
  - BGRA_to_jpega                 : jpeg
  - BGRA_to_webp                  : webp
  - BGRX_to_h264                  : nvenc, x264
  - BGRX_to_h265                  : nvenc
  - BGRX_to_jpeg                  : jpeg
  - BGRX_to_webp                  : webp
  - BGR_to_jpeg                   : jpeg
  - BGR_to_webp                   : webp
  - RGBA_to_jpega                 : jpeg
  - RGBA_to_webp                  : webp
  - RGBX_to_jpeg                  : jpeg
  - RGBX_to_webp                  : webp
  - RGB_to_jpeg                   : jpeg
  - RGB_to_webp                   : webp
  - XBGR_to_jpeg                  : jpeg
  - XRGB_to_h264                  : nvenc
  - XRGB_to_h265                  : nvenc
  - XRGB_to_jpeg                  : jpeg
  - YUV420P_to_h264               : openh264, x264
  - YUV420P_to_jpeg               : jpeg
  - YUV420P_to_vp8                : vpx
  - YUV420P_to_vp9                : vpx
  - YUV422P_to_h264               : x264
  - YUV422P_to_jpeg               : jpeg
  - YUV444P10_to_vp9              : vpx
  - YUV444P_to_h264               : x264
  - YUV444P_to_jpeg               : jpeg
  - YUV444P_to_vp9                : vpx
  - csc-module
    - cython                      : active
    - libyuv                      : active
  - r210_to_h264                  : nvenc
  - r210_to_h265                  : nvenc
  - video-encoder
    - gstreamer                   : active
    - jpeg                        : active
    - nvenc                       : active
    - nvjpeg                      : active
    - openh264                    : active
    - vpx                         : active
    - webp                        : active
    - x264                        : active
* gpu
  - csc                           : ()
  - decodings                     : ()
  - encodings                     : h264, h265

5.0.3 xpra encoding:

CUDA 11.2.0 / PyCUDA 2024.1, found 1 device: 
+ Tesla T4 @ 0000:00:1E.0 (memory: 97% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
Error querying drm devices: -2                                                                           
modules found:
* csc_cython           : No module named 'xpra.codecs.csc_cython'                                        
* csc_libyuv           : No module named 'xpra.codecs.libyuv'                                                   
* csc_swscale          : No module named 'xpra.codecs.ffmpeg'                                                           
* dec_avcodec2         : No module named 'xpra.codecs.ffmpeg'
* dec_avif             : /usr/lib/python3/dist-packages/xpra/codecs/avif/decoder.cpython-310-x86_64-linux-gnu.so        
* dec_gstreamer        : No module named 'xpra.codecs.gstreamer' 
* dec_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/decoder.cpython-310-x86_64-linux-gnu.so
* dec_openh264         : No module named 'xpra.codecs.openh264'                                                 
* dec_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/decoder.py
* dec_spng             : No module named 'xpra.codecs.spng'                                                     
* dec_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/decoder.cpython-310-x86_64-linux-gnu.so
* dec_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/decoder.cpython-310-x86_64-linux-gnu.so        
* drm                  : /usr/lib/python3/dist-packages/xpra/codecs/drm/drm.cpython-310-x86_64-linux-gnu.so              
* enc_avif             : /usr/lib/python3/dist-packages/xpra/codecs/avif/encoder.cpython-310-x86_64-linux-gnu.so
* enc_ffmpeg           : No module named 'xpra.codecs.ffmpeg'                                                         
* enc_gstreamer        : No module named 'xpra.codecs.gstreamer' 
* enc_jpeg             : /usr/lib/python3/dist-packages/xpra/codecs/jpeg/encoder.cpython-310-x86_64-linux-gnu.so         
* enc_nvjpeg           : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvjpeg/encoder.cpython-310-x86_64-linux-gnu.so
* enc_openh264         : No module named 'xpra.codecs.openh264'                                                
* enc_pillow           : /usr/lib/python3/dist-packages/xpra/codecs/pillow/encoder.py                          
* enc_rgb              : /usr/lib/python3/dist-packages/xpra/codecs/argb/encoder.py                             
* enc_spng             : No module named 'xpra.codecs.spng'
* enc_vpx              : /usr/lib/python3/dist-packages/xpra/codecs/vpx/encoder.cpython-310-x86_64-linux-gnu.so 
* enc_webp             : /usr/lib/python3/dist-packages/xpra/codecs/webp/encoder.cpython-310-x86_64-linux-gnu.so
* enc_x264             : /usr/lib/python3/dist-packages/xpra/codecs/x264/encoder.cpython-310-x86_64-linux-gnu.so                  
* evdi                 : No module named 'xpra.codecs.evdi'
* nvdec                : No module named 'xpra.codecs.nvidia.nvdec'                                                     
* nvenc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvenc/encoder.cpython-310-x86_64-linux-gnu.so         
* nvfbc                : /usr/lib/python3/dist-packages/xpra/codecs/nvidia/nvfbc/fbc_capture_linux.cpython-310-x86_64-linux-gnu.so
* v4l2                 : /usr/lib/python3/dist-packages/xpra/codecs/v4l2/pusher.cpython-310-x86_64-linux-gnu.so
                                                                                
codecs versions:                                                                
* avif                            : 0.9.3                                       
* drm                             : 4.4
* jpeg                            : 1.0 
* numpy                           : 1.22.3  
* nvenc                           : 11.0         
* nvfbc                           : 1.7                                         
* nvjpeg                          : 11.8.0.2                
* pillow                          : 9.5.0                                       
* rgb                             : 4.3                                         
* v4l2                            : 1.0
* vpx                             : 1.11.0                                      
* webp                            : 1.2.2                        * x264                            : 163

5.0.3 xpra video

CUDA 11.2.0 / PyCUDA 2024.1, found 1 device:
  + Tesla T4 @ 0000:00:1E.0 (memory: 97% free, compute: 7.5)
NVidia driver version 470.182.3
NVENC v11 successfully initialized with codecs: h264, h265
* csc
* decoding
  - vp8_to_YUV420P                : dec_vpx
  - vp9_to_YUV420P                : dec_vpx
  - vp9_to_YUV444P                : dec_vpx
* encoding
  - ARGB_to_h264                  : nvenc
  - ARGB_to_h265                  : nvenc
  - BGR48_to_h264                 : x264
  - BGRA_to_jpega                 : nvjpeg, jpeg
  - BGRA_to_webp                  : webp
  - BGRX_to_h264                  : x264, nvenc
  - BGRX_to_h265                  : nvenc
  - BGRX_to_jpeg                  : nvjpeg, jpeg
  - BGRX_to_webp                  : webp
  - BGR_to_jpeg                   : jpeg
  - BGR_to_webp                   : webp
  - RGBA_to_jpega                 : nvjpeg, jpeg
  - RGBA_to_webp                  : webp
  - RGBX_to_jpeg                  : nvjpeg, jpeg
  - RGBX_to_webp                  : webp
  - RGB_to_jpeg                   : jpeg
  - RGB_to_webp                   : webp
  - XBGR_to_jpeg                  : jpeg
  - XRGB_to_h264                  : nvenc
  - XRGB_to_h265                  : nvenc
  - XRGB_to_jpeg                  : jpeg
  - YUV420P_to_h264               : x264
  - YUV420P_to_jpeg               : jpeg
  - YUV420P_to_vp8                : vpx
  - YUV420P_to_vp9                : vpx
  - YUV422P_to_h264               : x264
  - YUV422P_to_jpeg               : jpeg
  - YUV444P10_to_vp9              : vpx
  - YUV444P_to_h264               : x264
  - YUV444P_to_jpeg               : jpeg
  - YUV444P_to_vp9                : vpx
  - csc-module
    - cython                      : active
    - libyuv                      : active
    - swscale                     : active
  - r210_to_h264                  : nvenc
  - r210_to_h265                  : nvenc
  - video-encoder
    - ffmpeg                      : active
    - gstreamer                   : active
    - jpeg                        : active
    - nvenc                       : active
    - nvjpeg                      : active
    - openh264                    : active
    - vpx                         : active
    - webp                        : active
    - x264                        : active

Rush-iam May 6, 2024
Author

nvenc h.264 also does not work (despite successful checks) for both 5.0.3 and 6.0 but it is a different story...

totaam · 2024-05-07T05:48:44Z

totaam
May 7, 2024
Maintainer

I still don't know what OS and version you are running.
But this doesn't look like a package from xpra.org for a start:

* csc_libyuv : No module named 'xpra.codecs.libyuv'
(..)
* dec_spng : No module named 'xpra.codecs.spng'
etc

As for the original question, this is the cause:

* enc_nvjpeg : libnvjpeg.so.12: cannot open shared object file: No such file or directory

The library is missing.

1 reply

Rush-iam May 7, 2024
Author

It is Ubuntu 22.04. I install Xpra with --no-install-recommends, which probably excludes some codecs.

The library is missing.

Why does the library work for Xpra 5.0.3 then? The logs above are from the same machine.

totaam · 2024-05-07T14:34:37Z

totaam
May 7, 2024
8000 Maintainer

I install Xpra with --no-install-recommends

And here we go. You've ended up with a weird installation.

Why does the library work for Xpra 5.0.3 then?

Probably some dependency that was installed then.

2 replies

Rush-iam May 7, 2024
Author

I googled it more, it looks like libnvjpeg.so.12 is from CUDA 12, while I have CUDA 11.
So, looks like CUDA 11 support was dropped by Xpra... I guess starting from Xpra 5.0.4.

Answer selected by Rush-iam

totaam May 7, 2024
Maintainer

So, looks like CUDA 11 support was dropped by Xpra...

We have to choose one .so to link against.
By default, we try to always use the current version.

xpra.org

NVJPEG does not work, -d nvjpeg does not show anything #4211

Uh oh!

Uh oh!

Rush-iam May 2, 2024

Replies: 3 comments · 5 replies

Uh oh!

totaam May 3, 2024 Maintainer

Uh oh!

Rush-iam May 6, 2024 Author

Uh oh!

Rush-iam May 6, 2024 Author

Uh oh!

totaam May 7, 2024 Maintainer

Uh oh!

Uh oh!

Rush-iam May 7, 2024 Author

Uh oh!

totaam May 7, 2024 8000 Maintainer

Uh oh!

Rush-iam May 7, 2024 Author

Uh oh!

totaam May 7, 2024 Maintainer

Rush-iam
May 2, 2024

Replies: 3 comments 5 replies

totaam
May 3, 2024
Maintainer

Rush-iam May 6, 2024
Author

Rush-iam May 6, 2024
Author

totaam
May 7, 2024
Maintainer

Rush-iam May 7, 2024
Author

totaam
May 7, 2024
8000 Maintainer

Rush-iam May 7, 2024
Author

totaam May 7, 2024
Maintainer