docker

[johndpope]

No description provided.

[peter-iglaev]

got the issue:

=====================
== NVIDIA TensorRT ==
=====================
NVIDIA Release 23.12 (build 76057045)
NVIDIA TensorRT Version 8.6.1
Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
Container image Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
https://developer.nvidia.com/tensorrt
Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES.  All rights reserved.
This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
To install Python sample dependencies, run /opt/tensorrt/python/python_setup.sh
To install the open-source samples corresponding to this TensorRT release version
run /opt/tensorrt/install_opensource.sh.  To build the open source parsers,
plugins, and samples for current top-of-tree on master or a different branch,
run /opt/tensorrt/install_opensource.sh -b <branch>
See https://github.com/NVIDIA/TensorRT for more information.
Traceback (most recent call last):
  File "/app/realtime_agent/main.py", line 2, in <module>
    import torch
  File "/usr/local/lib/python3.10/dist-packages/torch/__init__.py", line 409, in <module>
    from torch._C import *  # noqa: F403
ImportError: libcudnn.so.9: cannot open shared object file: No such file or directory

[johndpope]

from top of my head - dont use docker + desktop
just use cli docker

"AI Overview
Docker Desktop supports GPU usage, but with limitations. Currently, it's primarily available on Windows with the WSL2 backend, allowing NVIDIA GPU Paravirtualization (GPU-PV). For Linux, Docker Desktop doesn't natively support GPU usage, but you can install Docker CE, which does offer GPU support."