[Bug] Chatqna with denvr remote inference error

[srinarayan-srikanthan]

Priority

P3-Medium

OS type

Ubuntu

Hardware type

Xeon-GNR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other
• N/A

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Kubernetes GMC
• Other
• N/A

Running nodes

Single Node

What's the version?

main

Description

Response not captured and streamed to megaservice

Reproduce steps

Run with compose_remote.yaml

Raw log

Attachments

No response