Search results

Optimize the Default Precision of Model Weights for HuggingFace Runtime

Status: Open.

#2046 In SeldonIO/MLServer;

· fyuan1316 opened on Feb 4, 2025

Collecting custom metrics through bash terminal

Status: Open.

#2035 In SeldonIO/MLServer;

· alexei-borovik-1 opened on Jan 27, 2025

Opentelemetry dependency mismatch

Status: Open.

#2028 In SeldonIO/MLServer;

· seBasKov opened on Jan 10, 2025

Out of Memory (OOM) Error When Loading Phi-2 Model with Hugging Face Runtime

Status: Open.

#2023 In SeldonIO/MLServer;

· fyuan1316 opened on Jan 7, 2025

Support token metrics

Status: Open.

#2005 In SeldonIO/MLServer;

· luohua13 opened on Dec 24, 2024

Lose /invocations path when using envrironment tarball from model-settings.json

Status: Open.

#1956 In SeldonIO/MLServer;

· ylambrus opened on Nov 14, 2024

Cannot import "Conversation"

Status: Open.

#1955 In SeldonIO/MLServer;

· Phyks opened on Nov 13, 2024

Adaptive batching batch timeout fires sooner than configured

Status: Open.

#1936 In SeldonIO/MLServer;

· hanlaur opened on Oct 25, 2024

Can't specify params when running inference on MLServer

Status: Open.

#1927 In SeldonIO/MLServer;

· svpino opened on Oct 16, 2024

Streaming model docker not working

Status: Open.

#1906 In SeldonIO/MLServer;

· Hamlet626 opened on Sep 14, 2024

GPU support for custom inference runtimes in MLServer

Status: Open.

#1894 In SeldonIO/MLServer;

· koolgax99 opened on Aug 28, 2024

Python client library for mlflow server

Status: Open.

#1892 In SeldonIO/MLServer;

· idlefella opened on Aug 22, 2024