Search results

Upgrading gRPC lib

enhancementNew feature or requestNew feature or request

grpcRelated to the GRPC serverRelated to the GRPC server

investigatingThe developement team is investigating this issueThe developement team is investigating this issue

Status: Open.

#7043 In triton-inference-server/server;

· yutkin opened on Mar 26, 2024

All gRPC requests to the Triton server are timing out, but HTTP requests are functioning normally.

grpcRelated to the GRPC serverRelated to the GRPC server

investigatingThe developement team is investigating this issueThe developement team is investigating this issue

Status: Open.

#6899 In triton-inference-server/server;

· SunnyGhj opened on Feb 21, 2024

50k-60k infer/sec limitation

grpcRelated to the GRPC serverRelated to the GRPC server

module: serverIssues related to the server coreIssues related to the server core

performanceA possible performance tune-upA possible performance tune-up

Status: Open.

#7590 In triton-inference-server/server;

· v-hyhyniak-crt opened on Sep 3, 2024

Encountering a segmentation fault issue when attempting to send multiple images via gRPC

crashRelated to server crashes, segfaults, etc.Related to server crashes, segfaults, etc.

grpcRelated to the GRPC serverRelated to the GRPC server

Status: Open.

#6891 In triton-inference-server/server;

· lawliet0823 opened on Feb 16, 2024

Support request cancellation on timeout for sync grpc client

enhancementNew feature or requestNew feature or request

grpcRelated to the GRPC serverRelated to the GRPC server

Status: Open.

#7532 In triton-inference-server/server;

· ShuaiShao93 opened on Aug 15, 2024

grpc request performance issue

grpcRelated to the GRPC serverRelated to the GRPC server

performanceA possible performance tune-upA possible performance tune-up

Status: Open.

#7187 In triton-inference-server/server;

· Yuyaying-winnie opened on May 7, 2024

Slow Dynamic Batching with High Concurrency on NVIDIA Triton Inference

grpcRelated to the GRPC serverRelated to the GRPC server

module: serverIssues related to the server coreIssues related to the server core

performanceA possible performance tune-upA possible performance tune-up

Status: Open.

#7492 In triton-inference-server/server;

· tuanavu opened on Aug 2, 2024

GRPC infer returns null in outputs contents

grpcRelated to the GRPC serverRelated to the GRPC server

Status: Open.

#7191 In triton-inference-server/server;

· aohorodnyk opened on May 7, 2024

GRPC Duplicate timer being added causing segfaults.

crashRelated to server crashes, segfaults, etc.Related to server crashes, segfaults, etc.

grpcRelated to the GRPC serverRelated to the GRPC server

Status: Open.

#7571 In triton-inference-server/server;

· jamied157 opened on Aug 27, 2024

Interaction of timeouts, ensemble scheduler and oldest sequence scheduler causes state leakage

bugSomething isn't workingSomething isn't working

grpcRelated to the GRPC serverRelated to the GRPC server

Status: Open.

#7117 In triton-inference-server/server;

· jamied157 opened on Apr 15, 2024

Triton crashes with SIGSEGV (signal 11)

crashRelated to server crashes, segfaults, etc.Related to server crashes, segfaults, etc.

grpcRelated to the GRPC serverRelated to the GRPC server

questionFurther information is requestedFurther information is requested

Status: Open.

#7472 In triton-inference-server/server;

· JindrichD opened on Jul 24, 2024

Segfault/Coredump in grpc::ModelInferHandler::InferResponseComplete

crashRelated to server crashes, segfaults, etc.Related to server crashes, segfaults, etc.

grpcRelated to the GRPC serverRelated to the GRPC server

Status: Open.

#7877 In triton-inference-server/server;

· andyblackheel opened on Dec 12, 2024