Search results

Encounter Error: ValueError: Message onnx.ModelProto exceeds maximum protobuf size of 2GB

Status: Open.

#183 In ELS-RD/transformer-deploy;

· illumination-k opened on Mar 4, 2024

the performance of onxx fp16 seems to be even worse than that of onnx fp32

Status: Open.

#182 In ELS-RD/transformer-deploy;

· lierer007 opened on Nov 3, 2023

Unable To use batching

Status: Open.

#180 In ELS-RD/transformer-deploy;

· rahulmate opened on Oct 13, 2023

unable to host .onnx model on triton server

Status: Open.

#179 In ELS-RD/transformer-deploy;

· riyaj8888 opened on Jul 19, 2023

GPTModelWrapper' object has no attribute 'can_generate'

Status: Open.

#177 In ELS-RD/transformer-deploy;

· jxcomeon opened on Jul 13, 2023

unable to do tensorrt inference

Status: Open.

#176 In ELS-RD/transformer-deploy;

· riyaj8888 opened on Jul 12, 2023

No supported GPU(s) detected to run this container

Status: Open.

#175 In ELS-RD/transformer-deploy;

· sinankefeli opened on Jul 7, 2023

convert_model command not found

Status: Open.

#173 In ELS-RD/transformer-deploy;

· pint1022 opened on May 23, 2023

Tokenizer path

Status: Open.

#171 In ELS-RD/transformer-deploy;

· vishalsrao opened on Apr 22, 2023

Llama support

Status: Open.

#170 In ELS-RD/transformer-deploy;

· michaelroyzen opened on Apr 19, 2023

Torch 2.0

Status: Open.

#169 In ELS-RD/transformer-deploy;

· varshith15 opened on Apr 11, 2023

Marginal Improvement Between INT8 and FP16

Status: Open.

#168 In ELS-RD/transformer-deploy;

· alexriggio opened on Mar 31, 2023