Search results

warmup error when MAX_TOTAL_TOKENS and max_input_length are not power of 2 numbers

Status: Open.

#256 In huggingface/tgi-gaudi;

· rbrugaro opened on Dec 17, 2024

tgi-gaudi server error with long inputs sent to chat_completion api using openai python sdk

Status: Open.

#248 In huggingface/tgi-gaudi;

· minmin-intel opened on Nov 22, 2024

Adding Universal Assisted Generation

Status: Open.

#244 In huggingface/tgi-gaudi;

· edlee123 opened on Nov 4, 2024

Incorrect answer with openai compatible penalty parameters

Status: Open.

#238 In huggingface/tgi-gaudi;

· Spycsh opened on Oct 17, 2024

Generation stopped too early without hitting stop condition

Status: Open.

#223 In huggingface/tgi-gaudi;

· minmin-intel opened on Sep 18, 2024

llama3.1-70B-instruct 422 error Template error: unknown test: test iterable is unknown (in <string>:99)

Status: Open.

#218 In huggingface/tgi-gaudi;

· minmin-intel opened on Sep 3, 2024

GPTQ uint4 quantization broken

Status: Open.

#207 In huggingface/tgi-gaudi;

· endomorphosis opened on Aug 11, 2024

Best Performance for a single card for Llama-2-7b-chat-hf

Status: Open.

#196 In huggingface/tgi-gaudi;

· AdityaKulshrestha opened on Jul 29, 2024

setting token flags still results in console warning

Status: Open.

#195 In huggingface/tgi-gaudi;

· endomorphosis opened on Jul 28, 2024

Misleading documentation

Status: Open.

#174 In huggingface/tgi-gaudi;

· 12010486 opened on Jul 2, 2024

ValueError: Unsupported model type t5

Status: Open.

#172 In huggingface/tgi-gaudi;

· JunxiChhen opened on Jun 27, 2024

low throughput while using TGI-Gaudi on bigcode/starcoderbase-3b on Gaudi2

Status: Open.

#166 In huggingface/tgi-gaudi;

· vishnumadhu365 opened on Jun 22, 2024