Search results

Add support for a Python vLLM backend

featureFeature addition with a set PRD for the releaseFeature addition with a set PRD for the release

good first issueGood for newcomersGood for newcomers

priority-high

Status: Open.

Feature

#178 In neuralmagic/guidellm;

· rgreenberg1 opened on May 29, 2025

Sweep Mode Improvements - get closer to approaching peak-throughput

load-requestload-request workstreamload-request workstream

priority-high

Status: Open.

Feature

#155 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Standardize dataset profiles for reasoning benchmarking

priority-high

Status: Open.

Feature

#154 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Support Audio to text multi-modal benchmarking in GuideLLM

priority-high

Status: Open.

Feature

#153 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Support VL Model Benchmarking

multi-modalSupport for benchmarking new multi-modal modelsSupport for benchmarking new multi-modal models

priority-high

Status: Open.

#152 In neuralmagic/guidellm;

· rgreenberg1 opened on May 8, 2025

Event loop is closed error.

bugSomething isn't workingSomething isn't working

priority-high

Status: Open.

Bug

#147 In neuralmagic/guidellm;

· phalani-paladugu opened on May 5, 2025

[Feature Request] Testing with defined prefix lengths

priority-high

Status: Open.

Feature

#104 In neuralmagic/guidellm;

· thameem-abbas opened on Apr 4, 2025

Automatic performance stabilizization - so no need to set max-requests or max-seconds

analysisanalysis workstream - relating to adding in features to do analysis on extrapolating resultsanalysis workstream - relating to adding in features to do analysis on extrapolating results

automationautomation workstreamautomation workstream

priority-high

Status: Open.

Feature

#101 In neuralmagic/guidellm;

· rgreenberg1 opened on Mar 31, 2025

Land GuideLLM UI in Upstream Repository

priority-high

UIFront-end workstreamFront-end workstream

Status: Open.

Feature

#98 In neuralmagic/guidellm;

· rgreenberg1 opened on Mar 12, 2025