Skip to content

Perf: Explain text vs token perf on TRTLLM #182

Open
Open
Perf: Explain text vs token perf on TRTLLM#182
Assignees
viraatc
Labels
area: metricsEvent recorder, metrics reporter, reportingpriority: P1High — must address this cycletype: performancePerformance regression or improvement
@arekay-nv

Description

@arekay-nv
arekay-nv
opened on Mar 17, 2026

There is a perf regression between the using tokens versus text with TRTLLM.

Metadata

Metadata

Assignees

Labels

area: metricsEvent recorder, metrics reporter, reportingpriority: P1High — must address this cycletype: performancePerformance regression or improvement

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions