Skip to content

Clean up JSON output #76

Closed
Closed
@sjmonson

Description

@sjmonson

There is a lot of minor improvements that can be made to the JSON output of guidellm. For example:

  1. Deduplicate the prompt field for each request
  2. Flatten some field structures (e.g. "decode_times": { "data": [] } -> "decode_times": [] ).
  3. Label percentiles (e.g. "request_latency_percentiles": [ 1, 2,... ] -> "request_latency_percentiles": { "p01": 1, "p05": 5,. ... })
  4. Give max and min with all percentiles
  5. Drop concurrences timestamps (possibly replace with percentiles/min/max/mean)

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions