Skip to content

test: KVStore, ServiceLauncher, and MetricsAggregator services lack integration tests #222

@arekay-nv

Description

@arekay-nv

Problem

Three new infrastructure services were added in late March 2026 with no integration test coverage:

  • KVStore + ServiceLauncher + ready-check mechanism — added in commit fd7b4ed ("Add KVStore, ready-check mechanism, and ServiceLauncher")
  • MetricsAggregator service — added in commit 08476d7 ("add metrics_aggregator service for real-time metric computation")

These are located under src/inference_endpoint/async_utils/services/. Issue #213 already shows a production failure (psycopg.errors.DuplicatePreparedStatement) originating from this layer, demonstrating that the lack of test coverage is causing real bugs.

Expected Behavior

Integration tests should cover:

Related

Files

  • src/inference_endpoint/async_utils/services/
  • tests/integration/ — new test files needed

Metadata

Metadata

Assignees

No one assigned

    Labels

    area: core-engineLoad generator, scheduler, async utilspriority: P1High — must address this cycletype: choreMaintenance, deps, CI, tooling

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions