Skip to content

Ambiguous startup warning wrt. sglang / kt-kernel / moe integration #2008

@usrlocalben

Description

@usrlocalben

Reminder

  • I have read the above rules and searched the existing issues.

System Info

all versions

Reproduction

At sglang+kt-kernel startup:

[2026-05-15 20:31:38] Using default MoE kernel config. Performance might be sub-optimal! Config file not found at /.../.venv/lib/python3.12/site-packages/sglang/srt/layers/moe/fused_moe_triton/configs/triton_3_5_1/E=384,N=14336,device_name=NVIDIA_
RTX_PRO_6000_Blackwell_Max-Q_Workstation_Edition.json, you can create them with https://github.com/sgl-project/sglang/tree/main/benchmark/kernels/fused_moe_triton

This warning is given for various invocations (any invocations I've ever run) and for all working versions of sg+kt that I know of.

It's unclear if this is a "real" warning. e.g. kt-kernel replaces the MoE impl, so my assumption is that this warning can be ignored as this sglang component is completely avoided by the sg+kt combo. However, one might wonder if they should follow up on this direction for some improvement in perf (or at least silencing the warning.)

Others

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions