Skip to content

[wip]: instructions to run sglang h100 blog post results with dynamo #1583

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 8 commits into
base: ishan/token-endpoint
Choose a base branch
from
Draft

[wip]: instructions to run sglang h100 blog post results with dynamo #1583

wants to merge 8 commits into from

Conversation

ishandhanani
Copy link
Contributor

  1. Use my version of GAP
  2. Needs feat: add token completions endpoint #1565 for endpoint

TODO

  1. Full e2e instructions

@copy-pr-bot copy-pr-bot
Copy link

copy-pr-bot bot commented Jun 18, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@ishandhanani ishandhanani changed the base branch from main to ishan/token-endpoint June 18, 2025 07:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@biswapanda biswapanda Awaiting requested review from biswapanda biswapanda will be requested when the pull request is marked ready for review biswapanda is a code owner

@tedzhouhk tedzhouhk Awaiting requested review from tedzhouhk tedzhouhk will be requested when the pull request is marked ready for review tedzhouhk is a code owner

@rmccorm4 rmccorm4 Awaiting requested review from rmccorm4 rmccorm4 will be requested when the pull request is marked ready for review rmccorm4 is a code owner

@tanmayv25 tanmayv25 Awaiting requested review from tanmayv25 tanmayv25 will be requested when the pull request is marked ready for review tanmayv25 is a code owner

@richardhuo-nv richardhuo-nv Awaiting requested review from richardhuo-nv richardhuo-nv will be requested when the pull request is marked ready for review richardhuo-nv is a code owner

@ptarasiewiczNV ptarasiewiczNV Awaiting requested review from ptarasiewiczNV ptarasiewiczNV will be requested when the pull request is marked ready for review ptarasiewiczNV is a code owner

@alec-flowers alec-flowers Awaiting requested review from alec-flowers alec-flowers will be requested when the pull request is marked ready for review alec-flowers is a code owner

@nnshah1 nnshah1 Awaiting requested review from nnshah1 nnshah1 will be requested when the pull request is marked ready for review nnshah1 is a code owner

Assignees
No one assigned
Labels
size/L
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ishandhanani