Skip to content

[DataFlow runtime 5/7] Inference: CaptureConfig, RolloutWorker, SGLangAdapter#598

Merged
jiapingW merged 1 commit into
sgl-project:dataflow-up-4-control-planefrom
maocheng23:dataflow-up-5-inference
Jun 25, 2026
Merged

[DataFlow runtime 5/7] Inference: CaptureConfig, RolloutWorker, SGLangAdapter#598
jiapingW merged 1 commit into
sgl-project:dataflow-up-4-control-planefrom
maocheng23:dataflow-up-5-inference

Conversation

@maocheng23

@maocheng23 maocheng23 commented Jun 24, 2026

Copy link
Copy Markdown
Collaborator

DataFlow runtime — stacked PR. Stacked on #597true-stacked: this PR's base is the previous PR's branch, so the diff below shows only this layer.

Part 5/7 — inference (CaptureConfig, RolloutWorker, SGLangAdapter).

Adds specforge/runtime/inference/. CaptureConfig + verify_capture is the typed contract for what rollout must produce (verified before persisting). RolloutWorker is strategy-agnostic — it leases PromptTasks, asks a feature_source for features, verifies them, writes to the store, and commits refs; it never hands a tensor to the controller. SGLangAdapter wraps any Eagle3TargetModel.generate_eagle3_data (HF, SGLang, or custom backend). Tests: test_capture, test_rollout_worker, test_sglang_adapter_batching. Additive.

Part of a 7-PR series adding the DataFlow runtime (specforge/runtime/, milestones M1–M4). Verified on current upstream main: all subpackages import and 65 component tests pass. The integration launcher (launch.py + train_eagle3_dataflow.py) and the end-to-end equivalence gates are a deliberate follow-up, not in this series.

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@maocheng23 maocheng23 force-pushed the dataflow-up-5-inference branch from a6a1adf to 6d94c09 Compare June 24, 2026 17:49
@maocheng23 maocheng23 changed the base branch from main to dataflow-up-4-control-plane June 25, 2026 00:14
@jiapingW jiapingW self-requested a review June 25, 2026 08:45
@jiapingW jiapingW merged commit 7663c19 into sgl-project:dataflow-up-4-control-plane Jun 25, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants