Skip to content

Add qwen3 30b fused moe config #5859

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 29, 2025

Conversation

JustinTong0323
Copy link
Collaborator

@JustinTong0323 JustinTong0323 commented Apr 28, 2025

Motivation

image

Modifications

Checklist

@zhyncs
Copy link
Member

zhyncs commented Apr 28, 2025

isl 1k osl 2k tp 1 is even worse

@zhyncs zhyncs changed the title Add qwen3 30b fused moe config [WIP] Add qwen3 30b fused moe config Apr 28, 2025
@JustinTong0323
Copy link
Collaborator Author

isl 1k osl 2k tp 1 is even worse

I rerun the test, and it seems like the tuned config is better than default in all sets, the original score maybe a mistake.

@JustinTong0323 JustinTong0323 changed the title [WIP] Add qwen3 30b fused moe config Add qwen3 30b fused moe config Apr 29, 2025
@zhyncs zhyncs merged commit 8465f03 into sgl-project:main Apr 29, 2025
23 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants