Skip to content

Conversation

@yukirora
Copy link
Contributor

@yukirora yukirora commented Sep 4, 2025

Description
change cublasLtMatmulDescCreate scaleType from CUDA_R_32F to CUDA_R_16F in FP16 dist inference to fix cublaslt error.

@yukirora yukirora requested a review from a team as a code owner September 4, 2025 03:34
@codecov
Copy link

codecov bot commented Sep 4, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 86.47%. Comparing base (0b4311c) to head (3de5c93).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #732   +/-   ##
=======================================
  Coverage   86.47%   86.47%           
=======================================
  Files         102      102           
  Lines        7541     7541           
=======================================
  Hits         6521     6521           
  Misses       1020     1020           
Flag Coverage Δ
cpu-python3.10-unit-test 71.59% <ø> (ø)
cpu-python3.12-unit-test 71.59% <ø> (ø)
cpu-python3.7-unit-test 70.65% <ø> (ø)
cuda-unit-test 83.98% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@yukirora yukirora added the benchmarks SuperBench Benchmarks label Sep 5, 2025
@yukirora yukirora changed the title Benchmarks - change cublasLtMatmulDescCreate scaleType from CUDA_R_32F to CUDA_R_16F in FP16 dist inference Benchmarks: micro benchmarks - change cublasLtMatmulDescCreate scaleType from CUDA_R_32F to CUDA_R_16F in FP16 dist inference Sep 5, 2025
@yukirora yukirora enabled auto-merge (squash) September 19, 2025 02:05
@guoshzhao guoshzhao added the micro-benchmarks Micro Benchmark Test for SuperBench Benchmarks label Sep 19, 2025
@yukirora yukirora merged commit a7c4ed9 into main Sep 19, 2025
30 of 33 checks passed
@yukirora yukirora deleted the yutji/dist-inference-fix branch September 19, 2025 21:18
@guoshzhao guoshzhao mentioned this pull request Oct 2, 2025
30 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmarks SuperBench Benchmarks micro-benchmarks Micro Benchmark Test for SuperBench Benchmarks

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants