Skip to content

feat[cuda]: add a cuda stream pool #6205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
0ax1 merged 8 commits into from
Jan 29, 2026

feat[cuda]: add a stream pool

2a4cc78
Select commit
Loading
Failed to load commit list.
Merged

feat[cuda]: add a cuda stream pool #6205

feat[cuda]: add a stream pool
2a4cc78
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis failed Jan 29, 2026

Performance Regression: -29.5%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 8 improved benchmarks
❌ 4 regressed benchmarks
✅ 1167 untouched benchmarks
⏩ 1323 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime 1M_10pct[100000] 21.4 µs 27.1 µs -21.14%
⚡ Simulation canonical_into_non_nullable[(10000, 1, 0.0)] 27.9 µs 24.7 µs +12.88%
⚡ Simulation canonical_into_non_nullable[(10000, 1, 0.01)] 34.2 µs 31.1 µs +10.02%
⚡ Simulation canonical_into_non_nullable[(10000, 10, 0.0)] 285.3 µs 194.1 µs +46.95%
⚡ Simulation canonical_into_non_nullable[(10000, 10, 0.1)] 471.6 µs 380.6 µs +23.91%
❌ Simulation canonical_into_non_nullable[(10000, 100, 0.01)] 2.2 ms 2.9 ms -26.86%
❌ Simulation canonical_into_non_nullable[(10000, 100, 0.1)] 3.7 ms 4.6 ms -18.18%
⚡ Simulation into_canonical_non_nullable[(10000, 10, 0.1)] 461.8 µs 383.9 µs +20.3%
⚡ Simulation canonical_into_non_nullable[(10000, 10, 0.01)] 312.1 µs 221.1 µs +41.2%
⚡ Simulation into_canonical_non_nullable[(10000, 10, 0.01)] 302.8 µs 228.1 µs +32.78%
⚡ Simulation into_canonical_non_nullable[(10000, 10, 0.0)] 276.1 µs 200.6 µs +37.67%
❌ Simulation canonical_into_non_nullable[(10000, 100, 0.0)] 1.9 ms 2.7 ms -29.5%

Comparing ji/fuzz-oom (2a4cc78) with develop (f568de5)

Open in CodSpeed

Footnotes

  1. 1323 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

View more details on CodSpeed HQ