Skip to content

feat[scan]: gpu scan#6199

Merged
joseph-isaacs merged 21 commits intodevelopfrom
ji/gpu-scan-2
Jan 29, 2026
Merged

feat[scan]: gpu scan#6199
joseph-isaacs merged 21 commits intodevelopfrom
ji/gpu-scan-2

Conversation

@joseph-isaacs
Copy link
Contributor

@joseph-isaacs joseph-isaacs commented Jan 29, 2026

Added a e2e scan test for a vortex file on the GPU

onursatici and others added 7 commits January 27, 2026 17:43
Signed-off-by: Onur Satici <onursatici@gmail.com>
Signed-off-by: Onur Satici <onur@spiraldb.com>
Signed-off-by: Onur Satici <onur@spiraldb.com>
Signed-off-by: Onur Satici <onur@spiraldb.com>
Signed-off-by: Onur Satici <onur@spiraldb.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
# Conflicts:
#	vortex-array/src/array/mod.rs
#	vortex-array/src/array/visitor.rs
#	vortex-array/src/display/tree.rs
#	vortex-file/src/open.rs
@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Jan 29, 2026

Deploying vortex-bench with  Cloudflare Pages  Cloudflare Pages

Latest commit: 3bdb153
Status: ✅  Deploy successful!
Preview URL: https://e62d2354.vortex-93b.pages.dev
Branch Preview URL: https://ji-gpu-scan-2.vortex-93b.pages.dev

View logs

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@codspeed-hq
Copy link

codspeed-hq bot commented Jan 29, 2026

Merging this PR will degrade performance by 29.9%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 7 improved benchmarks
❌ 11 regressed benchmarks
✅ 1143 untouched benchmarks
🆕 18 new benchmarks
⏩ 1323 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
🆕 WallTime 10M_90pct[10000000] N/A 200.7 µs N/A
🆕 WallTime 1M_10pct[100000] N/A 21.8 µs N/A
🆕 WallTime 1M_10pct[100000] N/A 46.7 µs N/A
🆕 WallTime 1M_90pct[1000000] N/A 29.2 µs N/A
🆕 WallTime 10M_90pct[10000000] N/A 367.1 µs N/A
WallTime u32_values_u8_codes[10M] 133.7 µs 170.9 µs -21.75%
🆕 WallTime 1M_50pct[500000] N/A 22.8 µs N/A
🆕 WallTime 10M_10pct[1000000] N/A 222.9 µs N/A
🆕 WallTime 10M_10pct[1000000] N/A 218.7 µs N/A
🆕 WallTime 10M_90pct[10000000] N/A 368.3 µs N/A
🆕 WallTime 10M_50pct[5000000] N/A 157.9 µs N/A
🆕 WallTime 1M_10pct[100000] N/A 47.3 µs N/A
🆕 WallTime 10M_50pct[5000000] N/A 282.8 µs N/A
🆕 WallTime 10M_10pct[1000000] N/A 137 µs N/A
🆕 WallTime 1M_90pct[1000000] N/A 56.1 µs N/A
🆕 WallTime 10M_50pct[5000000] N/A 280.4 µs N/A
🆕 WallTime 1M_50pct[500000] N/A 52 µs N/A
🆕 WallTime 1M_90pct[1000000] N/A 58.6 µs N/A
🆕 WallTime 1M_50pct[500000] N/A 51.6 µs N/A
Simulation canonical_into_non_nullable[(10000, 1, 0.1)] 48 µs 57.2 µs -16.06%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/gpu-scan-2 (d1da424) with develop (68130ce)2

Open in CodSpeed

Footnotes

  1. 1323 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on develop (1e401b2) during the generation of this report, so 68130ce was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@joseph-isaacs joseph-isaacs changed the title allocators feat[scan]: gpu scan Jan 29, 2026
@0ax1 0ax1 self-requested a review January 29, 2026 10:01
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/feature A new feature label Jan 29, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs marked this pull request as ready for review January 29, 2026 10:17
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) January 29, 2026 10:18
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) January 29, 2026 10:18
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs requested a review from 0ax1 January 29, 2026 10:56
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs merged commit ed75f70 into develop Jan 29, 2026
44 of 47 checks passed
@joseph-isaacs joseph-isaacs deleted the ji/gpu-scan-2 branch January 29, 2026 13:15
use crate::CudaDeviceBuffer;

#[derive(Clone)]
pub struct VortexCudaStream(pub Arc<CudaStream>);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this pub element?

AdamGS pushed a commit that referenced this pull request Feb 2, 2026
Signed-off-by: Onur Satici <onur@spiraldb.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-authored-by: Onur Satici <onursatici@gmail.com>
Co-authored-by: Onur Satici <onur@spiraldb.com>
danking pushed a commit that referenced this pull request Feb 6, 2026
Signed-off-by: Onur Satici <onur@spiraldb.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-authored-by: Onur Satici <onursatici@gmail.com>
Co-authored-by: Onur Satici <onur@spiraldb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants