Skip to content

feat: WebGPU Backend, UI Overhaul, and Performance Optimizations#71

Open
sergeyplis wants to merge 37 commits intomasterfrom
webgpu
Open

feat: WebGPU Backend, UI Overhaul, and Performance Optimizations#71
sergeyplis wants to merge 37 commits intomasterfrom
webgpu

Conversation

@sergeyplis
Copy link
Copy Markdown
Contributor

@sergeyplis sergeyplis commented Dec 17, 2025 •
edited
Loading

Description: This PR introduces a major upgrade to BrainChop, integrating a WebGPU backend for accelerated inference, refreshing the UI/UX, and significantly optimizing performance and memory usage for large models.

Key Changes
🚀 WebGPU & Inference Backend

  • WebGPU Support: Implemented a full WebGPU backend for faster client-side inference. Huge thanks to @spikedoanz and @wpmed92
  • Smart Fallback: Added logic to automatically attempt progressively "safer" execution modes (WebGPU → WebGL) to ensure stability across devices.
  • Universal Runners: Standardized runners to handle both WebGL and WebGPU contexts seamlessly.
  • Backend Indicator: Added a visual indicator in the UI to show which backend is currently active.

⚡ Performance & Optimization

  • Faster Normalization: Optimized Quantile Normalization to use sampling, significantly reducing pre-processing time.
  • WebGL Memory Management: Improved memory estimation and implemented a "chunked argmax" strategy. This allows large models (e.g., 104-class, 50-class) to run on standard WebGL backends without memory crashes.
  • Stability: Fixed memory leaks to improve reliability during repeated drag-and-drop operations.

🎨 UI/UX Improvements

  • Visual Overhaul: Comprehensive CSS updates, harmonizing toolbar styles, fonts, and spacing.
  • About Section: Added a new "About" window detailing privacy (local processing), keyboard shortcuts (C for Clip, V for View), and model icon legends.
  • Streamlined Interface: Removed the "Clip Plane" checkbox in favor of the 'C' keyboard shortcut to declutter the UI.
  • Visualization: Enforced specific colormaps (Copper) for brain extraction/masking models.

🛠️ Infrastructure & Diagnostics

  • Unified Diagnostics: Centralized diagnostic logging for both WebGL and WebGPU to assist in debugging.
  • Deployment Fixes: Resolved pathing issues (favicon, relative paths) for GitHub Pages deployment.
  • Console Logging: Enabled better console output in production builds for easier troubleshooting.

sergeyplis and others added 27 commits November 10, 2025 19:18
@sergeyplis
multibackend including webgpu
8656705
@sergeyplis
webgpu and successively more economic way to run the models
58dc9e4
@sergeyplis
cosmetics
9b3a64e
@sergeyplis
deploying webgpu to demo
b3e26f8
@sergeyplis
for deployment from github
d0862a5
@sergeyplis
Delete v3 directory
3c312ff
@sergeyplis
Create mindgrab_runner.js
fcd7e73 
mindgrab
@sergeyplis
webgpu runners
8db1d56
@sergeyplis
weights for the 21 channel subcortical model
aae4f0c
@sergeyplis
runners
d4e830e
@sergeyplis
Merge branch 'webgpu' of github.com:neuroneural/brainchop-test into w…
134e18a 
…ebgpu
@sergeyplis
fixing non webgpu runner
16e90f3
@sergeyplis
favicon
08833af
@sergeyplis
treat zero answer as an exception
cb22dfb
@sergeyplis
console logs in production
5b14404
@sergeyplis
backend indicator
2b17e06
@sergeyplis
css overhaul
f6640a5
@sergeyplis
fixing font size and look in the toolbar
e553692
@sergeyplis
mask and brain extraction colors
37f353a
@sergeyplis
memory leak fix to re-enable drag and drop
c034d25
@sergeyplis
better size checks for webgl and faster execution for large class models
bb20db0
@sergeyplis
much faster quantile normalization because of the sampling
aa6ba9c
@sergeyplis
unified and extended diagnostic panel
34a252a
@sergeyplis
new about window
d144fc5
@sergeyplis
fixed diagnostics because of the changes for the about window
153c58a
@sergeyplis
added the missing diagnostics file
cc28560
@sergeyplis
removed the clip plane checkbox (available via keyboard)
a5e8b08
@sergeyplis sergeyplis self-assigned this Dec 17, 2025
@sergeyplis sergeyplis added the enhancement New feature or request label Dec 17, 2025
sergeyplis and others added 10 commits December 17, 2025 19:02
@sergeyplis
root
765caf1
@sergeyplis
fixing the bottom toolbar for cell-phone viewport
4397d64
@sergeyplis
trying another approach
0705c0f
@spikedoanz @claude
Fix WebGPU to WebGL fallback by removing blocking alert
aeeb8d5 
Remove the window.alert() that fires on WebGPU inference failure,
which was blocking the existing fallback chain from proceeding
smoothly. Now shows a non-blocking status message instead.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@spikedoanz @claude
Fix base path for GitHub Pages subdirectory hosting
61a6801 
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@spikedoanz @claude
Use BASE_PATH env var for Vite base to support both custom domain and…
dec3e22 
… GitHub Pages

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@spikedoanz @claude
Fix WebGPU buffer leak that caused intermittent WebGL fallback failures
71f0186 
resources[] was block-scoped inside try{} so the finally{} cleanup never
ran. Moved it to the outer scope so GPU buffers are properly destroyed on
failure. Also added a 1s delay before WebGL fallback to let the GPU release.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@sergeyplis
Merge pull request #74 from spikedoanz/webgpu
7f2d7c7 
cleaner webgl fallback from webgpu
@sergeyplis
Update vite.config.js
6d8dd6a 
rolling back the parameterization that did not work, so it is served correctly
@sergeyplis
Update vite.config.js
ceeaa15 
trying another root to quickly save brainchop
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Girish-Anadv-07 Girish-Anadv-07 Awaiting requested review from Girish-Anadv-07

At least 1 approving review is required to merge this pull request.

Assignees

@sergeyplis sergeyplis

Labels

enhancement New feature or request

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sergeyplis @spikedoanz