Gesture Controlled Scroll 🖐️
A Chrome Extension for hands-free navigation on YouTube Shorts, Instagram Reels, and ALL other websites using on-device hand gesture recognition!
- Hands-Free Scrolling: Navigate through YouTube Shorts, Instagram Reels, and vertically scroll any website just by moving your pointer finger!
- On-Device Processing: Powered by MediaPipe, all gesture recognition happens locally in your browser. No images are sent to the cloud.
- Low Latency & High Accuracy: Smooth EMA filtering and a robust state machine for responsive gesture detection.
- Privacy-First: Operates seamlessly without needing server-side processing, ensuring your privacy.
-
Clone the repository:
git clone https://github.com/mspandey/gesture-controlled-scroll.git
-
Navigate to the directory & Install dependencies:
cd gesture-controlled-scroll npm install -
Build the extension:
npm run build
-
Load the extension in Chrome:
- Open Chrome and navigate to
chrome://extensions/. - Enable Developer mode in the top right corner.
- Click on Load unpacked and select the
distfolder generated by the build step.
- Open Chrome and navigate to
- Click on the extension icon to open the popup.
- Toggle Enable Gesture Scroll to turn on the extension.
- Choose your preferred Handedness (Right, Left, or Either).
- Point your index finger up to scroll up, and point your index finger down to scroll down on any supported feed or generic webpage.
- Watch the magic happen!
- TypeScript for robust typing.
- MediaPipe Hands for state-of-the-art hand tracking.
- esbuild for fast compilation and bundling.