A real-time hand gesture tracking app for Linux Wayland using a webcam.
It shows a virtual cursor and gesture labels but does not send real mouse input.
Great for research, training models, and prototyping gesture-based UIs.
- Virtual cursor follows the index fingertip
- Gesture recognition:
- Left Click (visual) → index finger near thumb
- Right Click (visual) → index finger near middle finger
- Double Click (visual) → multiple fingers close
- Move Cursor → free movement of index finger
- On-screen feedback:
- Colored circle = cursor position
- Text = detected gesture + FPS counter
- Works in real time with PyQt5 + OpenCV
- Optimized for Wayland desktops on Linux
Install dependencies:
pip install opencv-python mediapipe PyQt5- Move Cursor → move index finger freely
- Left Click (visual) → bring index finger close to thumb
- Right Click (visual) → bring index finger close to middle finger
- Double Click (visual) → touch index and middle finger
The app opens a window with the camera feed, showing gestures and the virtual cursor.
- Only visual feedback is provided — no real mouse actions.
- Works best with bright lighting and clear hand visibility.
- Made for learning, experimentation, and demos.