I published the project in which we play the rhythm game by detecting the movements of the player from any camera connected to the computer.
HandSaber is an Open Source project which allows users to control their computer and gaming systems using hand gestures. From controlling your music, to powering up your favorite games, HandSaber lets you wield technology like a Jedi master!
- You just need to a webcam. If you've not a webcam, you can use your phone with pc connection or like a droidcam.
- All menu system is entegrated with cpp
- Easily you can change or add more graphic or other game settings with configuration struct file
- Easily you can add more cube type, wall or similar object. (just inherit the cube base class)
- You can add more sound to game. It will automatically import on game.
- Score color changing with music player percentage. When music ended, score will be red color and game dead screen will come.
- Blue cubes -> One saber slash
- Red cubes -> two saber slash
- Green cubes -> One saber slash + 400 score
- Orange cubes -> One saber slash - 400 score
- Pause game -> press the "q"
- You can change the game settings from the ConfigurationDataStruct.h file.
- Made with Unreal Engine 4.27
- I used to mediapipe for hand recognition
- I used to runtime audio plugin for play, stop or etc. function in runtime
- Due to its size, the entire project could not be loaded. If you want full access to the project, you can download it here. https://drive.google.com/file/d/11Bi6n9NAVaUWr5pYDNSe0tqRjuSCR17R/view?usp=sharing
- I'm not rotating the saber but you can add this function on handsaber. I tried on Unity Engine before this Unreal Engine version aaaand it's working. You can check the video. https://drive.google.com/file/d/1P0AH1Ouhtwm5MCyWmRDnuyCmVo5Nt0dB/view?usp=sharing
- extract file with 7zip or etc.
- Check your default camera settings with windows camera app. If you see yourself that app, your setup is done and you can play. When your hand detect on camera sabers will come your hands.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.