Learn sign language through an immersive Leap Motion-powered 2D platformer, combining education and fun in an interactive Unity experience!
Croak Quest is a 2D platformer game designed to teach players American Sign Language (ASL) in an engaging and interactive way. Leveraging the Leap Motion Controller, players use real-world hand gestures to control the game, creating an educational and immersive experience.
This project was created for nwHacks 2025, where it won the Best Beginner Project award! You can learn more on our Devpost page and watch the demo video.
▶ Click the image to watch the demo on YouTube
- Leap Motion Integration:
- Players perform hand gestures to control in-game movements.
- Responsive character actions mapped to real-life gestures.
- Educational Gameplay:
- Incorporates ASL signs, allowing players to learn as they play.
- Platforming Mechanics:
- Classic 2D platformer gameplay with movement, jumping, and obstacles.
- Unity: Game development engine for creating the 2D platformer.
- C#: Programming language for scripting game mechanics and Leap Motion integration.
- Leap Motion Controller: Hardware for capturing and interpreting real-world hand gestures.
- Git: Version control for collaborative development.
-
Clone the Repository:
git clone https://github.com/julianchen24/Croak-Quest.git cd CroakQuest
-
Setup Leap Motion:
- Ensure the Leap Motion Controller is set up and calibrated. Refer to the Leap Motion Setup Guide.
-
Open the Project in Unity:
- Open Unity Hub and add the project folder.
- Launch the project in Unity Editor.
-
Run the Game:
- Press the Play button in Unity to start the game.
- Controls: Use hand gestures with the Leap Motion Controller to navigate the platformer.
- Educational Focus: Learn and practice ASL signs while advancing through the levels.
- Immersion: Realistic and responsive gesture-based control enhances the experience.
- Julian Chen
- Daniel Ma
- Geoff Jiang
- Aaron Zhang
This project is licensed under the MIT License. Feel free to use, modify, and distribute this project as per the license terms.
All contributions are welcome.