โ Sign Language Recognition Using MNIST Hand Gesture Dataset ๐ค๐
Sign-Language-Recognition-Using-MNIST-Hand-Gesture-Dataset is a computer vision and deep learning project that recognizes American Sign Language (ASL) hand gestures using the MNIST Hand Gesture Dataset. The project demonstrates how Convolutional Neural Networks (CNNs) can be applied to empower communication accessibility for the deaf and hard-of-hearing community.
โจ Key Features
โ Gesture Recognition: Classify hand signs into ASL alphabet letters (AโZ, excluding J and Z due to motion)
๐ผ๏ธ Dataset: Trained on the MNIST Hand Gesture Dataset (image-based labeled hand signs)
๐งน Preprocessing: Grayscale normalization, resizing, and data augmentation for robustness
๐ง Deep CNN Models: Custom CNNs and pretrained models (VGG16, ResNet, MobileNet)
๐ Performance Metrics: Accuracy, Precision, Recall, F1-score, Confusion Matrix
๐ Visualization: Training/validation curves, heatmaps, and Grad-CAM to show model focus
๐ Real-Time Demo: Deployable web app for live gesture recognition (via webcam)
๐งฐ Tech Stack
Programming: Python ๐
Deep Learning: TensorFlow / Keras or PyTorch
Libraries: NumPy, Pandas, OpenCV, Matplotlib, Seaborn, Scikit-learn
Deployment (Optional): Flask, Streamlit, FastAPI
๐ Project Structure ๐ dataset/ # MNIST Hand Gesture Dataset ๐ preprocessing/ # Data cleaning & augmentation scripts ๐ models/ # CNN and pretrained architectures ๐ notebooks/ # Jupyter notebooks for training & evaluation ๐ results/ # Metrics, plots & Grad-CAM visualizations ๐ app/ # Web app for real-time sign recognition
๐ Getting Started git clone https://github.com/yourusername/Sign-Language-Recognition-Using-MNIST-Hand-Gesture-Dataset.git cd Sign-Language-Recognition-Using-MNIST-Hand-Gesture-Dataset pip install -r requirements.txt jupyter notebook
๐ Use Cases
๐ง Accessibility: Helps bridge communication gaps for the deaf community
๐ฑ Applications: Integration into mobile apps for real-time sign recognition
๐ซ Education: Assisting learners in practicing ASL alphabets
๐ค Research: Benchmark for applying CNNs in gesture and pattern recognition
๐ค Contributing
Contributions are welcome! You can add more architectures, improve dataset preprocessing, or expand to full ASL word recognition.
๐ License
MIT License โ Free to use for research, learning, and open-source development.
โญ Support
If you find this project valuable, please give it a star โญ to support open-source work in AI for accessibility.