Skip to content

SignSense is a real-time American Sign Language (ASL) recognition system that uses computer vision and deep learning to translate hand gestures into text and speech, enabling seamless communication between the deaf and hearing communities.

Notifications You must be signed in to change notification settings

kamalraj2772/SignSense

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Real-Time Sign Language Recognition

This project implements a real-time American Sign Language (ASL) recognition system using a pretrained CNN model and MediaPipe hands detection. The system captures hand gestures through a webcam, predicts the corresponding ASL letter, and constructs sentences dynamically. It also includes speech synthesis to read the constructed sentence aloud.


Features

  • Real-time hand gesture detection using MediaPipe Hands
  • CNN-based ASL alphabet classification with a custom pretrained model (models/asl_cnn.pth)
  • Sentence construction from sequential ASL letter predictions
  • Speech synthesis to read the sentence aloud (using gTTS and pygame)
  • Clear sentence functionality with a keypress
  • GPU support for faster model inference if CUDA is available
  • Logs predictions and sentences to a log file for debugging and training analysis

Getting Started

Prerequisites

  • Python 3.8 or above
  • GPU with CUDA support (optional but recommended for faster inference)
  • Webcam

Python Packages

Install required dependencies:

pip install -r requirements.txt

About

SignSense is a real-time American Sign Language (ASL) recognition system that uses computer vision and deep learning to translate hand gestures into text and speech, enabling seamless communication between the deaf and hearing communities.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages