Signify (Prototype AI model)

By: Md Kashfi Or Rashid Pranta, Hasrat Buttar
Course: IAT 360 Exploring Artificial Intelligence: Its Use, Concepts, and Impact

Description: Signify is a prototype AI system that translates American Sign Language (ASL) gestures into real-time text. Using a YOLO-based recognition model (gesture recognition model) and FastText AI, it streamlines communication by accurately recognizing gestures and predicting words, enhancing accessibility for ASL users.

This project, "Real-Time Hand Gesture to Text Conversion System," was built to address the communication barriers faced by individuals who rely on American Sign Language (ASL). It is an advanced development of our initial ASL gesture recognition project, integrating a YOLO-based gesture recognition model with a FastText language model. The project includes:

1. Re-trained gesture recognition model using an expanded dataset from Kaggle.
2. Language prediction model (FastText) for word suggestions.
3. A Graphical User Interface (GUI) for real-time interaction.
4. A React Native prototype simulating mobile deployment.

The project tackles the challenge of converting ASL gestures into text while enhancing text output with predictive capabilities, enabling seamless and inclusive communication.

Demo: