Sign Language Conversion To Text And Speech Using Machine Learning
Author(s):
Chilakala Venkata Shritha Reddy, Anitha M, Annanya P, Hargun Kour, Mangala H S
Keywords:
Sign Language, Machine Learning, Hand gestures, Hearing-Impaired, Convolutional Neural Networks, User-Centric Experience, Scalability, Sustainability.
Abstract
The "Sign Language Conversion to text and speech using machine learning" initiative tackles the urgent need for improved communication within this community by introducing an innovative system designed to convert sign language into text and speech. Leveraging state-of-the-art technologies, the system integrates computer vision techniques for real-time sign language gesture detection, employing Convolutional Neural Networks (CNNs) to adapt to diverse signing styles. The multi-stage methodology involves precise gesture recognition, mapping gestures to linguistic components using sequence-to-sequence models, and refining textual output through Natural Language Processing (NLP) techniques. The system further incorporates a sophisticated text-to-speech synthesis module, prioritizing prosody, intonation, and emotion to convey the expressive nature of sign language. The overall methodology ensures not only accuracy and real-time processing but also adaptability to different sign language variants. Promising outcomes are observed, with the system proving effective in overcoming communication barriers, as affirmed by user feedback and evaluations from the Deaf and Hard of Hearing community. The results highlight the system's accuracy, real-time processing capabilities, and its potential to foster inclusive interactions, making it a significant advancement in addressing the communication needs of this community.
Article Details
Unique Paper ID: 162143

Publication Volume & Issue: Volume 10, Issue 8

Page(s): 56 - 60
Article Preview & Download


Share This Article

Conference Alert

NCSST-2023

AICTE Sponsored National Conference on Smart Systems and Technologies

Last Date: 25th November 2023

SWEC- Management

LATEST INNOVATION’S AND FUTURE TRENDS IN MANAGEMENT

Last Date: 7th November 2023

Go To Issue



Call For Paper

Volume 10 Issue 1

Last Date for paper submitting for March Issue is 25 June 2023

About Us

IJIRT.org enables door in research by providing high quality research articles in open access market.

Send us any query related to your research on editor@ijirt.org

Social Media

Google Verified Reviews