A Comprehensive Approach to Sign Language Understanding: Audio-to-Gesture and Gesture-to-Audio Conversion using OpenCV

  • Unique Paper ID: 164123
  • Volume: 10
  • Issue: 12
  • PageNo: 1086-1091
  • Abstract:
  • Communication is a means to express our thoughts and feelings among us. Individuals with hearing and speaking disabilities often find it challenging to communicate with those without such impairments. Numerous research efforts have been undertaken to bridge this gap, including both hardware and software solutions. Dealing with hardware products, however, can be difficult and uncomfortable. Software solutions, on the other hand, focus on enabling impaired individuals to convey their thoughts to others using various methods and technologies. The objective of our project is to establish bidirectional communication, allowing both normal and impaired individuals to interact seamlessly. Our solution comprises two main parts: Firstly, in the gesture-to-audio conversion process, the gesture is initially translated to text through data collection, application, model training, functions, and data processing. Data is collected, and then the text is converted to audio using the 'pytts3' Python library Secondly, the audio is transformed back into a gesture using speech recognition, keyword extraction (NLTK), and the resulting gesture is displayed. This project aims to bridge the communication gap between impaired and normal individuals, making the world a more inclusive and better place to live.

Related Articles

Impact Factor
8.01 (Year 2024)

Join Our IPN

IJIRT Partner Network

Submit your research paper and those of your network (friends, colleagues, or peers) through your IPN account, and receive 800 INR for each paper that gets published.

Join Now

Recent Conferences

NCSEM 2024

National Conference on Sustainable Engineering and Management - 2024 Last Date: 15th March 2024

Submit inquiry