GESTURE CALCULATOR CONTROL WITH HANDS AND VOICE

  • Unique Paper ID: 195135
  • Volume: 12
  • Issue: 10
  • PageNo: 6711-6719
  • Abstract:
  • The Gesture Calculator is an advanced human computer interaction system designed to perform basic arithmetic operations using a combination of hand gestures and voice commands. Conventional input methods such as keyboards, mice, and touch interfaces may not always provide a natural or efficient user experience, especially in hands-free or accessibility focused environments. To overcome these limitations, the proposed system introduces a multimodal interaction approach that enhances usability and user engagement. The system employs real-time hand gesture recognition using a vision-based tracking framework to detect and interpret finger movements as numerical inputs. Simultaneously, a speech recognition module processes user voice commands to identify the desired arithmetic operation, such as addition, subtraction, or multiplication. By integrating both visual and auditory inputs, the system enables seamless interaction and improves flexibility in user control. The architecture is implemented using Python, incorporating computer vision techniques for hand detection, speech processing for command interpretation, and text-to-speech functionality for audio feedback. The system continuously captures input from a camera and microphone, processes the data in real time, and displays the computed results on the screen while also providing spoken output for enhanced accessibility. The proposed solution demonstrates reliable performance under standard environmental conditions and highlights the effectiveness of combining gesture and voice modalities. This approach not only simplifies user interaction but also opens new possibilities for applications in assistive technologies, touchless interfaces, and smart computing environments.

Copyright & License

Copyright © 2026 Authors retain the copyright of this article. This article is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

BibTeX

@article{195135,
        author = {CHIRUKURAPATI VENKATA DIVYA SRI and ETHAMUKKALA DEVI SRIYA and B sushma and ch saideepthi},
        title = {GESTURE CALCULATOR CONTROL WITH HANDS AND VOICE},
        journal = {International Journal of Innovative Research in Technology},
        year = {2026},
        volume = {12},
        number = {10},
        pages = {6711-6719},
        issn = {2349-6002},
        url = {https://ijirt.org/article?manuscript=195135},
        abstract = {The Gesture Calculator is an advanced human computer interaction system designed to perform basic arithmetic operations using a combination of hand gestures and voice commands. Conventional input methods such as keyboards, mice, and touch interfaces may not always provide a natural or efficient user experience, especially in hands-free or accessibility focused environments. To overcome these limitations, the proposed system introduces a multimodal interaction approach that enhances usability and user engagement. 
The system employs real-time hand gesture recognition using a vision-based tracking framework to detect and interpret finger movements as numerical inputs. Simultaneously, a speech recognition module processes user voice commands to identify the desired arithmetic operation, such as addition, subtraction, or multiplication. By integrating both visual and auditory inputs, the system enables seamless interaction and improves flexibility in user control. 
The architecture is implemented using Python, incorporating computer vision techniques for hand detection, speech processing for command interpretation, and text-to-speech functionality for audio feedback. The system continuously captures input from a camera and microphone, processes the data in real time, and displays the computed results on the screen while also providing spoken output for enhanced accessibility. 
The proposed solution demonstrates reliable performance under standard environmental conditions and highlights the effectiveness of combining gesture and voice modalities. This approach not only simplifies user interaction but also opens new possibilities for applications in assistive technologies, touchless interfaces, and smart computing environments.},
        keywords = {Gesture Recognition, Voice Recognition, Human Computer Interaction, Multimodal Interface, Computer Vision, Hand Tracking, Speech Processing, Touchless Interaction, Assistive Technology, Realtime Systems.},
        month = {March},
        }

Cite This Article

SRI, C. V. D., & SRIYA, E. D., & sushma, B., & saideepthi, C. (2026). GESTURE CALCULATOR CONTROL WITH HANDS AND VOICE. International Journal of Innovative Research in Technology (IJIRT), 12(10), 6711–6719.

Related Articles