Published on: June 2026
NEURO SEMANTIC INTERFACE
Bhakti Bhole Nikita Varpe Kalyani Patel Vaishnavi Kawtikwar
Prof. Minal Powar
JSCOE , Maharashtra , India
Article Status
Available Documents
Abstract
The approached Android application allows two way communication, it converts sign language into text and speech also producing sign language output for given text using advanced computer vision, machine learning, and Generative AI. This system helps in real-time interaction by converting sign language to text and speech, and also provides text-to-sign language a generation and Android's Text-to-Speech (TTS) system, allowing hearing-impaired individuals to both express themselves and receive information in a preferred format.
Beyond basic translation, the NSI includes high-level semantic processing via Gemini AI, enabling an educational layer and context-aware features.
The system relies on Firebase Cloud Services for real-time data handling and user synchronization. Experimental results indicate high accuracy in gesture recognition and low latency on standard mobile devices. Ultimately, the Neuro Semantic Interface aims to improve user independence and social participation, transforming assistive technology from a basic tool into an intelligent interface that would allow easy and more efficient communication between person with disability and normal person .
Keywords: Sign Language Recognition, Android Application, Computer Vision, Deep Learning, Assistive Technology, Generative AI, Accessibility, Firebase.
How to Cite this Paper
Bhole, B., Varpe, N., Patel, K. & Kawtikwar, V. (2026). Neuro Semantic Interface. International Journal of Creative and Open Research in Engineering and Management, <i>02</i>(6). https://doi.org/10.55041/ijcope.v2i6.299
Bhole, Bhakti, et al.. "Neuro Semantic Interface." International Journal of Creative and Open Research in Engineering and Management, vol. 02, no. 6, 2026, pp. . doi:https://doi.org/10.55041/ijcope.v2i6.299.
Bhole, Bhakti,Nikita Varpe,Kalyani Patel, and Vaishnavi Kawtikwar. "Neuro Semantic Interface." International Journal of Creative and Open Research in Engineering and Management 02, no. 6 (2026). https://doi.org/https://doi.org/10.55041/ijcope.v2i6.299.
Search & Index
References
- Tao et al., “Sign Language Recognition: A Comprehensive Review of Traditional and Deep Learning Approaches, Datasets, and Challenges,” IEEE Access, 2024.
- Naz et al., “SIGNGRAPH: An Efficient and Accurate Pose-Based Graph Convolution Approach Toward Sign Language Recognition,” IEEE Access, vol. 11, pp. 39211–39225, 2023.
- Renjith and N. Manazhy, “Indian Sign Language Recognition: A Comparative Analysis Using CNN and RNN Models,” in Proc. IEEE International Conference on Circuit Power and Computing Technologies (ICCPCT), 2023.
- Liu, J. Wu, Z. Shen, and X. Chen, “Improving End-to-End Sign Language Translation With Adaptive Video Representation Enhanced Transformer,” IEEE Transactions on Circuits and Systems for Video Technology, 2024.
- Maruyama et al., “Word-Level Sign Language Recognition With Multi-Stream Neural Networks Focusing on Local Regions and Skeletal Information,” IEEE Access, vol. 12, pp. 89012–89026, 2024.
Ethical Compliance & Review Process
- •All submissions are screened under plagiarism detection.
- •Review follows editorial policy.
- •Authors retain copyright.
- •Peer Review Type: Double-Blind Peer Review
- •Published on: Jun 23 2026
This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. You are free to share and adapt this work for non-commercial purposes with proper attribution.