Abhishek Deshmukh
Independent Researcher & Nashik, Maharashtra, India
DOI : https://doi.org/10.47191/ijmra/v7-i09-41Google Scholar Download Pdf
ABSTRACT:
The challenge of communication for the deaf and mute community continues to pose a barrier in connecting with society. Sign language, a manual communication method, has emerged as an essential tool for this group, yet it remains largely unrecognized by the majority of the population. This research proposes a machine learning-based Indian Sign Language (ISL) detection system utilizing Convolutional Neural Networks (CNN) to bridge this gap. The system is designed to automatically recognize hand gestures representing ISL alphabets in real-time through a camera interface. Key steps include image preprocessing, gesture detection, and classification using a trained CNN model, followed by deployment on mobile platforms via TensorFlow Lite integrated with Flutter. This approach ensures the model is lightweight yet capable of delivering high accuracy in real-world settings. The model achieves impressive results, with accuracy levels exceeding 90% in predicting hand gestures. The application is user-friendly, enabling anyone with a smartphone to recognize ISL symbols and assist in communication with the deaf-mute community. This paper discusses the implementation, performance, and potential extensions of the system, positioning it as an effective tool for improving communication accessibility.
KEYWORDS:Indian Sign Language Recognition, Convolutional Neural Networks (CNN), Real-Time Gesture Detection, Mobile Application Integration, TensorFlow Lite, Sign Language Translation
REFERENCES1) B. L. Loeding, S. Sarkar, A. Parashar, and A. I. Karshmer, "Progress in automated computer recognition of sign language," Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 3118, 2004
2) A. Er-Rady, R. Faizi, R. O. H. Thami, and H. Housni, "Automatic sign language recognition: A survey," presented at the Proc. - 3rd Int. Conf. Adv. Technol. Signal Image Process. ATSIP 2017, vol. 9, pp. 1-7, 2017
3) B. Bauer and K. Kraiss, "Towards an Automatic Sign Language Recognition System Using Subunits," presented at the International Gesture Workshop (pp. 64-75). Springer, Berlin, Heidelberg, 2002.
4) R. Gross and V. Brajovic, "An Image Preprocessing Algorithm for Illumination Invariant Face Recognition," presented at the International Conference on Audio-and Video-Based Biometric Person Authentication Springer, Berlin, Heidelberg. vol.3, no. 5, 2018
5) D. Kaur and Y. Kaur, "International Journal of Computer Science and Mobile Computing Various Image Segmentation Techniques: A Review," International Journal of Computer Science and Mobile Computing, 3(5), pp.809-814.
6) S. Joudaki, D. B. Mohamad, T. Saba,., A. Rehman., M. AIRodhaan, and A. Al-Dhelaan, "Vision-Based Sign Language Classification: A Directional Review VisionBased Sign Language Classification: A Directional Review," IETE Tech. Rev., vol. 31, no. 5, pp. 383-391, 2014
7) G. Tofighi, SA. Monadjemi, and N. GhasemAghaee, "Rapid Hand Posture Recognition Using Adaptive Histogram Template of Skin and Hand Edge Contour."2010 6th Iranian Conference on Machine Vision and Image Processing (pp. 1-5). IEEE.
Volume 07 Issue 09 September 2024
There is an Open Access article, distributed under the term of the Creative Commons Attribution – Non Commercial 4.0 International (CC BY-NC 4.0) (https://creativecommons.org/licenses/by-nc/4.0/), which permits remixing, adapting and building upon the work for non-commercial use, provided the original work is properly cited.
Our Services and Policies
Authors should prepare their manuscripts according to the instructions given in the authors' guidelines. Manuscripts which do not conform to the format and style of the Journal may be returned to the authors for revision or rejected.
The Journal reserves the right to make any further formal changes and language corrections necessary in a manuscript accepted for publication so that it conforms to the formatting requirements of the Journal.
International Journal of Multidisciplinary Research and Analysis will publish 12 monthly online issues per year,IJMRA publishes articles as soon as the final copy-edited version is approved. IJMRA publishes articles and review papers of all subjects area.
Open access is a mechanism by which research outputs are distributed online, Hybrid open access journals, contain a mixture of open access articles and closed access articles.
International Journal of Multidisciplinary Research and Analysis initiate a call for research paper for Volume 07 Issue 12 (December 2024).
PUBLICATION DATES:
1) Last Date of Submission : 26 December 2024 .
2) Article published within a week.
3) Submit Article : editor@ijmra.in or Online
Why with us
1 : IJMRA only accepts original and high quality research and technical papers.
2 : Paper will publish immediately in current issue after registration.
3 : Authors can download their full papers at any time with digital certificate.
The Editors reserve the right to reject papers without sending them out for review.
Authors should prepare their manuscripts according to the instructions given in the authors' guidelines. Manuscripts which do not conform to the format and style of the Journal may be returned to the authors for revision or rejected. The Journal reserves the right to make any further formal changes and language corrections necessary in a manuscript accepted for publication so that it conforms to the formatting requirements of the Journal.