Open Access Open Access  Restricted Access Subscription Access

Recognition of Sign Language using e-CNN

R Vadivel, Lakshmi kanth V S, Kaushik E, Mohan M S M S, Santhosh M

Abstract


Since the majority of people do not understand sign language, there has to be a bridge built so that the community can interact with the visually and verbally impaired. The use of image processing technology as a translation tool is one way that technology that is always improving and working to aid people may be utilized as a solution to build a communication bridge between the community and deaf individuals. Images may be converted into text using image processing. The advancement in digital image processing will make use of the hand key point library, which is a library that will locate the hand in each picture. However, it is well known that image processing needs an algorithm that serves as a classification tool in order to act as a stand-alone data processor. With its ability to recognize a variety of things, the Convolutional Neural Network (CNN) algorithm used in the Deep Learning technique may be used as a classification tool. Additionally, it has been shown in multiple earlier research that mixing several algorithms would boost accuracy.


Full Text:

PDF

References


S. Shahriar et al., "Real-Time American Sign Language Recognition Using Skin Segmentation and Image Category Classification with Convolutional Neural Network and Deep Learning," TENCON 2018 - 2018 IEEE Region 10 Conference, 2018, pp.

W. K. Wong, Filbert H. Juwono, “Multi-Features Capacitive Hand Gesture Recognition Sensor: A Machine Learning Approach”, IEEE SENSORS JOURNAL, VOL. 21, NO. 6, MARCH 15, 2021.

N. Gopinath, J. ANUJA, S. ANUSHA, V. MONISHA , “A Survey on Hand Gesture Recognition Using Machine Learning”, International Research Journal of Engineering and Technology (IRJET) , 2020.

Omkar Vedak, Prasad Zavre, Abhijeet Todkar, Manoj Patil, “Sign Language Interpreter using Image Processing and Machine Learning”, International Research Journal of Engineering and Technology (IRJET), 2019.

Nandy, A.; Prasad, J.; Mondal, S.; Chakraborty, P.; Nandi, G. Recognition of Isolated Indian Sign Language Gesture in Real Time. Commun. Comput. Inf. Sci. 2010, 70, 102–107.

Chen, J.K. Sign Language Recognition with Unsupervised Feature Learning; CS229 Project Final Report; Stanford University: Stanford, CA, USA, 2011.

Jiang, S.; Sun, B.; Wang, L.; Bai, Y.; Li, K.; Fu, Y. Skeleton aware multi-modal sign language recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 21–24 June 2021; pp. 3413–3423.

Liao, Y.; Xiong, P.; Min, W.; Min, W.; Lu, J. Dynamic Sign Language Recognition Based on Video Sequence with BLSTM-3D Residual Networks. IEEE Access 2019, 7, 38044–38054.

Wazalwar, S.S.; Shrawankar, U. Interpretation of sign language into English using NLP techniques. J. Inf. Optim. Sci. 2017, 38, 895–910.

Shivashankara, S.; Srinath, S. American Sign Language Recognition System: An Optimal Approach. Int. J. Image Graph. Signal Process. 2018, 10, 18–30.


Refbacks

  • There are currently no refbacks.