Open Access Open Access  Restricted Access Subscription Access

TOUCHLESS OPERATIONS USING HAND GESTURES DETECTION

Aryan Gupta, Rachna Narula, Parth Garg, Diksha Joshi, Navneet Upadhyay

Abstract


Humans have only recently begun using hand gestures to interact with computers. The integration of the real and digital worlds is the aim of gesture recognition. It is considerably simpler to convey our intentions and ideas to the computer via hand gestures. A simple and efficient touchless method of interacting with computer systems is through hand gestures. However, the limited end-user adoption of hand gesture-based systems is mostly caused by the significant technical challenges involved in successfully identifying in-air movements. Image recognition is one of the many ways that a computer may identify a hand gesture. The ability to recognise human movements is made possible by the deployment of a convolutional neural network (CNN). In this research, we build a straightforward hand tracking technique to operate a Robot Operating System (ROS) based surveillance car with socket programming using Google MediaPipe, a Machine Learning (ML) pipeline that integrates Palm Detection and Hand Landmark Models. In the investigation, steering speed and direction of a ROS automobile are controlled. Vehicles for surveillance that can be operated using hand gestures may help to enhance security measures.

Full Text:

PDF

References


. Al Farid, F.; Hashim, N.; Abdullah, J.; Bhuiyan, M.R.; Shahida Mohd Isa, W.N.; Uddin, J.; Haque, M.A.; Husen, M.N. A Structured and Methodological Review on Vision-Based Hand Gesture Recognition System. J. Imaging 2022, 8, 153. https://doi.org/10.3390/jimaging8060153

Sahoo, J.P.; Prakash, A.J.; Pławiak, P.; Samantray, S. Real-Time Hand Gesture Recognition Using Fine-Tuned Convolutional Neural Network. Sensors 2022, 22, 706. https://doi.org/10.3390/s22030706

Gadekallu, T. R., Srivastava, G., Liyanage, M., M., I., Chowdhary, C. L., Koppu, S., et al. (2022). Hand Gesture Recognition Based on a Harris Hawks Optimized Convolution Neural Network. Comput. Electr. Eng. 100, 107836. doi:10.1016/j.compeleceng.2022.107836

Lim, M., Kotsani, N., & Hartono, P. (2022). Handmate: An Accessible Browser-based Controller for Web Audio and Midi using AI Hand-Tracking. International Conference on New Interfaces for Musical Expression. https://doi.org/10.21428/92fbeb44.40c13869

Khawaritzmi Abdallah AHMAD, Dian Christy SILPANI, Kaori YOSHIDA Hand Gesture Recognition by Hand Landmark Classification Released on J-STAGE: May 31, 2022 https://doi.org/10.5057/isase.2022-C000026

Lu Liu, Wenlong Xu, Yao Ni, Zhipeng Xu, Binbin Cui, Jiaqi Liu, Huanhuan Wei, and Wentao Xu ACS Nano 2022 Stretchable Neuromorphic Transistor That Combines Multisensing and Information Processing for Epidermal Gesture Recognition 16 (2), 2282-2291 DOI: 10.1021/acsnano.1c08482

S. Cai, Z. Lu, L. Guo, Z. Qing and L. Yao, "The LET Procedure for Gesture Recognition With Multiple Forearm Angles," in IEEE Sensors Journal, vol. 22, no. 13, pp. 13226-13233, 1 July1, 2022, doi: 10.1109/JSEN.2022.3177475.

Wang, H., Zhang, Y., Liu, C. et al. sEMG based hand gesture recognition with deformable convolutional network. Int. J. Mach. Learn. & Cyber. 13, 1729–1738 (2022). https://doi.org/10.1007/s13042-021-01482-7

Bhushan, S.; Alshehri, M.; Keshta, I.; Chakraverti, A.K.; Rajpurohit, J.; Abugabah, A. An Experimental Analysis of Various Machine Learning Algorithms for Hand Gesture Recognition. Electronics 2022, 11, 968. https://doi.org/10.3390/electronics11060968

Bhaumik, G., Verma, M., Govil, M.C. et al. HyFiNet: Hybrid feature attention network for hand gesture recognition. Multimed Tools Appl (2022). https://doi.org/10.1007/s11042-021-11623-3


Refbacks

  • There are currently no refbacks.