Open Access Open Access  Restricted Access Subscription Access

Finger and Hand Tracking with Feedback Simulation for VR and Other Applications

Ali Umar, Basanta Mahto, Sundaram Trpathi

Abstract


The hand gestures are one of the typical methods used in sign language. It is very difficult for the hearingimpaired people to communicate with the world. This project presents a solution that will not only automatically recognize the hand gestures but will also convert it usable output so that anyone can easily communicate with people or other systems. A microcontroller will monitor the condition and outputs of the multiple sensors implemented within the glove and provide output based on the form of communication that is preferred as the end product. The system can recognize gestures as well as provide an output or feedback for the user.


Full Text:

PDF

References


Buckingham, G., Parr, J., Wood, G., Day, S., Chadwell, A., Head, J., ... & Poliakoff, E. (2019). Upper-and lower-limb amputees show reduced levels of eeriness for images of prosthetic hands. Psychonomic Bulletin & Review, 26, 1295-1302.

Buolamwini, J., & Gebru, T. (2018, January). Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency (pp. 77-91). PMLR.

Carlton, B. (2021). HaptX Launches True-Contact Haptic Gloves for VR And Robotics. VRScout.

Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive science, 12(2), 257-285.

Bowman, D. A., Koller, D., & Hodges, L. F. (1997, March). Travel in immersive virtual environments: An evaluation of viewpoint motion control techniques. In Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality (pp. 45-52). IEEE.

Yang, L. I., Huang, J., Feng, T. I. A. N., Hong-An, W. A. N. G., & Guo-Zhong, D. A. I. (2019). Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware, 1(1), 84-112.

Jorge, V. A., Sarmiento, W. J., Maciel, A., Nedel, L., Collazos, C. A., Faria, F., & Oliveira, J. (2013, October). Interacting with danger in an immersive environment: issues on cognitive load and risk perception. In Proceedings of the 19th ACM symposium on virtual reality software and technology (pp. 83-92).

Dean, D., Millward, J., Mulligan, L., Saleh, I., Wise, C., & Higgins, G. (2018, December). Evaluating alternative input techniques for building and construction VR training. In 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) (pp. 1001-1004). IEEE.


Refbacks

  • There are currently no refbacks.