Open Access Open Access  Restricted Access Subscription Access

GestureMath:Free - Form Math Solver

Aaron Sunu A George, Ashin George, Basil Sabu, Premchand C P, Bonia Jose

Abstract


An innovative mathematical tool leveraging gesture-based interaction redefines how calculations are performed, moving away from traditional input methods like keyboards or touchscreens. A cutting-edge system enables users to perform tasks such as writing mathematical expressions, pausing input, clearing the workspace and computing results using intuitive hand gestures. Unlike standard calculators or software that rely on rigid syntax or button-based inputs, this tool offers a more flexible, engaging and inclusive experience. It supports free-form handwriting and accommodates the diverse needs of users, including those with disabilities. The system processes handwritten mathematical expressions in real time, recognizing various handwriting styles and delivering instant results. Additionally, it provides optional step-by-step solutions, enhancing understanding and usability, particularly in educational settings. By offering detailed explanations, it helps students effectively learn complex concepts. Beyond its educational benefits, this tool is well-suited for both professional and everyday use. Real-time feedback and natural interaction transform human-computer engagement for mathematical computations. Designed with accessibility and adaptability in mind, this tool bridges the gap between user needs and technology, ensuring a seamless and inclusive experience for a wide range of audiences. Its gesture recognition and interactive features set a new benchmark for computational tools.


Full Text:

PDF

References


A. S. M. Miah and J. Shin, “Dynamic Hand Gesture Recognition Using Multi-Branch Attention Based Graph and General Deep Learning Model,” IEEE Access, vol. 11, pp. 4703–4714, Jan. 2023.

G. Park, V. K. Chandrasegar and J. Koh, “Accuracy Enhancement of Hand Gesture Recognition Using CNN,” IEEE Access, vol. 11, pp. 26496–26501, Mar. 2023.

D. Zhelezniakov, V. Zaytsev and O. Radyvonenko, “Online Handwritten Mathematical Expression Recognition and Applications: A Survey,” IEEE Access, vol. 9, pp. 38352–38368, Mar. 2021.

Yibo Zhang, Gaoxu Li, "Improving Handwritten Mathematical Expression Recognition via Integrating Convolutional Neural Network With Transformer and Diffusion-Based Data Augmentation", International Journal of Engineering and Technology (IEEE ACCESS), Vol. 12, pp. 67945-67956, May 2024.

P. Ji, J. Feng, F. Ma, X. Wang and C. Li, “Fingertip Detection Algorithm Based on Maximum Discrimination HOG Feature in Complex Background,” IEEE Access, Vol. 11, pp. 3160-3162, January 2023.

F. Erden and A. E. Çetin, “Hand Gesture Based Remote Control System Using Infrared Sensors and a Camera,” IEEE Transactions on Consumer Electronics, Vol. 60, No. 4, pp. 675-677, November 2014.

C. Wang, Z. Liu and S.-C. Chan, “Superpixel-Based Hand Gesture Recognition With Kinect Depth Camera,” IEEE Transactions on Multimedia, Vol. 17, No. 1, pp. 29-31, January 2015.

R. Zahra, A. Shehzadi, M. I. Sharif, A. Karim, S. Azam, F. De Boer, M. Jonkman and M. Mehmood, “Camera-Based Interactive Wall Display Using Hand Gesture Recognition,” Intelligent Systems with Applications, Vol. 19, Article 200262, August 2023.

S. Jeong, J. Jin, T. Song, K. Kwon and J. W. Jeon, “Single-Camera Dedicated Television Control System Using Gesture Drawing,” IEEE Transactions on Consumer Electronics, Vol. 58, No. 4, pp. 1129-1131, December 2012.

Lizao Zhang, Qiuhong Tian, Qionglu Ruan, Zhixiang Shi, “A Simple and Effective Static Gesture Recognition Method Based on Attention Mechanism,” Journal of Visual Communication and Image Representation, Vol. 92, Article 103783, 2023.


Refbacks

  • There are currently no refbacks.