Open Access Open Access  Restricted Access Subscription Access

Smart Voice and Gesture Controlled WheelChair with IOT-Based Emergency Alert And Obstacle Detection System

Thanneeru. Durga Rao, S. Jabeena, G. Lavanya, J. Poojitha, M. Deepika, G. Renuka

Abstract


In this project, a Gesture and Voice Control Smart Wheelchair using ESP32 with an IoT-based Emergency Alert and Obstacle Detection System is developed to assist elderly and physically challenged individuals to enable safe and independent mobility. The ESP32 microcontroller is used as the main controller to integrate gesture control, voice control, motor control, obstacle detection, and IoT communication. The hand gestures are detected using an MPU6050 sensor, which will be used to control the movement of the wheelchair, i.e., forward, backward, left, right, and stop. The offline VC02 voice recognition module will be used for voice commands to operate the movements and emergency stops. In case of emergency, a notification will be sent to the user’s mobile phone using the Blynk IoT cloud. The system also has voice control for lighting. Ultrasonic sensors are used for detecting obstacles in front and at the back, and they stop the wheelchair and sound a buzzer if objects are too close. The DC motors are controlled by an L293D IC, ensuring smooth motion. RTOS has been used for multitasking, allowing efficient and reliable operation.


Full Text:

PDF

References


Usman Masud et al., “Smart wheelchair controlled through a vision-based autonomous system,” IEEE Access, 2024.

W. Benayed and M. S. Masmoudi, “Voice-controlled autonomous navigation for smart wheelchairs,” Scientific Reports, 2026.

Md. Asiful Islam et al., “AI-IoT based smart wheelchair with gesture control and obstacle detection,” arXiv, 2026.

J. V. Pavan Chand et al., “Intelligent wheelchair using voice, touch and gesture control,” ICCIP, 2022.

Md. Asiful Islam et al., “An AI-IoT Based Smart Wheelchair with Gesture-Controlled Mobility and Deep Learning-Based Obstacle Detection,” arXiv, 2026.

J. V. Pavan Chand and S. Sowmika, “Intelligent Wheelchair Using Voice, Touch and Gesture Control by Smartphone,” Proc. ICCIP, 2022.

Ali Abed, “Design of Voice Controlled Smart Wheelchair,” Int. Journal of Computer Applications, 2015.

Y. Rama Krishna et al., “Hand Gesture Controlled Smart Wheelchair with Fall Detection Alarm,” Int. Journal of Digital Electronics, 2025.

Usman Masud et al., “Smart Wheelchair Controlled Through a Vision-Based Autonomous System,” IEEE Access, 2024.

G. N. Sagar et al., “Smart Wheelchair Control Using Voice and Gesture Control,” IJNRD, vol. 11, no. 1, 2026.


Refbacks

  • There are currently no refbacks.