Development of Speaking System for Mute People using MATLAB and Embedded System

Abstract

Communication between a mute and a normal person has always been a difficult task. Manufacturers around the world have expressed various sign language systems but they are not flexible and economical for all people. By using finger positions and hand gestures this smart speaking system will help mute people to communicate with normal people. In this project, the speaking system will be working in two ways. First, it can take input signals from hand gestures by using flex sensors. Second, it can also take input from finger position by using image processing. The system contains of a dataset and many more which aids the mute people to carry primary messages. The setup contains of a single camera to capture the finger position shaped by the user connected with Raspberry pi and take this hand image as a contribution to the planned algorithm and produce the text message as an output. The user will place a finger with a particular action in front of the camera. When a user makes the gestures, the webcam will capture the exact positions of the fingers and perform image processing. The coordinates captured will be mapped with the one previously stored and accordingly exact picture from the dataset will be identified and the output will be processed according to it. The other way through which the user can generate input signal is through the flex sensor which will be connected with Arduino. Arduino will process the text data to an external application through a Bluetooth module and that application will convert the text output in the voice. The need for this framework is to give yield in everyday life through Image handling and hand motion established sign discourse converters for quiet individuals. By utilizing this framework, the quiet individuals would be advanced as they can interface with everybody unreservedly which to be sure would be an extraordinary accomplishment for humankind.