Development of full duplex intelligent communication system for deaf and dumb people

摘要

Sign language is the only essential communicating tools, for deaf and dumb people. To ensure an independent life for hearing impaired and mute people, the automatic interpretation of sign language is an extensive era of research. Using sign languages, deaf and mute people can communicate among themselves but they find it tough to face the outside world. The aim of the proposed system is to make a dual way communication system between deaf-dumb and normal people. The paper presents a vision based approach where continuous sequences of frames of dynamic hand gestures have been taken. Preprocessing, Segmentation, Feature Extraction and Classification these four are the main steps to recognize dynamic hand gestures of ISL words. After that, dual way communication is performed. In that, first the recognized gesture has converted into text message and voice format, so that normal person can understand it. Second, voice has converted into text message and its corresponding gesture, so that physically impaired humans can understand it. Hence, the proposed system can definitely breaks the barrier between deaf-dumb and normal people.