Indonesian Sign Language Recognition Application For Two-Way Communication Deaf-Mute People

摘要

Communication is a process of sending and receiving information in human life. Human communicate with the others not only by voice, but also by giving information in number of ways. For example, the communication between deaf-mute people with normal person. Deaf-mute people use sign language to send information, ideas, feelings and emotions. But on the other side, normal people have difficulty to understand what they mean and vice versa. This paper aims at eliminating communication distress between them by developing two-way communication with Indonesian Sign Language recognition and interpretation hand gesture into android mobile device. It can be used for deaf-mute people to accomplish two-way communication between them. The developed Bluetooth glove using five flex sensors mounted in each finger and an accelerometer mounted on the index finger. The individual sensor value is obtained as the input to an Arduino Nano that accurately maps it to the Indonesian alphabets and numbers through mapping algorithm to minimize the complexity of the processes. Android application also allow the normal people to send information using speech to text conversion and then it will be converted into gif animation. With that method, communication between deaf-mute people with normal person achieved easily.