About the solution
Inspired by a deaf friend, Nana Wang and her friend Shuang Huang started developing a solution for people with hearing disorders 2015. After two years of hard work and thousands of experimentations, they successfully developed a gesture recognition armband which recognize the most common 400 gestures from sign language.
Each gesture of the sign language sends different electrical muscle signals. The armband developed by Nana and Shuang collects those signals, analyse through AI deep learning and finally convert them into speech. “It is extremely difficult to accurately recognize a gesture. Usually it requires to collect the signal for a thousand, even several thousand times.” explained the inventors.
"My friend, who is a deaf, told me he once sent a resume and then someone called him. However, he couldn’t answer the phone nor speak anything”, said Nana Wang, a student from Beijing University of Aeronautics and Astronautics.
"In China, there are 70 million people with language dysfunction, for a variety of reasons”, said Shuang Huang, Nana Wang’s friend and roommate in the university, a student from Tsinghua University.
Although currently, the armband can only translate common gestures one by one, the students believe that they will be able to improve it with the fast development of AI. The sign language recognition armband has also won the championship in an innovative competition held by the United Nations and an Internet company. The girls said they are not thinking of making money out of their invention yet, but would be pleased to help more deaf people communicate normally.
This solution shall not include mention to the use of drugs, chemicals or biologicals (including food); invasive devices; offensive, commercial or inherently dangerous content. This solution was not medically validated. Proceed with caution! If you have any doubts, please consult with a health professional.
Student invents Braille glove for deaf people
Feelif is a multimedia device for blind and visually impaired people
App to help deaf people communicate
Sudden hearing loss
Congenital hearing disorder
Hearing disorders congenital
Hearing disorders NEC
Using communication devices and techniques