- 8920
- 521
- 11
- 6
- 0
- Help Ukraine
About the solution
Inspired by a deaf friend, Nana Wang and her friend Shuang Huang started developing a solution for people with hearing disorders 2015. After two years of hard work and thousands of experimentations, they successfully developed a gesture recognition armband which recognize the most common 400 gestures from sign language.
Each gesture of the sign language sends different electrical muscle signals. The armband developed by Nana and Shuang collects those signals, analyse through AI deep learning and finally convert them into speech. “It is extremely difficult to accurately recognize a gesture. Usually it requires to collect the signal for a thousand, even several thousand times.” explained the inventors.
"My friend, who is a deaf, told me he once sent a resume and then someone called him. However, he couldn’t answer the phone nor speak anything”, said Nana Wang, a student from Beijing University of Aeronautics and Astronautics.
"In China, there are 70 million people with language dysfunction, for a variety of reasons”, said Shuang Huang, Nana Wang’s friend and roommate in the university, a student from Tsinghua University.
Although currently, the armband can only translate common gestures one by one, the students believe that they will be able to improve it with the fast development of AI. The sign language recognition armband has also won the championship in an innovative competition held by the United Nations and an Internet company. The girls said they are not thinking of making money out of their invention yet, but would be pleased to help more deaf people communicate normally.
Adapted from: https://bit.ly/2MRv2dk
https://bit.ly/2M5hJGU
This solution shall not include mention to the use of drugs, chemicals or biologicals (including food); invasive devices; offensive, commercial or inherently dangerous content. This solution was not medically validated. Proceed with caution! If you have any doubts, please consult with a health professional.
DISCLAIMER: This story was written by someone who is not the author of the solution, therefore please be advised that, although it was written with the utmost respect for the innovation and the innovator, there can be some incorrect statements. If you find any errors please contact the patient Innovation team via info@patient-innovation.com
-
-
222
-
2
-
2805
Student invents glove that translates sign language into text
COMMUNICATION: Communicating, whether by speaking, listening, or other means
Social interaction
Blindness
Visual Impairment
Hearing Disorders
Congenital Deafness
Speech Disorder
App (Including when connected with wearable)
Body-Worn solutions (Clothing, accessories, shoes, sensors...)
5 Senses support devices: (glasses, hearing aids, headphones...)
Vision problems
Difficulty speaking or understanding speech
Hearing loss or ringing in the ears (tinnitus)
Regaining sensory function
Promoting inclusivity and social integration
Improving Speech and Communication
Neurology
Ophthalmology
Otorhinolaryngology
Turkey
-
-
-
370
-
0
-
8852
Pedro, an acoustic engineer designed an open-ear hearable device in order to allow everyone to listen to music!
COMMUNICATION: Communicating, whether by speaking, listening, or other means
Hearing Disorders
5 Senses support devices: (glasses, hearing aids, headphones...)
Assistive Technology access
Body-Worn solutions (Clothing, accessories, shoes, sensors...)
Regaining sensory function
Promoting self-management
Promoting inclusivity and social integration
Improving Speech and Communication
Raise awareness
General and Family Medicine
Internal Medicine
Neurology
Otorhinolaryngology
Denmark
-
-
-
171
-
0
-
2296
Using AI to allow blind people to find familiar faces
COMMUNICATION: Communicating, whether by speaking, listening, or other means
Social interaction
Blindness
5 Senses support devices: (glasses, hearing aids, headphones...)
Body-Worn solutions (Clothing, accessories, shoes, sensors...)
App (Including when connected with wearable)
AI algorithm
Assistive Daily Life Device (to help ADL)
Difficulty communicating with environment
Confusion
Regaining sensory function
Promoting self-management
Promoting inclusivity and social integration
Improving Speech and Communication
Raise awareness
Ophthalmology
Pediatrics
United States
-