- 2152
- 160
- 3
- 4
- 0
- Help Ukraine
About the solution
When Martin Grayson and Ed Cutrell followed a group of athletes and spectators with varying levels of vision on a trip from the United Kingdom to the 2016 for the Paralympic Games in Rio de Janeiro, Brazil, they began to pick up on clues that, even though there were a number of these athletes that could not see, an enriched understanding of social context was instilled on them, but unfortunately they could not seek the social cues necessary to perform this social interaction in the best way.
By observing how they interacted with other people, and even how they navigated through airports, attended a multitude of sporting venues, and even went sightseeing, this allowed the two collaborators to hoist key elements of social interaction, beginning with a very nuanced and elaborate sense of social understanding, which allows humans to modulate the way on how to interact with other people. Getting a sense of who is in the room, what they are doing, what is their relationship, and even if they are relevant to the person becomes an essential part of human interaction, which is stripped away from blind people.
With the help of Peter Bosher, an audio engineer who has been blind most of his life, the concept of a technology that provided information about the people around him resonated immediately, and thus project Tokyo was born with a partnership among researchers in the U.S., U.K., China, Japan, and India. By using HoloLens, these developers constructed a computer vision algorithm that provides varying levels of information about who is wherein the user’s environment. One model, for example, detects the pose of people in the environment, which provides a sense of where and how far away people are from the user, while another analyzes the stream of photos from the high-resolution camera to recognize people and determine if they have opted to make their names known to the system. All this information is relayed to the user through audio cues. There is also a LED strip fixed above the band of cameras which tracks the person closest to the user and turns green when the person has been identified to the user. Thus allowing partners or bystanders to know they’ve been seen, making it more natural to initiate a conversation.
Adapted from https://news.microsoft.com/innovation-stories/project-tokyo/
Learn more about the Project Tokyo and his developer here https://www.microsoft.com/en-us/research/people/cutrell/
DISCLAIMER: This story was written by someone who is not the author of the solution, therefore please be advised that, although it was written with the utmost respect for the innovation and the innovator, there can be some incorrect statements. If you find any errors please contact the patient Innovation team via info@patient-innovation.com or at carolina.piedade@patient-innovation.com directly.
This solution shall not include mention to the use of drugs, chemicals or biologicals (including food); invasive devices; offensive, commercial or inherently dangerous content. This solution was not medically validated. Proceed with caution! If you have any doubts, please consult with a health professional.
DISCLAIMER: This story was written by someone who is not the author of the solution, therefore please be advised that, although it was written with the utmost respect for the innovation and the innovator, there can be some incorrect statements. If you find any errors please contact the patient Innovation team via info@patient-innovation.com
-
-
215
-
2
-
2666
Student invents glove that translates sign language into text
COMMUNICATION: Communicating, whether by speaking, listening, or other means
Social interaction
Blindness
Visual Impairment
Hearing Disorders
Congenital Deafness
Speech Disorder
App (Including when connected with wearable)
Body-Worn solutions (Clothing, accessories, shoes, sensors...)
5 Senses support devices: (glasses, hearing aids, headphones...)
Difficulty speaking or understanding speech
Hearing loss or ringing in the ears (tinnitus)
Vision problems
Regaining sensory function
Promoting inclusivity and social integration
Improving Speech and Communication
Neurology
Ophthalmology
Otorhinolaryngology
Turkey
-
-
-
375
-
0
-
6067
Developer creates smart glove to help his deaf niece to communicate
COMMUNICATION: Communicating, whether by speaking, listening, or other means
Social interaction
Congenital Deafness
5 Senses support devices: (glasses, hearing aids, headphones...)
Body-Worn solutions (Clothing, accessories, shoes, sensors...)
App (Including when connected with wearable)
Promoting self-management
Promoting inclusivity and social integration
Improving Speech and Communication
Otorhinolaryngology
Kenya
-
-
-
415
-
1
-
9454
Man invents wristband to help deaf people be more aware of their surroundings
COMMUNICATION: Communicating, whether by speaking, listening, or other means
Social interaction
Congenital Deafness
Assistive Daily Life Device (to help ADL)
5 Senses support devices: (glasses, hearing aids, headphones...)
AI algorithm
Cognitive impairment
Confusion
Difficulty speaking or understanding speech
Sensory disturbances (e.g., hypersensitivity to touch, temperature changes)
Regaining sensory function
Promoting inclusivity and social integration
Improving Speech and Communication
Otorhinolaryngology
South Africa
-