• 5575
  • 4
  • 2
  • 0
  • Help Ukraine

Be My Eyes – App to help visually impaired people

Shared by Ana Duarte on 2015-12-26 09:15

About the solution

The concept for Be My Eyes originated from heartfelt conversations with blind friends who relied on the FaceTime feature of their iPhones to seek guidance from sighted individuals. However, they often faced the challenge of ensuring their friends were available and willing to assist them at any given time.

Since its inception in 2015, Be My Eyes has garnered remarkable support, with over 6 million volunteers registering through the app to offer their services to blind users. The overwhelming response from these volunteers exemplifies the power of human connection and the willingness to lend a helping hand. Notably, the platform has also witnessed substantial participation from the blind and low-vision community, with approximately 500,000 individuals signing up to Be My Eyes. This staggering number showcases the vital role the app plays in empowering and enhancing the daily lives of visually impaired individuals.

Recognizing the potential for further innovation, Be My Eyes embarked on a journey to enhance their services by integrating cutting-edge technology. In early February 2023, the company started beta-testing a revolutionary feature backed by GPT technology, with a small group of employees. The test results were nothing short of extraordinary, surpassing all expectations. The overwhelmingly positive outcomes have paved the way for the imminent release of this groundbreaking feature to the wider user base within a matter of weeks.

In an exciting development since March 2023, Be My Eyes has introduced a groundbreaking addition to its volunteer network—the Virtual Volunteer tool, powered by ChatGPT4. Building upon the remarkable capabilities of the GPT-4 language model, Be My Eyes set out to create a sophisticated Virtual Volunteer™ that could emulate the context and understanding of a human volunteer. This state-of-the-art technology is equipped with a dynamic image-to-text generator, enabling it to analyze visual inputs and provide instantaneous and comprehensive assistance.

With the integration of the Virtual Volunteer feature into the existing Be My Eyes app, users can now seamlessly submit images to an AI-powered assistant. The Virtual Volunteer responds promptly, offering detailed descriptions and answering any questions related to the images. This transformative functionality provides blind individuals with an unprecedented level of visual assistance for an extensive array of tasks, contributing to their independence and confidence in navigating the world around them.

Adapted from:
https://openai.com/customer-stories/be-my-eyes
http://www.bemyeyes.org/
https://www.youtube.com/watch?v=d5tgRRJfRBU

This solution shall not include mention to the use of drugs, chemicals or biologicals (including food); invasive devices; offensive, commercial or inherently dangerous content. This solution was not medically validated. Proceed with caution! If you have any doubts, please consult with a health professional.

DISCLAIMER: This story was written by someone who is not the author of the solution, therefore please be advised that, although it was written with the utmost respect for the innovation and the innovator, there can be some incorrect statements. If you find any errors please contact the patient Innovation team via info@patient-innovation.com

About the author

Hans Jørgen Wiberg, born in Denmark, in 1965, suffers from tunnel vision. He is the co-funder of BeMyEyes, a company that produces a mobile app designed to help those who are blind or visually impaired by connecting them with sighted helpers. To do this the user makes a video-call to volunteer who would then be able to assist with their task. Examples of use could be navigating a new area or simply just reading a label at a supermarket.

Like solution
Close en
Close