• 10629
  • 13
  • 15
  • 0
  • Help Ukraine

Open Sesame App - Smartphone controlled by head movements

Shared by SesameEnable on 2017-01-24 09:40

About the solution

Sesame creates Hands-Free control technology for mobile devices. The 'Open Sesame' Android app (which can be downloaded in the Google Play Store) enables users to control any app without touching the screen. Sesame works by tracking the user’s head movements using the built-in, front-facing camera on the phone. These tracked movements are combined with cutting-edge computer vision algorithms to create a cursor that appears on the screen of the phone, similar to a cursor you would see on a computer screen.

The on-screen cursor is controlled by the position and movements of a user’s head, and supports even minimal movements. You can operate any and all features of the device that you would normally operate using one finger on screen. Touch, swipe, browse, play, download, and more - it’s all possible with Sesame. .

Voice control is integrated to provide a truly hands-free experience for accessing the device. To turn the phone just say "Open Sesame" and it will wake up and start tracking you.

Sesame's mission is to open a new door for millions who have been left outside the smartphone revolution due to limited or no hand movement. Today the company has already launched several products in this area, and are looking forward to making more products accessible for people with disabilities. It is becoming the “young, fresh and extremely tech-y” company, in an often over-looked and under-served space.

Here is a recent news article written about Sesame:

This solution shall not include mention to the use of drugs, chemicals or biologicals (including food); invasive devices; offensive, commercial or inherently dangerous content. This solution was not medically validated. Proceed with caution! If you have any doubts, please consult with a health professional.

About the author

Sesame started from a serendipitous connection between a high-current engineer, turned quadriplegic 10 years ago, and a young computer vision expert. Oded Ben Dov, the latter, was demonstrating a game on TV that was controlled using head gestures. A day after the phone rings, and on the line is Giora Livne - “Hello, I can’t move my hands or legs, could you make me a smartphone I could use?”

That was the start of Sesame Enable. The two partnered up and set to create the world’s first Touch-Free Smartphone.

Like solution
Close en