July 15, 2017

New App for iOS Reads Text and Describes the World


New App for iOS Reads Text and Describes the World

Microsoft has released a free app using amazing new technology to assist blind people. It’s called Seeing AI: Talking camera for the blind.
The app harnesses the power of Artificial Intelligence (AI) to narrate the world around the user by describing nearby people, text and objects. Once it is downloaded, the user simply points the device’s camera at another person, and it will describe them.
Seeing AI can also read test aloud that appears on screen. It can help someone who is visually impaired listen to text from a book, find grocery items on the store shelf, and much more.
The app is optimized for use with VoiceOver and helps recognize:

  • People – stores people’s faces so you can recognize them later. The app gives an estimate of their age, gender and emotions.
  • Short text – speaks text as soon as it appears in front of the camera.
  • Documents – gives audio guidance to capture a printed page for reading by VoiceOver.
  • Products – lets the user scan barcodes with the assistance of audio beeps to guide them. The name of the product as well as package information can be heard.
  • Scenes – speaks an overall description of the user’s surroundings.
  • Images in other apps – tap “Share” and “Recognize with Seeing AI” to hear descriptions of images from Mail, Photos, social media apps, and more.

Seeing AI uses technology similar to self-driving cars and drones. Most of the app’s functions are executed right on the user’s gadget, but some of the more elaborate ones need a connection to the cloud.
At this time, Seeing AI is available only for iOS devices. There is no word on when it will be available for Android. Click here to download the free app for iOS.

We offer resources and free materials for those living with low vision.

View Resources