Seeing AI

Seeing AI, a complimentary application designed with and for the blind and low vision community, serves as an ongoing research project aimed at utilizing the power of artificial intelligence to provide narrations of the surrounding visual world, encompassing descriptions of nearby people, text, and objects.

This innovative app offers a range of tools to assist with various daily tasks:

1)Short Text: Instantly vocalizes text as it appears in front of the camera.

2)Documents: Offers audio guidance for capturing printed pages, recognizing text, and maintaining original formatting. Additionally, users can inquire about the contents to easily locate desired information.

3)Products: Utilizes audio beeps to guide users in scanning barcodes or Accessible QR codes, providing information such as product names and package details.

4)Scenes: Provides an overall description of captured scenes, with the option to access richer descriptions by tapping "More Info." Users can also explore photos by swiping their finger over the screen to hear the location of different objects.

5)People: Enables the saving of people's faces for recognition purposes, along with estimations of their age, gender, and expression.

6)Currency: Recognizes currency notes.

7)Colors: Identifies colors.

8)Handwriting: Reads handwritten text, such as that found in greeting cards (available in select languages).

9)Light: Generates an audible tone corresponding to the brightness of the surroundings.

10)Images in other apps: Users can simply tap "Share" and "Recognize with Seeing AI" to describe images from various apps like Mail, Photos, and Twitter.

Seeing AI continually evolves based on feedback from the community and advancements in AI research.

For tutorials and further details, visit our YouTube playlist at http://aka.ms/SeeingAIPlaylist and our website at http://SeeingAI.com.

For questions, feedback, or feature requests, feel free to email us at SeeingAI@Microsoft.com.

What's New in the Latest Version 1.1

Last updated on Apr 3, 2024

Ask questions about photos (English only) - You can now ask Seeing AI questions about photos on the Scene channel, or those shared from another app.

Rich image descriptions, when you tap "More Info", have been improved to include even more details. Additionally, the names of people you have taught Seeing AI to identify are now included.

We have added 14 new languages, bringing the total to 33.