Supervisor Elham AbolFateh
Editor in Chief Mohamed Wadie

Microsoft Launches AI App to Assist Visually Impaired


Sun 10 Dec 2023 | 07:25 PM
Israa Farhan

Microsoft, the American technology and software giant, has introduced a version of its visually impaired and low-vision assistance app using artificial intelligence (AI) called "Seeing AI" to work with the Android operating system for smart devices.

Microsoft has indicated that the app can be downloaded from the Play Store and operates in 18 languages, with plans to support 36 languages in the coming year.

The "Seeing AI" app describes the surroundings and objects to the user audibly, aiming to assist the visually impaired and those with low vision in tasks such as reading email messages, identifying products, and hearing image descriptions.

Users simply point their smartphone camera in any direction, and the app describes the content of the image captured by the camera.

The specialized technology news site "CNET" noted that the app includes various categories for diverse tasks.

For instance, the "Short Text" feature reads out loud any text placed in front of the camera.

The "People" feature identifies individuals in the user's vicinity when the camera detects their faces. The "Currency" feature helps in identifying different banknotes that the user handles.

The "Scene" feature allows users to hear a description of a place where a photograph was taken. Users can also move their finger across the screen while viewing an image to understand the location of various elements within it.

Furthermore, the "Seeing AI" app can read handwritten texts and identify colors.

It's worth noting that the "Seeing AI" app is currently available for iPhones and iPads running the iOS operating system.

At the same time, both the Android and iOS versions feature updated functionalities such as more detailed image descriptions and the option to ask questions about any document scanned, like the contents of a menu or the price of an item on a bill. Users can also request a summary of any article from the app.

Microsoft's commitment to expanding the accessibility of its technology through AI-driven applications like "Seeing AI" demonstrates its dedication to enhancing the lives of people with visual impairments, making the digital world more inclusive and accessible to all.