SBS Radio App

Download the FREE SBS Radio App for a better listening experience

A Facebook feature on the iPhone app will interpret what is in a picture using a program that recognises faces and objects.
29 Apr 2016 - 9:50 AM  UPDATED 2 May 2016 - 9:40 AM

Facebook is training its computers to become seeing-eye guides for blind and visually impaired people as they scroll through the pictures posted on the world's largest online social network.

The feature rolling out Tuesday on Facebook's iPhone app interprets what's in a picture using a form of artificial intelligence that recognizes faces and objects.

The iPhone's built-in screen reader, VoiceOver, must be turned on for Facebook's photo descriptions to be read.

For now, the feature will only be available in English.

100 words

The descriptions initially will be confined to a vocabulary of 100 words in a restriction that will prevent the computer from providing a lot of details.

Social media

Eventually, Facebook hopes to refine the technology so it's more precise and even answers questions that a user might pose about a picture.

Facebook's emotional experiment
Facebook has revealed that it manipulated the feelings of thousands of users in an experiment to understand so-called 'emotional contagion'. (In Vietnamese)