Software helps autistic kids read faces

Stanford University is trialling software using Google Glass to help autistic children with one their biggest challenges - recognising emotions.

Like many autistic children, Julian Brown has trouble reading emotions in people's faces, one of the biggest challenges for people with the neurological disorder.

Now the 10-year-old Californian boy is getting help from "autism glass" - an experimental device that records and analyses faces in real time and alerts him to the emotions they're expressing.

The facial recognition software was developed at Stanford University in the US and runs on Google Glass, a computerised headset with a front-facing camera and a tiny display just above the right eye.

Julian is one of about 100 autistic children participating in a Stanford study to see if "autism glass" therapy can improve their ability to interpret facial expressions.

"There's not a machine that can read your mind, but this helps with the emotions, you know, recognising them," Julian said.

Julian wears the device each day for three 20-minute sessions when he interacts with family members face-to-face - talking, playing games, eating meals.

The program runs on a smartphone, which records the sessions.

When the device's camera detects an emotion such as happiness or sadness, Julian sees the word "happy" or "sad" - or a corresponding "emoji" - flash on the glass display.

The device also tests his ability to read facial expressions.

"The autism glass program is meant to teach children with autism how to understand what a face is telling them. And we believe that when that happens they will become more socially engaged," said Dennis Wall, who directs the Stanford School of Medicine's Wall Lab, which is running the study.

Stanford student Catalin Voss and researcher Nick Haber developed the technology to track faces and detect emotions in a wide range of people and settings.

"We had the idea of basically creating a behavioural aide that would recognise the expressions and faces for you and then give you social cues according to those," said Voss, who was partly inspired by a cousin who has autism.

Google provided about 35 Google Glass devices to Stanford, but otherwise hasn't been involved in the project.

The Silicon Valley tech giant stopped producing the headset last year after it failed to gain traction, but the device found new life among medical researchers.

Brain Power, a US-based startup, is also developing Google Glass-based applications to help children with autism improve their face-reading abilities and social skills.

Currently, many autistic children learn to read facial expressions by working with therapists who use flashcards with faces expressing different emotions.

The Stanford team hopes autism glass can provide a convenient, affordable therapy that families can do at home.


Share
3 min read

Published

Source: AAP


Share this with family and friends


Get SBS News daily and direct to your Inbox

Sign up now for the latest news from Australia and around the world direct to your inbox.

By subscribing, you agree to SBS’s terms of service and privacy policy including receiving email updates from SBS.

Download our apps
SBS News
SBS Audio
SBS On Demand

Listen to our podcasts
An overview of the day's top stories from SBS News
Interviews and feature reports from SBS News
Your daily ten minute finance and business news wrap with SBS Finance Editor Ricardo Gonçalves.
A daily five minute news wrap for English learners and people with disability
Get the latest with our News podcasts on your favourite podcast apps.

Watch on SBS
SBS World News

SBS World News

Take a global view with Australia's most comprehensive world news service
Watch the latest news videos from Australia and across the world