SKIP TO MAIN CONTENT

Vision trumps hearing in study

In trying to explain how the brain combines information from two different senses, researchers found that we depend more on vision than hearing.

A woman wears sunglasses to protect her eyes
US researchers found that we depend more on vision than hearing when the brain combines information. (AAP)

3 min read

Published

Updated

Source: AAP


Skip to article content

A US university study used puppet-based comedy to demonstrate the complicated inner-workings of the brain and shows what every ventriloquist knows: the eye is more convincing than the ear.

The study, which appears in the journal PLOS ONE, seeks to explain how the brain combines information coming from two different senses. How, asks Duke University psychology and neuroscience professor Jennifer Groh, does the brain determine where a sound is coming from?

In your eyes, the retina takes a snapshot, she said. It makes a topographic image of what's in front of you. But the ears have nothing concrete to go on. They have to rely on how loud the sound is, how far away and from what direction.

That's where a ventriloquist comes in, providing a model for this problem. With a puppet, the noise and the movement are coming from different places. So how does the brain fix this and choose where to look?

Duke researchers tested their hypotheses on 11 people and two monkeys, placing them in a soundproof booth.

News that makes sense

Your trusted source for staying up-to-date with the world around you. Get free daily news updates and analysis, straight to your inbox.

By subscribing, you agree to SBS’s terms of service and privacy policy including receiving email updates from SBS.

They arranged speakers in various locations and attached lights to them.

Then they played a sound from one speaker and flashed a light from another, tracking people's eye movements. Sometimes they played the sound in time with the light, but only for just a fraction of a second. Sometimes they played the sound first, then followed up with the light.

Results: People moved their eyes much more when the light came at a different time with the sound. To sum up, it doesn't matter if sounds and lights happen at the same time, in the same place. It's more important that the eyes get a clue to give back to the brain.

"Vision is so much better at informing location," Groh said. "Why do we have the ventriloquist illusion? That illusion occurs because of the power of vision to correct errors."

This rings true to Cynthia Foust, a real ventriloquist in Rocky Mount.

She spent about six months practising on her own before taking her show to daycare centres, where she aims to keep children's eyes on the puppet's mouth.

"You kind of keep things animated with the puppet so they're not looking at me," Foust said.


Get SBS News straight to your inbox

Sign up now for daily news from Australia and around the world. You can also subscribe to Insight's weekly newsletter for in-depth features and first-person stories.

By subscribing, you agree to SBS’s terms of service and privacy policy including receiving email updates from SBS.

Follow SBS News

Download our apps

Listen to our podcasts

Get the latest with our News podcasts on your favourite podcast apps.

Watch on SBS

SBS World News

Take a global view with Australia's most comprehensive world news service

Stream now

Watch the latest news videos from Australia and across the world