German and US researchers read brainwaves

Researchers are developing Brain-to-Text technology, which could be the start of a means of communication for patients with locked in syndrome.

AAP

Source: AAP

Scientists have found a way to read the mind, analysing brain waves and interpreting them as words and even complete sentences of continuous speech without having to listen.

The "reading" was done by way of electrodes fixed on the surface of the cerebral cortex, researchers at the Karlsruhe Institute for Technology (KIT) in Germany and the Wadsworth Center in the United States said.

Seven US epilepsy patients voluntarily participated in the study, reading aloud sample texts while an electrode array was attached to their cortices, the outer layer of the brain, which had been exposed for epilepsy surgery.

Observations of this kind are impossible with electrodes attached to the outside of the skull.

"For the first time we have been able to observe the brain," says Tanja Schultz, professor of information technology at KIT and one of the authors of the study published in the journal Frontiers in Neuroscience.

The researchers were able to observe how the brain planned speech acts and then activated the muscles of the speech organs via the neurones in the cortex, a split second before the speech itself became audible.

Software was used to map the activity and show it on a screen the aid of colours.

"Red and yellow colours mean intense activity at this spot in the brain, and blue colours lower activity," Schultz explained in a demonstration.

The patients were given set texts, such as a speech by former US president John F Kennedy or simple children's rhymes, so that the researchers would know which sounds were being uttered and when.

They set up databases containing prototypes of around 50 different phonemes, or basic speech sounds.

Using algorithms from automatic speech recognition, it then became possible to understand what was being said purely from the brainwaves.

"We arrive at meaningful results that are still far removed from the accuracy of acoustic speech recognition, but are well above pure chance," Schultz says.

The limited survey size of just seven patients with just five minutes of speech apiece in the four-year research program is a sticking point.

The Karlsruhe researchers are developing a technology they call Brain-to-Text, which could be a building block to develop a means of speech communication for patients with locked in syndrome.


Share
3 min read

Published

Updated

Source: AAP

Tags

Share this with family and friends


Get SBS News daily and direct to your Inbox

Sign up now for the latest news from Australia and around the world direct to your inbox.

By subscribing, you agree to SBS’s terms of service and privacy policy including receiving email updates from SBS.

Download our apps
SBS News
SBS Audio
SBS On Demand

Listen to our podcasts
An overview of the day's top stories from SBS News
Interviews and feature reports from SBS News
Your daily ten minute finance and business news wrap with SBS Finance Editor Ricardo Gonçalves.
A daily five minute news wrap for English learners and people with disability
Get the latest with our News podcasts on your favourite podcast apps.

Watch on SBS
SBS World News

SBS World News

Take a global view with Australia's most comprehensive world news service
Watch the latest news videos from Australia and across the world