Finger device reads aloud to the blind

A device being developed in the US allowed the vision impaired to read words off a page simply by pointing to them.

Scientists at the Massachusetts Institute of Technology in the US are developing an audio reading device to be worn on the index finger of people whose vision is impaired, giving them affordable and immediate access to printed words.

The so-called FingerReader, a prototype produced by a 3D printer, fits like a ring on the user's finger, equipped with a small camera that scans text. A synthesised voice reads words aloud, quickly translating books, restaurant menus and other needed materials for daily living, especially away from home or office.

Reading is as easy as pointing the finger at text. Special software tracks the finger movement, identifies words and processes the information. The device has vibration motors that alert readers when they stray from the script, said Roy Shilkrot, who is developing the device at the MIT Media Lab.

For Jerry Berrier, 62, who was born blind, the promise of the FingerReader is its portability and offer of real-time functionality at school, a doctor's office and restaurants.

"When I go to the doctor's office, there may be forms that I wanna read before I sign them," Berrier said.

He said there are other optical character recognition devices on the market for those with vision impairments, but none that he knows of that will read in real time.

Berrier manages training and evaluation for a federal program that distributes technology to low-income people in Massachusetts and Rhode Island who have lost their sight and hearing. He works from the Perkins School for the Blind in Watertown, Massachusetts.

"Everywhere we go, for folks who are sighted, there are things that inform us about the products that we are about to interact with. I wanna be able to interact with those same products, regardless of how I have to do it," Berrier said.

Pattie Maes, an MIT professor who founded and leads the Fluid Interfaces research group developing the prototype, says the FingerReader is like "reading with the tip of your finger and it's a lot more flexible, a lot more immediate than any solution that they have right now."

Developing the gizmo has taken three years of software coding, experimenting with various designs and working on feedback from a test group of visually impaired people. Much work remains before it is ready for the market, Shilkrot said, including making it work on mobile phones.


Share

3 min read

Published

Updated



Share this with family and friends


Get SBS News daily and direct to your Inbox

Sign up now for the latest news from Australia and around the world direct to your inbox.

By subscribing, you agree to SBS’s terms of service and privacy policy including receiving email updates from SBS.

Download our apps
SBS News
SBS Audio
SBS On Demand

Listen to our podcasts
An overview of the day's top stories from SBS News
Interviews and feature reports from SBS News
Your daily ten minute finance and business news wrap with SBS Finance Editor Ricardo Gonçalves.
A daily five minute news wrap for English learners and people with disability
Get the latest with our News podcasts on your favourite podcast apps.

Watch on SBS
SBS World News

SBS World News

Take a global view with Australia's most comprehensive world news service
Watch the latest news videos from Australia and across the world