Talking Hands

A team of innovative researchers have created a system that translates sign language into audible speech. They are now on their way to commercialising this groundbreaking technology and helping to give deaf people a voice.

A great number of people all over the world are affected by hearing impairments. According to the World Health Organization, around 466 million people worldwide have disabling hearing loss; 34 million of these are children. Recent advances in machine learning and consumer electronics now offer the chance to develop a truly life-changing technological aid for the hearing impaired.

The EU-funded Talking Hands project has created an innovative, portable, user-friendly gesture-recognition device for the hearing impaired.

“Imagine a device that enables deaf people to talk. Imagine a business that combines profit and social inclusion,” says Francesco Pezzuoli, project coordinator. “Talking Hands is the unique solution with these characteristics.”

Surveying the hearing impaired

The team engaged extensively with the deaf community on their way to bringing the product to market. “Many obstacles occur along the path from an idea to the market, especially at the beginning of the journey, and one can even consider quitting,” underlines Pezzuoli. “But when you receive mails and calls from deaf people and from parents of a deaf child to encourage you and to confirm they are waiting for your product, you work harder, because you feel that your work really matters.”

Project partners also conducted extensive research, going through the academic literature in order to understand what technology has been used to aid the hearing impaired. They found that research into sign language translation spans decades and has been conducted by many other researchers; but few have succeeded in commercialising it.

“We focused our research from a market perspective since our goal is a user-friendly product,” explains Pezzuoli. “Even if Talking Hands does perform a perfect translation of an entire sign language, it should firstly be a satisfying communication experience for the user.”

Building a working prototype

Pezzuoli and his team used their academic literature review to determine the best sensors and electronic components to use in their product. After months of work they finally had a working prototype made up of a gardening glove, over-the-counter electronics and a simple algorithm.

“By then we had to improve each part; we developed different prototypes and we explored different solutions,” says Pezzuoli. “We eventually were satisfied with the product and now we think it is ready for the market.”

The team faced some unexpected delays in addition to some technical problems because the needs of hearing-impaired people differ. “Some similar projects have been started through the world, and no one ever succeeded in the market with a useful product,” reveals Pezzuoli. “We have overcome some of these challenges and early feedback from users has been very good.”

Getting the product ready for market

The team plans to introduce a high-quality product into the market now that they have a working prototype. In the coming months they plan to test the beta version of their product with a high school in Rome that specialises in teaching hearing-impaired children. After a final revision, the team will commercialise Talking Hands with the support of private and public funding.

“We cannot count the times people asked why we did not move to the United States to develop our business,” Pezzuoli points out. “We think the most important value of the SME Instrument grant is the great message that we are not just in Italy anymore, but we are in Europe.”

Reference source:Talking Hands