Watch CBS News

Captioned smart glasses let deaf people see, rewind conversations

Captioned smart glasses let deaf people see, rewind conversations
Captioned smart glasses let deaf people see, rewind conversations 01:15

MIAMI - New artificial intelligence 'AI' powered smart glasses give deaf or hard-of-hearing people a heads-up display of live, real-time subtitles of their conversation, right in front of their eyes and let them rewind the chat, to read it again.

The technology, called XRAI Glass, uses off-the-shelf augmented reality 'AR' glasses that are tethered to a smartphone app with AI driven software that gives the user a new kind of personal assistant, one that remembers what you have forgotten.

"Imagine Alexa for your eyes," Mitchell Feldman, co-founder and Chief Marketing Officer for XRAI.

The XRAI Glass technology was inspired by co-founder Dan Scarfe's 97-year-old grandfather's hearing loss and his subsequent difficulty joining in at family gatherings, although it now has potential uses for anyone.

"Where his grandfather became most alive, was watching television and using subtitles," Feldman said. "If he's enjoying subtitles, why can we not subtitle his life? And that was the genesis of how this product started."

The app also now boasts the ability to translate nine different languages in near-real time, with more coming in the next few months.

One of those impressed by XRAI is Justin Osmond, who was diagnosed at the age of two with severe hearing loss. Osmond, son of Merrill Osmond of the U.S. pop group The Osmonds, was amazed by a conversation with his wife while using the glasses:

"What's amazing is not only can I follow everything that she's saying, even if I'm not looking up at her, if I have to look down or look elsewhere, it's all right there in front of me," he said.

XRAI says the app is currently compatible with the Nreal Air Augmented Reality glasses but they hope to work with all AR and XR glass makers in the future.

The basic live caption app is free to download with the assistant and translation services paid for by subscription.

View CBS News In
CBS News App Open
Chrome Safari Continue
Be the first to know
Get browser notifications for breaking news, live events, and exclusive reporting.