Mind-Reading Wearable Translates Silent Words Into Actions

It sounds like it might be straight out of a science fiction movie, but researchers at MIT say they've discovered a way to read your silent speech and translate it into actions.

Credit: Lorrie Lejeune/MIT

(Image credit: Lorrie Lejeune/MIT)

The technology, called AlterEgo, is an oddly shaped white headset that sits around your ear and curves across your jaw. It's outfitted with electrodes that analyze brain activity and vibrations in your bones when you internally verbalize a message. It takes that data and imports it into a computer that uses neural networks to identify what you were trying to say.

If successful, the system will properly translate your thoughts and convert them into real-world commands.

“The motivation for this was to build an IA device — an intelligence-augmentation device,” MIT Media Lab graduate student Arnav Kapur, who led the team that developed the technology, told MIT News in an interview. "Our idea was: Could we have a computing platform that’s more internal, that melds human and machine in some ways and that feels like an internal extension of our own cognition?”

The headset is designed to explore the world of subvocalization, or internal verbalization. The researchers wanted to see if they could find a way to understand the words and inner talks you have with yourself and extract them for real-world use. And in order to do that, they needed to fully evaluate what happens when we think thoughts that we don't actually verbalize.

In that research, the scientists found that we have seven "electrode locations" that provide hints at what we're thinking. And by creating the headset to wrap around the neck, ear, and jaw, the researchers were able to target all seven and gather information. However, they also discovered they could reduce the size of the headset and tap into only four of those locations and get the same results.

As time goes on, they hope to further reduce the number of locations they need to cover to make the headset smaller and less intrusive.

The researchers told MIT News that they used the technology in a variety of ways, including answering math equations and controlling Roku players. In 92 percent of cases, even though not a single word was uttered out loud, the technology was able to determine their thoughts and accurately respond.

Looking ahead, the researchers believe their technology has a variety of real-world applications in loud environments where traditional headsets might not be able to easily hear commands or a person speaking and respond accordingly. They also believe special operations forces could use it to communicate with each other during a silent mission.

Still, there's no telling when, or even if, the technology might eventually find its way to companies or consumers.