The Motion-Sensing Gloves That Will Translate Sign Language Into Spoken Words

More

The winners of Microsoft's Imagine Cup aim to create a device "to solve the language barrier between sign-language users and the rest of the world."

enabletalkprototype.jpg

Enable Talk's protoype (Enable Talk)

Taking home a $25,000 prize, a team of Ukrainian students won Microsoft's annual Imagine Cup yesterday, with a plan for building and selling gloves that will enable sign-language users to talk through their cell phones. As the team explains, sign language's capacity for communication is limited outside of the deaf community, making many daily interactions -- in stores, on public transit, in restaurants -- difficult for many deaf people. With their Enable Talk gloves, the team hopes to bridge that divide, translating -- through motion detection, recognized as language by software on a cell phone, and then brought into sound waves by the phone's speakers.

Each glove is a technological marvel, equipped with a "microcontroller, 15 flex sensors, [an] accelerometer, [a] gyroscope, and a compass in order to define the position of the glove in space, a Bluetooth module for data transmission from the gloves to a mobile device and a USB-port for the synchronization with the PC and for charging the Li-ion battery that provides power. The glove is also fitted with a solar panel to provide for longer intervals between charging and out of concern for environment." Software on a Windows phone captures the incoming motions, and "transforms the resulting data into a sound wave."

glovesdesign.jpg

It's easy to see the limitations of this technology -- most obviously that once the deaf person's words become speech, then what? Even for skilled lipreaders, many settings (e.g. darker rooms) make lipreading difficult and many hearing people do not articulate their words in ways that make lipreading easier. Additionally, many deaf people may not want to carry around the glove or may find that the computer processing is too slow or unnatural. Lastly, these gloves cannot capture the facial expressions that are crucial to ASL grammar. Even so, it's great to see so much technology, brainpower, and now some Microsoft cash applied to raising up more voices -- including those translated from motions and spoken by computers.



H/t @edyong209.

Jump to comments
Presented by

Rebecca J. Rosen is a senior editor at The Atlantic, where she oversees the Business Channel. She was previously an associate editor at The Wilson Quarterly.

Get Today's Top Stories in Your Inbox (preview)

A Wild Vacation in the Pacific Northwest

A not-so-ordinary road trip, featuring extra-tall art bikes, skateboards, and hand-painted vans


Elsewhere on the web

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

Adventures in Legal Weed

Colorado is now well into its first year as the first state to legalize recreational marijuana. How's it going? James Hamblin visits Aspen.

Video

What Makes a Story Great?

The storytellers behind House of CardsandThis American Life reflect on the creative process.

Video

Tracing Sriracha's Origin to Thailand

Ever wonder how the wildly popular hot sauce got its name? It all started in Si Racha.

Video

Where Confiscated Wildlife Ends Up

A government facility outside of Denver houses more than a million products of the illegal wildlife trade, from tigers and bears to bald eagles.

Video

Is Wine Healthy?

James Hamblin prepares to impress his date with knowledge about the health benefits of wine.

Video

The World's Largest Balloon Festival

Nine days, more than 700 balloons, and a whole lot of hot air

Writers

Up
Down

More in Technology

Just In