The Future of Smartphone Tech Is ... Knuckle-Dragging?

New software tries to expand the "touch" in "touchscreen."

Touchscreens were a pivotal innovation for computing: Much like the graphical user interface, much like the trackpad, much like the mouse, they gave us a brand-new way to put human bodies to the service of human technology. But the touchscreens we have today are also -- just like graphical interfaces and trackpads and mice once were -- a first step toward something more intricate and sophisticated and better. Mice were, in short order, improved with scrolling and right-click capabilities. Trackpads got adapted to distinguish between the gestures of one finger, or two, or three. Graphical interfaces became more intuitive and more attractive.

And now touchscreens are approaching the moment that all good innovations do: the end of the beginning. Computer scientists are developing software that expands the capability of the touchscreen by expanding the idea of touch itself.

So researchers at Microsoft are working on 3-D gestural control that would transfer users' hand gestures to a screen. Scientists at Purdue are experimenting with haptic feedback (pdf) that approximates the feel of discrete buttons -- even on a piece of flat glass. There's the bendable touchscreen. There's the capacitive fingerprinting that allows screens to distinguish among different users. And over at Carnegie Mellon, the computer scientist Chris Harrison has developed software that is able to distinguish between touches delivered from the fingertip, the knuckle, and even (ew?) the fingernail. The whole of one hand, communicating with the machine held by the other.

More on the workings of Harrison's software, FingerSense, in the video above. But the most intriguing operating feature is that the system works not so much by detecting touch as by detecting sound. In Harrison's prototype, a modified Samsung Galaxy S3 smartphone, the device is fitted with a vibration sensor that listens for the acoustic and vibrational differences that occur when a screen is swiped by a fingerpad or a fingernail. So a fingertip could select an object, say, while a knuckle tap could do the kind of next-step and deep-cuts work that a right-click does on a computer. One gesture could get a user deep into his or her own device. And one appendage could operate even more effectively as a medium between mind and machine.

Presented by

Megan Garber is a staff writer at The Atlantic.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register with Disqus.

Please note that The Atlantic's account system is separate from our commenting system. To log in or register with The Atlantic, use the Sign In button at the top of every page.

blog comments powered by Disqus

Video

A New York City Minute, Frozen in Time

This short film takes you on a whirling tour of the Big Apple

Video

What Happened to the Milky Way?

Light pollution has taken away our ability to see the stars. Can we save the night sky?

Video

The Faces of #BlackLivesMatter

Scenes from a recent protest in New York City

Video

Ruth Bader Ginsburg on Life

The Supreme Court justice talks gender equality and marriage.

Video

The Pentagon's $1.5 Trillion Mistake

The F-35 fighter jet was supposed to do everything. Instead, it can barely do anything.

More in Technology

Just In