The Future of Smartphone Tech Is ... Knuckle-Dragging?

More

New software tries to expand the "touch" in "touchscreen."

Touchscreens were a pivotal innovation for computing: Much like the graphical user interface, much like the trackpad, much like the mouse, they gave us a brand-new way to put human bodies to the service of human technology. But the touchscreens we have today are also -- just like graphical interfaces and trackpads and mice once were -- a first step toward something more intricate and sophisticated and better. Mice were, in short order, improved with scrolling and right-click capabilities. Trackpads got adapted to distinguish between the gestures of one finger, or two, or three. Graphical interfaces became more intuitive and more attractive.

And now touchscreens are approaching the moment that all good innovations do: the end of the beginning. Computer scientists are developing software that expands the capability of the touchscreen by expanding the idea of touch itself.

So researchers at Microsoft are working on 3-D gestural control that would transfer users' hand gestures to a screen. Scientists at Purdue are experimenting with haptic feedback (pdf) that approximates the feel of discrete buttons -- even on a piece of flat glass. There's the bendable touchscreen. There's the capacitive fingerprinting that allows screens to distinguish among different users. And over at Carnegie Mellon, the computer scientist Chris Harrison has developed software that is able to distinguish between touches delivered from the fingertip, the knuckle, and even (ew?) the fingernail. The whole of one hand, communicating with the machine held by the other.

More on the workings of Harrison's software, FingerSense, in the video above. But the most intriguing operating feature is that the system works not so much by detecting touch as by detecting sound. In Harrison's prototype, a modified Samsung Galaxy S3 smartphone, the device is fitted with a vibration sensor that listens for the acoustic and vibrational differences that occur when a screen is swiped by a fingerpad or a fingernail. So a fingertip could select an object, say, while a knuckle tap could do the kind of next-step and deep-cuts work that a right-click does on a computer. One gesture could get a user deep into his or her own device. And one appendage could operate even more effectively as a medium between mind and machine.

Jump to comments
Presented by

Megan Garber is a staff writer at The Atlantic. She was formerly an assistant editor at the Nieman Journalism Lab, where she wrote about innovations in the media.

Get Today's Top Stories in Your Inbox (preview)

What Is a City?

Cities are like nothing else on Earth.


Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

CrossFit Versus Yoga: Choose a Side

How a workout becomes a social identity

Video

Is Technology Making Us Better Storytellers?

The minds behind House of Cards and The Moth weigh in.

Video

A Short Film That Skewers Hollywood

A studio executive concocts an animated blockbuster. Who cares about the story?

Video

In Online Dating, Everyone's a Little Bit Racist

The co-founder of OKCupid shares findings from his analysis of millions of users' data.

Video

What Is a Sandwich?

We're overthinking sandwiches, so you don't have to.

Video

Let's Talk About Not Smoking

Why does smoking maintain its allure? James Hamblin seeks the wisdom of a cool person.

Writers

Up
Down

More in Technology

Just In