And Now There's Facial Recognition for the People in Your Pupils

You know how sometimes you can see yourself in the eyes of another person? Others can see you, too.
More

If you get up really close to someone—or zoom in really close in a photo of that person—you can see what he sees, reflected into your own eyes. It's creepy and cool and occasionally profound: Staring back at you in shiny, convex curves is yourself. 

Which is another way of saying what Rob Jenkins says: that "the pupil of the eye is like a black mirror." And it turns out that even tiny, curve-warped faces of people—the people in your pupils—can be identifiable. In a paper newly published in the open-source journal PLoS ONE, Jenkins, a psychologist, and his co-author, Christie Kerr, share a way to turn the eyes, the old windows into the soul, into information. Photographic portraits can lend themselves to facial recognition ... not just of their subjects, but of their photographers. 

A lineup-style array of reflected images from the photos used in the researchers' facial recognition task (in which participants were familiar with the face of the psychologist and unfamiliar with the faces of the bystanders). The correct naming of the familiar face was frequent (90 percent). (Rob Jenkins via Ray Kurzweil AI)

So how do you make that transition? First, you have to zoom in (really, really zoom in) on images of eyes—since, as Jenkins notes, "a face image that is recovered from a reflection in the subject’s eye is about 30,000 times smaller than the subject’s face." Then you have to enhance those zoom-ins to isolate the faces—the "bystander images"—that the human subjects' pupils contain. But even if you do that, the question remains: Are the pupil-mirrored images, given their small size and curvature, even discernible as faces? If the reflection in the eyes is someone other than yourself, can you make out who it is? 

To test that, the researchers presented a series of pixellated faces—an average of only 322 pixels each—as part of a face-matching task they administered to subjects. The subjects who were unfamiliar with the bystanders' faces were able to match the pixellated faces to the standard images of them with 71 percent accuracy; when they were familiar with the faces (if the pixellated face belonged to, say, Barack Obama), they performed with 84 percent accuracy. 

Those scant pixels, in other words, were enough to identify not just a face, but a particular person. 

The researchers' findings, most obviously, have forensic implications: They could be useful for identifying the perpetrators of crimes like kidnapping and sexual abuse, which all too often involve the photographing of victims. The findings could also, however, have implications for the many social networks that have a vested interest in identifying who your friends are. The eyes may be windows to your soul; they can also, when analyzed appropriately, be windows to your social life. 

Via Ray Kurzweil

Jump to comments
Presented by

Megan Garber is a staff writer at The Atlantic. She was formerly an assistant editor at the Nieman Journalism Lab, where she wrote about innovations in the media.

Get Today's Top Stories in Your Inbox (preview)

What Is the Greatest Story Ever Told?

A panel of storytellers share their favorite tales, from the Bible to Charlotte's Web.


Elsewhere on the web

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

The Death of Film

You'll never hear the whirring sound of a projector again.

Video

How to Hunt With Poison Darts

A Borneo hunter explains one of his tribe's oldest customs: the art of the blowpipe

Video

A Delightful, Pixar-Inspired Cartoon

An action figure and his reluctant sidekick trek across a kitchen in search of treasure.

Video

I Am an Undocumented Immigrant

"I look like a typical young American."

Video

Why Did I Study Physics?

Using hand-drawn cartoons to explain an academic passion

Writers

Up
Down

More in Technology

Just In