The World Is Not Enough: Google and the Future of Augmented Reality


A book in The Future.

It is The Future. You wake up at dawn and fumble on the bedstand for your (Google) Glass. Peering out at the world through transparent screens, what do you see? 

If you pick up a book, do you see a biography of its author, an analysis of the chemical composition of its paper, or the share price for its publisher? Do you see a list of your friends who've read it or a selection of its best passages or a map of its locations or its resale price or nothing? The problem for Google's brains, as it is for all brains, is choosing where to focus attention and computational power. As a Google-structured augmented reality comes closer to becoming a product-service combination you can buy, the particulars of how it will actually merge the offline and online are starting to matter. 

To me, the hardware (transparent screens, cameras, batteries, etc) and software (machine vision, language recognition) are starting to look like the difficult but predictable parts. The wildcard is going to be the content. No one publishes a city, they publish a magazine or a book or a news site. If we've thought about our readers reading, we've imagined them at the breakfast table or curled up on the couch (always curled up! always on the couch!) or in office cubicles running out the clock. No one knows how to create words and pictures that are meant to be consumed out there in the world.

This is not a small problem.

* * *

I'm sitting with Google's former maps chief John Hanke in the company's San Francisco offices looking out at the Bay's islands and bridges, which feel close enough to touch. We're talking about Field Trip, the new Android app his 'internal startup' built, when he says something that I realize will be a major theme of my life for the next five or 10 years. Yours too, probably. 

But first, let me explain what Field Trip is. Field Trip is a geo-publishing tool that gently pushes information to you that its algorithms think you might be interested in. In the ideal use case, it works like this: I go down to the Apple Store on Fourth Street in Berkeley and as I get back to my car, I hear a ding. Looking at my phone, I see an entry from Atlas Obscura, which informs me that the East Bay Vivarium -- a reptilian wonderland that's part store, part zoo -- is a couple of blocks away. That sounds neat, so I walk over and stare at pythons and horned dragons for the next hour. Voila. "Seamless discovery," as Hanke calls it. 

Dozens of publishers are tagging their posts with geocodes that Field Trip can hoover up and send to users now. Hanke's team works on finding the right moment to insert that digital information into your physical situation. 

And when it works well, damn does it work well. 

It's only a slight exaggeration to say that Field Trip is invigorating. That is to say: It makes life more interesting. And since I switched back to my iPhone after a one-week Android/Field Trip test, it's the one thing that I really miss. 

At first, I was tempted to write off this effort as a gimmick, to say that Field Trip was a deconstructed guide book. But the app is Google's probe into the soft side of augmented reality. What the team behind it creates and discovers may become the basis of your daily reality in five or 10 years. And that brings me back to Hanke's comment, the one you could devote a career to. 

"You've got things like Google Glass coming. And one of the things with Field Trip was, if you had [Google Glass], what would it be good for?" Hanke said. "Part of the inspiration behind Field Trip was that we'd like to have that Terminator or Iron Man-style annotation in front of you, but what would you annotate?"

There's so much lurking in that word, "annotate." In essence, Hanke is saying: What parts of the digital world do you want to see appear in the physical world?

If a Field Trip notification popped up about John Hanke, it might tell you to look for the East Bay hipster with floppy hair almost falling over his eyes. He looks like a start-up guy, and admits to being one despite his eight years at Google. He refers to its cofounders like old college friends. ("Sergey was always big on, 'You should be able to blow stuff up' [in Google Earth].") Not a kid anymore, Hanke sold an early massively multiplayer online gaming company to the legendary Trip Hawkins in the '90s, then co-founded Keyhole, which became the seed from which Google's multi-thousand person map division grew. 

When maps got too big for Hanke's taste, he "ultimately talked with Larry" [Page], and figured out how to create an "autonomous unit" to play with the company's geodata to create novel, native mobile experiences. This is Google's Page-blessed skunkworks for working on this very specific problem. They are Google but they have license to be unGoogle.

"You don't want to show everything from Google Maps. You don't want to show every dry cleaner and 7-Eleven in a floating bubble," Hanke said. "I want to show that incremental information that you don't know. What would a really knowledgeable neighborhood friend tell you about the neighborhood you're moving through? He wouldn't say, 'That's a 7-Eleven. That's a fire hydrant.' He would say, 'Michael Mina is opening this new place here and they are going to do this crazy barbecue thing.' " 

Presented by

How to Cook Spaghetti Squash (and Why)

Cooking for yourself is one of the surest ways to eat well. Bestselling author Mark Bittman teaches James Hamblin the recipe that everyone is Googling.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register.

blog comments powered by Disqus


How to Cook Spaghetti Squash (and Why)

Cooking for yourself is one of the surest ways to eat well.


Before Tinder, a Tree

Looking for your soulmate? Write a letter to the "Bridegroom's Oak" in Germany.


The Health Benefits of Going Outside

People spend too much time indoors. One solution: ecotherapy.


Where High Tech Meets the 1950s

Why did Green Bank, West Virginia, ban wireless signals? For science.


Yes, Quidditch Is Real

How J.K. Rowling's magical sport spread from Hogwarts to college campuses


Would You Live in a Treehouse?

A treehouse can be an ideal office space, vacation rental, and way of reconnecting with your youth.

More in Technology

Just In