Recently I recommended that you check out Google Photos if you have not done so already. Like Gmail, it’s a way to store huge quantities of digital material and leave its management to someone else. (I promise, later we’ll get into the privacy tradeoffs involved.) And much more than Gmail, it offers big-data tools that can arrange and transform your information/photos in ways difficult or impossible to do by yourself.
For instance: I mentioned that Google Photos had, on its own, merged three smart-phone snapshots of a scene at Oxford into one panorama view. Several people wrote in to say: Let’s see the originals! So here goes.
First, in its full-frame entirety, a smartphone snapshot of one side of the entry quad at The Queen’s College, Oxford.
Then two almost-identical shots of the other side, both in full frame. First this:
Then this:
The point is that without my doing anything more than saving all three shots to a Google drive, the system recognized them as overlapping parts of a whole and stitched them together into a high-rez, level-horizon, panorama version, looking like this (and at larger scale here):
Even when zooming in on the composite shot as far as possible, I still can’t find a pixellated boundary where the shots were brought together.
We all say in our blase way: Yeah yeah there’s increasing power of big-data systems. At least for me, seeing how it worked on my own information dramatized these effects. To be clear, this was with three quick, casual phone-shots taken over a few-second span. The result isn’t anything fancy, but it’s different from what I could have done myself.
And, as I say, we’ll get to the surveillance-state ramifications soon.
***
Actually, why not now. Here’s one reader response:
In the vein of the glass being neither half-full nor half-empty, but having a leak, that [big-data] magic means just as much that a computer can figure-out where you have been and when based on the photos you take, making it that much easier for a human being with access to that computer to know where you have gone and when.
The photo taker providing in essence CCTV of their movements. At least though unlike CCTV (and of course all that magical facial recognition) if the photo taker stops taking/posting the photos the intelligence stream stops.
Panorama photo created by Microsoft’s Windows Live Photo Gallery. For details, read on.
In two earlier dispatches, here and here, I suggested that you give Google Photos a try if you hadn’t done so already. The most obvious payoff is providing an answer to the increasingly pressing question of how to handle increasing zillions of digital images. The less obvious advantage that has grown on me involves the big data/AI aspects of the system — the way it automatically groups photos of one scene into panorama views, or created animated GIFs, or creates albums with titles like “Iron Pigs Game in Allentown” by recognizing the landmarks and activities.
Yes, I know that on the other side of this same technology is the Panopticon Surveillance State. For now I’m talking about the applications that many users will find convenient — and, in particular, where they originated.
A reader who was a long-time official at Microsoft writes in to lament the fact that Google is now being either oohed and aahed at, or viewed with concern, for innovations that Microsoft had been chipping away at for years, especially with a product called Photosynth. I turn it over to the reader:
Once again I shake my head at the ways my ex-employer [Microsoft] would develop a great idea, and then not follow through, partly because of an inability to catch on with the cool crowd.
Photosynth could not just stitch many photos together, it could (given enough pictures) create a 3D model – about 10 years ago. It’s not as passive as Google Photos, as you have to point it at your picture collection, but it would have been relatively easy to make it munch on photos uploaded to OneDrive. The idea has basically just sat as a research project, with the last update 9 months ago, and now Google gets the credit for a great innovation. Apparently people are still using it (who knew?): go to photosynth.net for some recent 3D creations.
I’d never known of this project; I went to the site after getting his note; and he’s right! It looks very interesting. For instance, check this out. Back to the reader:
Apple didn’t invent the smartphone. The “Pocket PC” phone came years earlier. Nest? I remember touring the demonstration e-home when I joined Microsoft in the late 1990s. [JF note: when I was at Microsoft in 1999 I saw it too.]
Now, maybe the company didn’t pursue these projects because they weren’t part of the core mission, and maybe it was because Ballmer was focused on business and not “toys”. That would be fair rationale. But it is, at best, ironic that Microsoft gets the reputation of never innovating anything, and being a ruthless productizing and marketing machine, when almost the opposite is true….
Re your correspondent’s concern about big data and privacy: that cat has been out of the bag for a long time. The “cloud” being able to figure where you were and when dates to when the first geo-encoded picture was uploaded to flickr.
After further comparison of what Microsoft had done and Google is now doing, he wrote once more:
I guess it’s the [Microsoft Live] Photo Gallery feature that’s most like the Google feature. Photosynth is a world beyond both, and has more of the “wow” factor.
The photos [at the beginning and end of this post] come from the London Natural History Museum and the top of the Arc de Triomphe in 2012; I just had to select the pictures in Photo Gallery and click.
What Google seems to bring to the table is (a) identification of a group by place and time (which is trivial), (b) recognition of picture similarity (which is commonplace today) and (c) lots of computers available to make panoramas in the background and probably (d) recognition of a good result. And I guess they trim the result to a rectangle.
The fact you of all people hadn’t heard of Photosynth is exactly my point.
Photo Gallery panorama of Natural History Museum in London
In the three previous installments you’ll find lower down in this Thread, I started with ‘Google’s powerful new Photos feature — and then heard from a Microsoft veteran about Microsoft’s earlier steps in this same field. Why, this reader asked, does Google (or Apple) end up with so much of the attention and coolness factor for developments that had been underway, longer, elsewhere in the techno-sphere? Readers weigh in with further hypotheses.
First, a reader in the tech business in California says the crucial concept is that of the “first widely noticed” innovation, rather than the first actual engineering or scientific breakthrough:
Variations on this theme have been playing out for years. People thinking VMware came-up with virtualization, when it was IBM (or someone else) back in the 1960s. People thinking that x86 servers were where fancy network interface card features (“stateless offloads”) were created when it was in the mini-computer vendors. Call it “first widely noticed” advantage I suppose.
A reader who has worked at Google, but not on the Photos feature, writes:
Your ex-Microsoft correspondent reminds me of an old New Yorker cartoon I used to have on my office door but unfortunately got lost in a move. In the cartoon, a beaver and a rabbit stand in front of a huge concrete dam, and the beaver tells the rabbit something like "It was my idea, you know?"
Great products are not just a pile of good ideas, they are a combination that works well together in practice to meet real user needs. PhotoSynth was indeed a great technology, but it was never incorporated into a compelling product. And your correspondent conveniently ignores the biggest innovation in Google Photos, its unparalleled ability to find relevant photos from descriptions of their content.
I remember when Microsoft first introduced Photosynth and was quite excited about it. There was, however, one "small" problem: the Photosynth tools were (and still are, I believe) only available for Windows. Since I had a Mac, it was (and, again, still is) unavailable to me. What I can't use is, ultimately, of no interest to me. (I also use Linux quite a bit; again, of what use is Photosynth to me?)
Google's Photos (like their other Google products) are web and and cloud based. Take some pictures, upload to Photos (or have them automatically uploaded), and the "magic" is available on any browser on any operating system. It's not only interesting, but it's easily available and easy to take advantage of.
The difference is Microsoft wanted to sell you software that worked within (and that fed into) their foundational operating system. If you didn't support that foundational system, they weren't particularly interested in you. (Of course, there were exceptions to the above, Microsoft Office for the Mac being the obvious example).
On the other hand, Google doesn't want to sell you any software; they in fact give that away for free. They want your attention, which they can turn around and offer to companies which pay them to run ads while you are paying attention. So they work to make sure their software works on as many systems and browsers as possible (the more eyeballs to sell ads to, the better).
The two companies work (or at least worked in the past) with different philosophies. I think it's pretty clear which one is working better right now.
And a technology executive based in Hong Kong writes:
In 1995 Microsoft partnered with Tandem Computers to port Windows NT over to Tandem's high availability hardware platform. It was (for its day) extremely fast with enormous data search and transfer capacity with the very best networking connectivity available. The joint engineering team struggled mightily to find a data source big and complex enough to really show off the system. The solution was a searchable database of NASA satellite imagery covering all the continental U.S.
If it sounds like Google Maps version 0.0 ten years in advance of the real thing, then yes, it was exactly that. The images were black and white and of course there was nothing like StreetView, but it was an extraordinarily innovative and cool application of technology to solve a problem nobody knew existed. State of the art engineering that never left the lab.
Bonus irony - I saw the system demonstrated twenty years ago at Tandem Computers headquarters on the corner of North Tantau and Pruneridge in Cupertino. If that street address doesn't ring a bell, think "Spaceship Campus."
***
For completeness, here is an account by journalist David Arnott of his experience in having Google Photos upload his smartphone photos to the cloud when he didn’t think it was doing so. This aspect of the system has not been a problem for me, but if you have an Android phone (as I do) it’s worth understanding exactly how to control the upload settings. This guide, from Android Central, tells you how to do that, step by step.
***
The next two Notes installments, which I’ll space out over the holiday weekend, will both be thankfulness-themed. One will be about encouraging recent developments in the “sustainable capitalism” sphere. The other, about some nice news in places we’ve come to know in our American Futures travels. Then when the weekend is over, back to the South China Sea. Happy Thanksgiving.