What's So Great About IBM's Jeopardy!-Playing Machine?


What is Watson?

It's the name of IBM's latest high-profile supercomputer, this time designed to play Jeopardy! rather than chess. The New York Times has a a forthcoming magazine profile on what Watson is, how it differs from IBM's past supercomputing projects and what challenges it had to overcome. The project sounds impressive, but Watson's success apparently has more to do with sheer computing power than any major language-processing breakthrough.

Watson was designed with practicality in mind, unlike Deep Blue which famously beat Chess Grandmaster Gary Kasparov in 1997. That skill -- the ability to play chess really well -- couldn't be used to make much money. Solving the "question answering" problem, however, has plenty of applications. (Just ask Google.) There is a lot of money to be made from developing a system that can "understand" questions posed in normal, everyday speech, rather than selected keywords, and return meaningful results quickly.

Watson never truly obliterates the competition and sometimes it even loses. Still, creating a question-answering machine is a difficult task because of the vagueness of language and making one that answers questions based on a pun, play on words, or other verbal trickery deployed by Jeopardy's creators is even harder.

So, how did IBM approach the problem? Rather than develop a machine that can decipher semantics -- what do these words mean and how do they relate? -- IBM took a shortcut of sorts and developed a high-speed computer that "thinks" in probabilities:

Watson uses more than a hundred algorithms at the same time to analyze a question in different ways, generating hundreds of possible solutions. Another set of algorithms ranks these answers according to plausibility; for example, if dozens of algorithms working in different directions all arrive at the same answer, it's more likely to be the right one. In essence, Watson thinks in probabilities. It produces not one single "right" answer, but an enormous number of possibilities, then ranks them by assessing how likely each one is to answer the question.

That's quite a feat, but it's not emulating human thought. It has side-stepped the problem altogether, relying on massive computing power and storage, as well as probabilistic number-crunching to approximate how we parse language.

In an IBM-produced video, the host of a fake game of Jeopardy! offers the answer: "In R.E.M.'s 'It's The End Of The World As We Know It' two of the men with the initials L.B." Watson replies with "What is 'I Feel Fine.'" It's not that the supercomputer didn't know the song or the band -- clearly both were in the database because its response was a phrase from the song -- it's that the computer didn't even understand an elementary question.

Jump to comments
Presented by

Niraj Chokshi is a former staff editor at TheAtlantic.com, where he wrote about technology. He is currently freelancing and can be reached through his personal website, NirajC.com. More

Niraj previously reported on the business of the nation's largest law firms for The Recorder, a San Francisco legal newspaper. He has also been published in The Hartford Courant, The Seattle Times and The Age, in Melbourne, Australia. He's also a longtime programmer and sometimes website designer.
Get Today's Top Stories in Your Inbox (preview)

What Is a City?

Cities are like nothing else on Earth.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus


CrossFit Versus Yoga: Choose a Side

How a workout becomes a social identity


Is Technology Making Us Better Storytellers?

The minds behind House of Cards and The Moth weigh in.


A Short Film That Skewers Hollywood

A studio executive concocts an animated blockbuster. Who cares about the story?


In Online Dating, Everyone's a Little Bit Racist

The co-founder of OKCupid shares findings from his analysis of millions of users' data.


What Is a Sandwich?

We're overthinking sandwiches, so you don't have to.


Let's Talk About Not Smoking

Why does smoking maintain its allure? James Hamblin seeks the wisdom of a cool person.



More in Technology

Just In