What's So Great About IBM's Jeopardy!-Playing Machine?

What is Watson?

It's the name of IBM's latest high-profile supercomputer, this time designed to play Jeopardy! rather than chess. The New York Times has a a forthcoming magazine profile on what Watson is, how it differs from IBM's past supercomputing projects and what challenges it had to overcome. The project sounds impressive, but Watson's success apparently has more to do with sheer computing power than any major language-processing breakthrough.

Watson was designed with practicality in mind, unlike Deep Blue which famously beat Chess Grandmaster Gary Kasparov in 1997. That skill -- the ability to play chess really well -- couldn't be used to make much money. Solving the "question answering" problem, however, has plenty of applications. (Just ask Google.) There is a lot of money to be made from developing a system that can "understand" questions posed in normal, everyday speech, rather than selected keywords, and return meaningful results quickly.

Watson never truly obliterates the competition and sometimes it even loses. Still, creating a question-answering machine is a difficult task because of the vagueness of language and making one that answers questions based on a pun, play on words, or other verbal trickery deployed by Jeopardy's creators is even harder.

So, how did IBM approach the problem? Rather than develop a machine that can decipher semantics -- what do these words mean and how do they relate? -- IBM took a shortcut of sorts and developed a high-speed computer that "thinks" in probabilities:

Watson uses more than a hundred algorithms at the same time to analyze a question in different ways, generating hundreds of possible solutions. Another set of algorithms ranks these answers according to plausibility; for example, if dozens of algorithms working in different directions all arrive at the same answer, it's more likely to be the right one. In essence, Watson thinks in probabilities. It produces not one single "right" answer, but an enormous number of possibilities, then ranks them by assessing how likely each one is to answer the question.

That's quite a feat, but it's not emulating human thought. It has side-stepped the problem altogether, relying on massive computing power and storage, as well as probabilistic number-crunching to approximate how we parse language.

In an IBM-produced video, the host of a fake game of Jeopardy! offers the answer: "In R.E.M.'s 'It's The End Of The World As We Know It' two of the men with the initials L.B." Watson replies with "What is 'I Feel Fine.'" It's not that the supercomputer didn't know the song or the band -- clearly both were in the database because its response was a phrase from the song -- it's that the computer didn't even understand an elementary question.

Presented by

Niraj Chokshi is a former staff editor at TheAtlantic.com, where he wrote about technology. He is currently freelancing and can be reached through his personal website, NirajC.com. More

Niraj previously reported on the business of the nation's largest law firms for The Recorder, a San Francisco legal newspaper. He has also been published in The Hartford Courant, The Seattle Times and The Age, in Melbourne, Australia. He's also a longtime programmer and sometimes website designer.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register with Disqus.

Please note that The Atlantic's account system is separate from our commenting system. To log in or register with The Atlantic, use the Sign In button at the top of every page.

blog comments powered by Disqus

Video

A New York City Minute, Frozen in Time

This short film takes you on a whirling tour of the Big Apple

Video

What Happened to the Milky Way?

Light pollution has taken away our ability to see the stars. Can we save the night sky?

Video

The Faces of #BlackLivesMatter

Scenes from a recent protest in New York City

Video

Ruth Bader Ginsburg on Life

The Supreme Court justice talks gender equality and marriage.

Video

The Pentagon's $1.5 Trillion Mistake

The F-35 fighter jet was supposed to do everything. Instead, it can barely do anything.

More in Technology

Just In