Bad News for Aspiring Gurus?

The Boston Globe's take on the frequent misses of the formerly doomsaying economist Nouriel Roubini is discouraging for those who think they've found the right forecasting formula--and for everyone else looking for somebody who has.

Joe Keohane cites especially the work of the political scientist Philip Tetlock, who revealed that the formula for successful political prophecy is to make frequent and bold claims. People will remember only the correct calls. Economic forecasting is little different, according to two academic economists, Jerker Denrell and Christina Fang:

Economists who had a better record at calling extreme events had a worse record in general. "The analyst with the largest number as well as the highest proportion of accurate and extreme forecasts," they wrote, "had, by far, the worst forecasting record."

Their findings are also discouraging for those of us using history to inspire strategy. Success, Denrell has found,

is an especially bad teacher. In 2003 he published a paper arguing that when people study success stories exclusively--as many avid devourers of business self-help books do--they come away with a vastly oversimplified idea of what it takes to succeed. This is because success is what economists refer to as a "noisy signal." It's chancy, fickle, and composed of so many moving parts that any one is basically meaningless in the context of the real world. By studying what successful ventures have in common (persistence, for instance), people miss the invaluable lessons contained in the far more common experience of failure. They ignore the high likelihood that a company will flop--the base rate--and wind up wildly overestimating the chances of success.

Maybe that's why there are so few super-rich economists, and zero historians of technology or business. In all the lists of billionaires I've seen, it's hard to find one who made his or her fortune by relatively accurate predictions of technology or markets. The greatest fundamental investor, Warren Buffett, is famous for declaring that he never puts money in anything so advanced it's hard to understand. George Soros' coups are closer to high-stakes poker than to crystal-gazing. (Consider his stand on gold.) There are a few consistent hedge fund geniuses like Renaissance Technologies' James Simons, but of course they rarely publish anything about their methods, and their prowess appears to rest on recruiting brilliant staffs to help them discover new market anomalies as the value of successful strategies decays. And even Simons' newer funds have been disappointing performers. (The funds you really would like to buy, always seem to be closed to new investors, as that doctor you've heard so much about isn't accepting further patients.)

Keohane and Denrell certainly have a point about how misleading examples can be, but the positive-thinking genre has survived even its ablest debunkers intact--curiously like astrology, which would seem to pose limits to the optimistic human will.

The challenge in thinking about the future consists of harnessing simultaneously our expansive and cautionary minds. Jeff Bezos, taking an enormous risk on the future of the Web and giving up a lucrative hedge fund job, made a veteran tech skeptic his first employee, according to Wired. The programmer, Shel Kaphan,

has a reputation among the engineering staff at as the prototypical pessimist, a geek convinced that the company's systems are always on the verge of implosion. He came by his doomsaying honestly - he had worked for at least a dozen companies before, including failed start-ups and bureaucratically inept monsters. Shortly before he and Bezos met he had left Kaleida Labs, an ill-fated Apple spin-off, which makes it all the more remarkable that he almost immediately found Bezos trustworthy - so trustworthy, in fact, that Kaphan agreed in short order to relocate to Seattle.

So it's not enough to say that most things fail. The research cited by Keohane suggests that consistent pessimism also isn't terribly accurate or helpful. In fact there's a bright side to humanity's inability to predict the future accurately, which I recently explored here.

Presented by

Edward Tenner is a historian of technology and culture, and an affiliate of the Center for Arts and Cultural Policy at Princeton's Woodrow Wilson School. He was a founding advisor of Smithsonian's Lemelson Center.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register with Disqus.

Please note that The Atlantic's account system is separate from our commenting system. To log in or register with The Atlantic, use the Sign In button at the top of every page.

blog comments powered by Disqus


The Absurd Psychology of Restaurant Menus

Would people eat healthier if celery was called "cool celery?"


This Japanese Inn Has Been Open For 1,300 Years

It's one of the oldest family businesses in the world.


What Happens Inside a Dying Mind?

Science cannot fully explain near-death experiences.


Is Minneapolis the Best City in America?

No other place mixes affordability, opportunity, and wealth so well.

More in National

From This Author

Just In