Bad News for Aspiring Gurus?

More

The Boston Globe's take on the frequent misses of the formerly doomsaying economist Nouriel Roubini is discouraging for those who think they've found the right forecasting formula--and for everyone else looking for somebody who has.

Joe Keohane cites especially the work of the political scientist Philip Tetlock, who revealed that the formula for successful political prophecy is to make frequent and bold claims. People will remember only the correct calls. Economic forecasting is little different, according to two academic economists, Jerker Denrell and Christina Fang:

Economists who had a better record at calling extreme events had a worse record in general. "The analyst with the largest number as well as the highest proportion of accurate and extreme forecasts," they wrote, "had, by far, the worst forecasting record."

Their findings are also discouraging for those of us using history to inspire strategy. Success, Denrell has found,

is an especially bad teacher. In 2003 he published a paper arguing that when people study success stories exclusively--as many avid devourers of business self-help books do--they come away with a vastly oversimplified idea of what it takes to succeed. This is because success is what economists refer to as a "noisy signal." It's chancy, fickle, and composed of so many moving parts that any one is basically meaningless in the context of the real world. By studying what successful ventures have in common (persistence, for instance), people miss the invaluable lessons contained in the far more common experience of failure. They ignore the high likelihood that a company will flop--the base rate--and wind up wildly overestimating the chances of success.

Maybe that's why there are so few super-rich economists, and zero historians of technology or business. In all the lists of billionaires I've seen, it's hard to find one who made his or her fortune by relatively accurate predictions of technology or markets. The greatest fundamental investor, Warren Buffett, is famous for declaring that he never puts money in anything so advanced it's hard to understand. George Soros' coups are closer to high-stakes poker than to crystal-gazing. (Consider his stand on gold.) There are a few consistent hedge fund geniuses like Renaissance Technologies' James Simons, but of course they rarely publish anything about their methods, and their prowess appears to rest on recruiting brilliant staffs to help them discover new market anomalies as the value of successful strategies decays. And even Simons' newer funds have been disappointing performers. (The funds you really would like to buy, always seem to be closed to new investors, as that doctor you've heard so much about isn't accepting further patients.)

Keohane and Denrell certainly have a point about how misleading examples can be, but the positive-thinking genre has survived even its ablest debunkers intact--curiously like astrology, which would seem to pose limits to the optimistic human will.

The challenge in thinking about the future consists of harnessing simultaneously our expansive and cautionary minds. Jeff Bezos, taking an enormous risk on the future of the Web and giving up a lucrative hedge fund job, made a veteran tech skeptic his first employee, according to Wired. The programmer, Shel Kaphan,

has a reputation among the engineering staff at Amazon.com as the prototypical pessimist, a geek convinced that the company's systems are always on the verge of implosion. He came by his doomsaying honestly - he had worked for at least a dozen companies before Amazon.com, including failed start-ups and bureaucratically inept monsters. Shortly before he and Bezos met he had left Kaleida Labs, an ill-fated Apple spin-off, which makes it all the more remarkable that he almost immediately found Bezos trustworthy - so trustworthy, in fact, that Kaphan agreed in short order to relocate to Seattle.

So it's not enough to say that most things fail. The research cited by Keohane suggests that consistent pessimism also isn't terribly accurate or helpful. In fact there's a bright side to humanity's inability to predict the future accurately, which I recently explored here.

Jump to comments

Edward Tenner is a historian of technology and culture. He was a founding advisor of Smithsonian's Lemelson Center and holds a Ph.D in European history. More

Edward Tenner is an independent writer and speaker on the history of technology and the unintended consequences of innovation. He holds a Ph.D. in European history from the University of Chicago and was executive editor for physical science and history at Princeton University Press. A former member of the Harvard Society of Fellows and John Simon Guggenheim fellow, he has been a visiting lecturer at Princeton and has held visiting research positions at the Institute for Advanced Study, Woodrow Wilson International Center for Scholars, and the Princeton Center for Information Technology Policy. He is now a visiting scholar in the Rutgers School of Communication and Information and an affiliate of the Center for Arts and Cultural Policy of Princeton's Woodrow Wilson School. He was a founding advisor of Smithsonian's Lemelson Center, where he remains a senior research associate.
Get Today's Top Stories in Your Inbox (preview)


Elsewhere on the web

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

Miami: The Next Big Start-Up City?

How the city became a center for innovation

Video

Video

A Brief History of Romantic Comedies

From The Atlantic's Chris Orr

Video

Life in 'the New Arctic'

A moving portrait of a fading landscape

Video

Video

The Rise of New York City

A fascinating look at Manhattan in the 1940s

Video

What Is Methane Hydrate?

"Flaming ice" is a vast natural energy source

Video

NASA's Time-Lapse of the Sun

Now with epic dubstep music

Video

Shaken Not Tuned: Cocktail Experiments

Can a tuning fork improve a cocktail?

Video

Video

Is He Cheating? A 1950s Guide

'That little blonde secretary from the office?’

Video

New Yorkers: Vintage Vacuum-Tube Amps

Risking electric shock to restore old amplifiers

Video

The DIY Piano-Bicycle

Everybody needs a hobby

Video

What Does It Take to Make Real Craft Gin?

Tour the Green Hat Gin distillery

Video

Letter From the Editor

The June 2013 issue

Video

What Straights Can Learn From Same-Sex Couples

New insight from decades of research

Video

The End of the Mall Rat

A tribute to that pillar of teen culture

Writers

Up
Down

More in National

In Focus

Picking up the Pieces After the Tornado in Moore, Oklahoma

From This Author

Just In