I know that Paul Krugman was not really serious when he linked this study naming him the most accurate prognosticator in America. Nonetheless, it's getting some play around the internet, and a warm reception from people who don't seem to know any better, so it's worth pointing out why this sort of thing is so dreadful. I mean, I'm sure it was a very fine senior project for the Hamilton College students who produced it, but the results tell us nothing at all about the state of prognostication in this country.
Krugman quotes this segment from the Hamilton College press release:
Now, a class at Hamilton College led by public policy professor P. Gary Wyckoff has analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.
The students found that only nine of the prognosticators they studied could predict more accurately than a coin flip. Two were significantly less accurate, and the remaining 14 were not statistically any better or worse than a coin flip.
The top prognosticators - led by New York Times columnist Paul Krugman - scored above five points and were labeled "Good," while those scoring between zero and five were "Bad." Anyone scoring less than zero (which was possible because prognosticators lost points for inaccurate predictions) were put into "The Ugly" category. Syndicated columnist Cal Thomas came up short and scored the lowest of the 26.
I myself read Paul Krugman more often than Cal Thomas, so perhaps I should take this as evidence of my perspicacity . . . but no. This is nonsense. The study runs for a little over a year, between September 2007 and 2008. They didn't even look at all of the statements made by the prognosticators, but at a "representative sample", presumably because they couldn't handle the volume that would be required to analyze all of it. Some of the prognosticators made too few testable predictions to generate good results, and the riskiness of the prediction varied--someone who predicted that Obama was going to win the election in October 2008 seems to have gotten the same "score" for that flip as someone who predicted that Obama would do so in September 2007. The number of predictions varied between commentators, making comparison even more difficult.
Against this background, it makes no sense to say--as the students and the press release do--that this study shows that "a number of individuals in our sample, including Paul Krugman, Maureen Dowd, Ed Rendell, Chuck Schumer, Nancy Pelosi, and Kathleen Parker were better than a coin flip (sometimes, substantially so.)" One of the commonest fallacies you see among beginning students of probability is the belief that if a coin has a 50% chance of turning up heads, then anyone who flips a coin multiple times should end up getting half heads, and half tails.
This is not true--especially when you have a small number of "flips", as most of the prognosticators did. (It's not surprising that George Will, who made the greatest number of predictions, was statistically very close to zero.) Rather, if you get a bunch of people to flip coins a bunch of times, you'll get a distribution. Most of the results will cluster close to 50/50 (as was true in this case), but you'll get outliers.
This is often pointed out in the case of mutual fund managers, as John Bogle does using this graph:
And indeed, my finance profs taught me that the top mutual funds in a given year are not any more likely to show up as next year's top funds. Indeed, they may be less likely to do well the next year. Why? Because funds have strategies, which do better or worse depending on market conditions. The funds that do well in a given year are probably the funds that were especially well positioned to show outsized fluctuations in response to whatever changed that year--but that also means that they're especially likely to do lose money when those conditions change. Because the fluctuations are a random walk, they do not vindicate the fund manager's strategy or perspicacity--but they may seem to, temporarily.
Which may cast some light on why liberal pundits did especially well in this test. If you were the sort of person who is systematically biased towards predicting a bad end for Republicans, and a rosy future for Democrats, then election year 2008 was going to make you look like a genius. If you were the sort of person who takes a generally dim view of anything Democrats get up to, then your pessimism was probably going to hit more often than it missed.
It would be interesting to go back and look at the same group in the year running up to 2010. But even then, it would tell us very little. To do any sort of a true test, we'd have to get a bunch of these prognosticators to all make predictions about the same binary events, over a lengthy period of time, and then see how they fared over a multi-year period. I suspect that they'd end up looking a lot like mutual fund managers: little variation that could be distinguished from random variance.
Once you take into account their fees, mutual fund managers, as a group, underperform the market. And I suspect you'd see the same thing with pundits: as a group, they'd slightly underperform a random coin flip. People like Lindsay Graham cannot go on Meet the Press and say "Yup, we're going to lose on November 2nd" even when it is completely obvious that this is what will happen; they need to present an optimistic bias for their base. Over time, that optimistic bias about no-hope causes will cause a slight negative drag on the predictive power of their statements.
Does that undermine the credibility of pundits? I don't think that predictions are the fundamental purpose of punditry (though I do encourage people to make them as a way of raising the stakes on the truth claims they make, and in order to give us a benchmark against which to analyze our reasoning). Pundits offer predictions, yes, but more importantly, they offer you facts, context, and analysis. Their really important work is to help you make your own wrong predictions about the world.
Why Nixon's former lawyer John Dean worries Trump could be one of the most corrupt presidents ever—and get away with it
Sometime early last fall, John Dean says he began having nightmares about a Trump presidency. He would wake in the middle of the night, agitated and alarmed, struggling to calm his nerves. “I’m not somebody who remembers the details of dreams,” he told me in a recent phone call from his home in Los Angeles. “I just know that they were so bad that I’d force myself awake and out of bed just to get away from them.”
Few people are more intimately acquainted than Dean with the consequences of an American presidency gone awry. As White House counsel under President Richard Nixon from 1970 to 1973, he was a key figure in the Watergate saga—participating in, and then helping to expose, the most iconic political scandal in modern U.S. history. In the decades since then, Dean has parlayed that resume line into something of a franchise, penning several books and countless columns on the theme of presidential abuses of power.
After an unexpected loss in November, Democrats are nowhere near ready to take on the president-elect.
For Democrats and other progressive types, Winter Is Coming. Scratch that. Winter has hit—full force—and hordes of White Walkers are now wilding across the land.
It’s not merely that the party’s presidential dreams were crushed. Defeat came at the hands of a chest-thumping reality-TV star with the attention span of a toddler on speed to whom the norms of civilized society, much less politics, don’t seem to apply. Donald Trump’s jerkiness is central to his appeal, and for whatever cocktail of reasons—fear, awe, confusion—even many of the guy’s detractors find him hard to resist.
How the heck is non-Trump America supposed to forge an effective opposition to such a character, especially when his political team controls all the levers of power?
Is there room in the movement for people who morally object to abortion?
Updated on Monday, January 16 at 4:05 p.m.
Pro-life women are headed to D.C. Yes, they’ll turn out for the annual March for Life, which is coming up on January 27. But one week earlier, as many as a few hundred pro-lifers are planning to attend the Women’s March on Washington, which has been billed as feminist counterprogramming to the inauguration.
With organizations like Planned Parenthood and NARAL Pro-Choice America co-sponsoring the event, pro-life marchers have found themselves in a somewhat awkward position. What’s their place at an event that claims to speak for all women, but has aligned itself with pro-choice groups? With roughly a week to go before the march, organizers also released a set of “unity principles,” and one of them is “open access to safe, legal, affordable abortion and birth control for all people.”
Why some people are withdrawing from mainstream society into “intentional communities”—and what the rest of the country can learn from them
VIRGINIA— For the last eight years, Nicolas and Rachel Sarah have been slowly weaning themselves off fossil fuels. They don’t own a refrigerator or a car; their year-old baby and four-year-old toddler play by candlelight rather than electricity at night. They identify as Christian anarchists, and have given an official name to their search for an alternative to consumption-heavy American life: the Downstream Project, with the motto to “do unto those downstream as you would have those upstream do unto you.”
As it turns out, exiting the system is a challenging, time-consuming, and surprisingly technical process. Here in the Shenandoahs and central Virginia, a handful of tiny communities are experimenting with what it means to reject the norms of contemporary life and exist in a radically different way. They seem to share Americans’ pervasive sense of political alienation, which arguably reached an apotheosis with the election of Donald Trump: a sense of division from their peers, a distrust of government. The challenges of modern politics—dealing with issues like climate change, poverty, mass migration, and war on a global scale—are so vast and abstract that it’s difficult not to find them overwhelming. But instead of continuing in passive despair, as many Americans seem to do, the people in these communities decided to overhaul their lives.
Can Republicans repeal Obamacare without imposing the greatest costs on the older, white, blue-collar voters who put Trump into office?
As congressional Republicans race to repeal and replace President Obama’s Affordable Care Act, one of their principal challenges is finding an alternative that does not expose older and less affluent white voters at the core of Donald Trump’s electoral coalition to greater costs and financial risk.
The paradox of the health-reform debate is that many of Obamacare’s key elements raised costs on younger and healthier people who generally vote Democratic as a means of limiting the financial exposure of older and sicker people, even as older whites have stampeded toward the GOP. Conversely, many of the central ideas common to the Republican replacement plans would lower costs for younger and healthier adults while exposing people with greater health needs, many of them older, to the risk of much larger out-of-pocket costs, even if it reduces the health-insurance premiums they initially pay.
Billy Barr moved to the Rocky Mountains four decades ago, got bored one winter, and decided to keep a notebook that has become the stuff of legend.
It was a year into his life alone in Colorado’s Rocky Mountains when Billy Barr began his recordings. It started as a curiosity, a task to busy his mind during the winter. By no means, Barr told me, having skied down from his cabin to use the nearest phone, did he set out to make a vital database for climate change scientists. “Hell no!” he said. “I didn’t know anything about climate change at the time.”
In 1973 Barr had dropped out of college and made his home an abandoned mining shack at the base of Gothic Mountain, a 12,600-foot stone buttress. The cold winds blew through the shack’s wood slat walls as if they didn’t exist; he shared the bare dirt floor with a skunk and pine marten, his only regular company for much of the year. Barr had moved from the East Coast to the Rocky Mountains precisely because of the solitude, but he couldn’t escape boredom. Especially that first winter. So he measured snow levels, animal tracks, and in spring the first jubilant calls of birds returning. He filled a notebook with these observations; then another notebook. This has continued now for 44 years.
A history of the first African American White House—and of what came next
In the waning days of President Barack Obama’s administration, he and his wife, Michelle, hosted a farewell party, the full import of which no one could then grasp. It was late October, Friday the 21st, and the president had spent many of the previous weeks, as he would spend the two subsequent weeks, campaigning for the Democratic presidential nominee, Hillary Clinton. Things were looking up. Polls in the crucial states of Virginia and Pennsylvania showed Clinton with solid advantages. The formidable GOP strongholds of Georgia and Texas were said to be under threat. The moment seemed to buoy Obama. He had been light on his feet in these last few weeks, cracking jokes at the expense of Republican opponents and laughing off hecklers. At a rally in Orlando on October 28, he greeted a student who would be introducing him by dancing toward her and then noting that the song playing over the loudspeakers—the Gap Band’s “Outstanding”—was older than she was.
King's famous "Letter from Birmingham Jail," published in The Atlantic as "The Negro Is Your Brother" and excerpted below, was written in response to a public statement of concern and caution issued by eight white religious leaders of the South. It stands as one of the classic documents of the civil-rights movement.
While confined here in the Birmingham city jail, I came across your recent statement calling our present activities "unwise and untimely." Seldom, if ever, do I pause to answer criticism of my work and ideas. If I sought to answer all of the criticisms that cross my desk, my secretaries would be engaged in little else in the course of the day, and I would have no time for constructive work. But since I feel that you are men of genuine good will and your criticisms are sincerely set forth, I would like to answer your statement in what I hope will be patient and reasonable terms.
I think I should give the reason for my being in Birmingham, since you have been influenced by the argument of "outsiders coming in"
The president-elect described NATO as “obsolete,” called the EU “basically a vehicle for Germany,” and said other countries would follow the UK's lead and leave the bloc.
President-elect Donald Trump hasn’t been shy about sharing his views about the world, in general, and Europe, in particular. He was criticized during the presidential campaign for questioning the value of NATO, praising the U.K.’s decision to leave the EU, and linking terrorist attacks to the million or so asylum-seekers who have arrived in Europe since 2015. Trump’s supporters and political analysts attributed those comments to campaign-season rhetoric, and said he would pivot on these and other issues before the general election. But with less than a week before the inauguration at which he’ll be sworn in as the 45th president of the United States, Trump gave a joint interview to The Times (of London) and Bild, the mass-circulation German tabloid, during which he described NATO as “obsolete,” called the EU “basically a vehicle for Germany,” and said other countries would follow the U.K.’s lead and leave the bloc.
Narcissism, disagreeableness, grandiosity—a psychologist investigates how Trump’s extraordinary personality might shape his possible presidency.
In 2006, Donald Trump made plans to purchase the Menie Estate, near Aberdeen, Scotland, aiming to convert the dunes and grassland into a luxury golf resort. He and the estate’s owner, Tom Griffin, sat down to discuss the transaction at the Cock & Bull restaurant. Griffin recalls that Trump was a hard-nosed negotiator, reluctant to give in on even the tiniest details. But, as Michael D’Antonio writes in his recent biography of Trump, Never Enough, Griffin’s most vivid recollection of the evening pertains to the theatrics. It was as if the golden-haired guest sitting across the table were an actor playing a part on the London stage.
“It was Donald Trump playing Donald Trump,” Griffin observed. There was something unreal about it.