I know that Paul Krugman was not really serious when he linked this study naming him the most accurate prognosticator in America. Nonetheless, it's getting some play around the internet, and a warm reception from people who don't seem to know any better, so it's worth pointing out why this sort of thing is so dreadful. I mean, I'm sure it was a very fine senior project for the Hamilton College students who produced it, but the results tell us nothing at all about the state of prognostication in this country.
Krugman quotes this segment from the Hamilton College press release:
Now, a class at Hamilton College led by public policy professor P. Gary Wyckoff has analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.
The students found that only nine of the prognosticators they studied could predict more accurately than a coin flip. Two were significantly less accurate, and the remaining 14 were not statistically any better or worse than a coin flip.
The top prognosticators - led by New York Times columnist Paul Krugman - scored above five points and were labeled "Good," while those scoring between zero and five were "Bad." Anyone scoring less than zero (which was possible because prognosticators lost points for inaccurate predictions) were put into "The Ugly" category. Syndicated columnist Cal Thomas came up short and scored the lowest of the 26.
I myself read Paul Krugman more often than Cal Thomas, so perhaps I should take this as evidence of my perspicacity . . . but no. This is nonsense. The study runs for a little over a year, between September 2007 and 2008. They didn't even look at all of the statements made by the prognosticators, but at a "representative sample", presumably because they couldn't handle the volume that would be required to analyze all of it. Some of the prognosticators made too few testable predictions to generate good results, and the riskiness of the prediction varied--someone who predicted that Obama was going to win the election in October 2008 seems to have gotten the same "score" for that flip as someone who predicted that Obama would do so in September 2007. The number of predictions varied between commentators, making comparison even more difficult.
Against this background, it makes no sense to say--as the students and the press release do--that this study shows that "a number of individuals in our sample, including Paul Krugman, Maureen Dowd, Ed Rendell, Chuck Schumer, Nancy Pelosi, and Kathleen Parker were better than a coin flip (sometimes, substantially so.)" One of the commonest fallacies you see among beginning students of probability is the belief that if a coin has a 50% chance of turning up heads, then anyone who flips a coin multiple times should end up getting half heads, and half tails.
This is not true--especially when you have a small number of "flips", as most of the prognosticators did. (It's not surprising that George Will, who made the greatest number of predictions, was statistically very close to zero.) Rather, if you get a bunch of people to flip coins a bunch of times, you'll get a distribution. Most of the results will cluster close to 50/50 (as was true in this case), but you'll get outliers.
This is often pointed out in the case of mutual fund managers, as John Bogle does using this graph:
And indeed, my finance profs taught me that the top mutual funds in a given year are not any more likely to show up as next year's top funds. Indeed, they may be less likely to do well the next year. Why? Because funds have strategies, which do better or worse depending on market conditions. The funds that do well in a given year are probably the funds that were especially well positioned to show outsized fluctuations in response to whatever changed that year--but that also means that they're especially likely to do lose money when those conditions change. Because the fluctuations are a random walk, they do not vindicate the fund manager's strategy or perspicacity--but they may seem to, temporarily.
Which may cast some light on why liberal pundits did especially well in this test. If you were the sort of person who is systematically biased towards predicting a bad end for Republicans, and a rosy future for Democrats, then election year 2008 was going to make you look like a genius. If you were the sort of person who takes a generally dim view of anything Democrats get up to, then your pessimism was probably going to hit more often than it missed.
It would be interesting to go back and look at the same group in the year running up to 2010. But even then, it would tell us very little. To do any sort of a true test, we'd have to get a bunch of these prognosticators to all make predictions about the same binary events, over a lengthy period of time, and then see how they fared over a multi-year period. I suspect that they'd end up looking a lot like mutual fund managers: little variation that could be distinguished from random variance.
Once you take into account their fees, mutual fund managers, as a group, underperform the market. And I suspect you'd see the same thing with pundits: as a group, they'd slightly underperform a random coin flip. People like Lindsay Graham cannot go on Meet the Press and say "Yup, we're going to lose on November 2nd" even when it is completely obvious that this is what will happen; they need to present an optimistic bias for their base. Over time, that optimistic bias about no-hope causes will cause a slight negative drag on the predictive power of their statements.
Does that undermine the credibility of pundits? I don't think that predictions are the fundamental purpose of punditry (though I do encourage people to make them as a way of raising the stakes on the truth claims they make, and in order to give us a benchmark against which to analyze our reasoning). Pundits offer predictions, yes, but more importantly, they offer you facts, context, and analysis. Their really important work is to help you make your own wrong predictions about the world.
In an interview, the U.S. president ties his legacy to a pact with Tehran, argues ISIS is not winning, warns Saudi Arabia not to pursue a nuclear-weapons program, and anguishes about Israel.
On Tuesday afternoon, as President Obama was bringing an occasionally contentious but often illuminating hour-long conversation about the Middle East to an end, I brought up a persistent worry. “A majority of American Jews want to support the Iran deal,” I said, “but a lot of people are anxiety-ridden about this, as am I.” Like many Jews—and also, by the way, many non-Jews—I believe that it is prudent to keep nuclear weapons out of the hands of anti-Semitic regimes. Obama, who earlier in the discussion had explicitly labeled the supreme leader of Iran, Ayatollah Ali Khamenei, an anti-Semite, responded with an argument I had not heard him make before.
“Look, 20 years from now, I’m still going to be around, God willing. If Iran has a nuclear weapon, it’s my name on this,” he said, referring to the apparently almost-finished nuclear agreement between Iran and a group of world powers led by the United States. “I think it’s fair to say that in addition to our profound national-security interests, I have a personal interest in locking this down.”
New research confirms what they say about nice guys.
Smile at the customer. Bake cookies for your colleagues. Sing your subordinates’ praises. Share credit. Listen. Empathize. Don’t drive the last dollar out of a deal. Leave the last doughnut for someone else.
Sneer at the customer. Keep your colleagues on edge. Claim credit. Speak first. Put your feet on the table. Withhold approval. Instill fear. Interrupt. Ask for more. And by all means, take that last doughnut. You deserve it.
Follow one of those paths, the success literature tells us, and you’ll go far. Follow the other, and you’ll die powerless and broke. The only question is, which is which?
Of all the issues that preoccupy the modern mind—Nature or nurture? Is there life in outer space? Why can’t America field a decent soccer team?—it’s hard to think of one that has attracted so much water-cooler philosophizing yet so little scientific inquiry. Does it pay to be nice? Or is there an advantage to being a jerk?
A scholar’s analysis of American culture presumes too much.
Last week, Gawkerinterviewed Robin DiAngelo, a professor of multicultural education at Westfield State University. She discussed aspects of her thinking on whiteness, which are set forth at length in her book, What Does it Mean to be White? I’ve ordered the book.
Meanwhile, her remarks on police brutality piqued my interest. Some of what Professor DiAngelo said is grounded in solid empirical evidence: blacks and Hispanics are disproportionately victimized by misbehaving police officers; there are neighborhoods where police help maintain racial and class boundaries. And if our culture, which she calls “the water we swim in,” contained fewer parts racism per million, I suspect that police brutality would be less common.
The former secretary of state jettisons sweeping rhetoric, and focuses on specific policies.
Hillary Clinton has been an official candidate for president for five weeks, and she still hasn’t done the thing most candidates do on day one: given a speech laying out her vision for America. Nor is she planning on doing so anytime soon. Politicoreports that Hillary’s “why I’m running for president,” speech, initially scheduled for May, has now been delayed until June, or even later.
There’s a reason for that: The speech is unlikely to be very good. Soaring rhetoric and grand themes have never been Hillary’s strengths. That’s one reason so many liberals found her so much less inspirational than Barack Obama in 2008. And it’s a problem with deep roots. In his biography, A Woman in Charge, Carl Bernstein describes Hillary, then in law school, struggling to articulate her generation’s perspective in an address to the League of Women Voters. “If she was speaking about a clearly defined subject,” Bernstein writes, “her thoughts would be well organized, finely articulated, and delivered in almost perfect outline form. But before the League audience, she again and again lapsed into sweeping abstractions.”
The Islamic State is no mere collection of psychopaths. It is a religious group with carefully considered beliefs, among them that it is a key agent of the coming apocalypse. Here’s what that means for its strategy—and for how to stop it.
What is the Islamic State?
Where did it come from, and what are its intentions? The simplicity of these questions can be deceiving, and few Western leaders seem to know the answers. In December, The New York Times published confidential comments by Major General Michael K. Nagata, the Special Operations commander for the United States in the Middle East, admitting that he had hardly begun figuring out the Islamic State’s appeal. “We have not defeated the idea,” he said. “We do not even understand the idea.” In the past year, President Obama has referred to the Islamic State, variously, as “not Islamic” and as al-Qaeda’s “jayvee team,” statements that reflected confusion about the group, and may have contributed to significant strategic errors.
In any case, people have probably heard the phrase in reference to something gone awry at work or in life. In either setting, when the shit does hit the fan, people will tend to look to the most competent person in the room to take over.
And too bad for that person. A new paper by a team of researchers from Duke University, University of Georgia, and University of Colorado looks at not only how extremely competent people are treated by their co-workers and peers, but how those people feel when, at crucial moments, everyone turns to them. They find that responsible employees are not terribly pleased about this dynamic either.
Advocates say that a guaranteed basic income can lead to more creative, fulfilling work. The question is how to fund it.
Scott Santens has been thinking a lot about fish lately. Specifically, he’s been reflecting on the aphorism, “If you give a man a fish, he eats for a day. If you teach a man to fish, he eats for life.” What Santens wants to know is this: “If you build a robot to fish, do all men starve, or do all men eat?”
Santens is 37 years old, and he’s a leader in the basic income movement—a worldwide network of thousands of advocates (26,000 on Reddit alone) who believe that governments should provide every citizen with a monthly stipend big enough to cover life’s basic necessities. The idea of a basic income has been around for decades, and it once drew support from leaders as different as Martin Luther King Jr. and Richard Nixon. But rather than waiting for governments to act, Santens has started crowdfunding his own basic income of $1,000 per month. He’s nearly halfway to his his goal.
The big change: None of the officers was indicted for false imprisonment. That’s notable, because Mosby emphasized during her initial statement that Gray’s very arrest was illegal, saying officers had no basis for detaining him.
In September 2009, the second platoon of Charlie Company arrived in Afghanistan with 42 men. Ten months later, nearly half had been killed or wounded, mostly in the Arghandab Valley—a key to controlling southern Afghanistan. Now these 82nd Airborne troops were getting ready to leave the Arghandab behind. They had one more dangerous job to do: a joint mission with the untried artillery unit that would replace them patrolling the fields, orchards, and villages they called the Devil’s Playground.
July 11, 2010, 11:09 a.m.
Staff Sergeant Christopher Gerhart’s stomach rolled, queasy. He stood alone under a trellis heavy with fat bunches of white grapes, planted his hands against a mud wall, and stared at the ground, head rocking as “Love Lost in a Hail of Gunfire,” by the heavy-metal band Bleeding Through, blasted from his headphones. Gerhart had already deployed three times to Afghanistan and once to Iraq. Promoted 10 days earlier, he was 22, brash and outgoing. “You grow up quick out here,” he’d told me. “You’ve got to. You can’t be a little kid when your buddy gets blown up next to you.”