I know that Paul Krugman was not really serious when he linked this study naming him the most accurate prognosticator in America. Nonetheless, it's getting some play around the internet, and a warm reception from people who don't seem to know any better, so it's worth pointing out why this sort of thing is so dreadful. I mean, I'm sure it was a very fine senior project for the Hamilton College students who produced it, but the results tell us nothing at all about the state of prognostication in this country.
Krugman quotes this segment from the Hamilton College press release:
Now, a class at Hamilton College led by public policy professor P. Gary Wyckoff has analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.
The students found that only nine of the prognosticators they studied could predict more accurately than a coin flip. Two were significantly less accurate, and the remaining 14 were not statistically any better or worse than a coin flip.
The top prognosticators - led by New York Times columnist Paul Krugman - scored above five points and were labeled "Good," while those scoring between zero and five were "Bad." Anyone scoring less than zero (which was possible because prognosticators lost points for inaccurate predictions) were put into "The Ugly" category. Syndicated columnist Cal Thomas came up short and scored the lowest of the 26.
I myself read Paul Krugman more often than Cal Thomas, so perhaps I should take this as evidence of my perspicacity . . . but no. This is nonsense. The study runs for a little over a year, between September 2007 and 2008. They didn't even look at all of the statements made by the prognosticators, but at a "representative sample", presumably because they couldn't handle the volume that would be required to analyze all of it. Some of the prognosticators made too few testable predictions to generate good results, and the riskiness of the prediction varied--someone who predicted that Obama was going to win the election in October 2008 seems to have gotten the same "score" for that flip as someone who predicted that Obama would do so in September 2007. The number of predictions varied between commentators, making comparison even more difficult.
Against this background, it makes no sense to say--as the students and the press release do--that this study shows that "a number of individuals in our sample, including Paul Krugman, Maureen Dowd, Ed Rendell, Chuck Schumer, Nancy Pelosi, and Kathleen Parker were better than a coin flip (sometimes, substantially so.)" One of the commonest fallacies you see among beginning students of probability is the belief that if a coin has a 50% chance of turning up heads, then anyone who flips a coin multiple times should end up getting half heads, and half tails.
This is not true--especially when you have a small number of "flips", as most of the prognosticators did. (It's not surprising that George Will, who made the greatest number of predictions, was statistically very close to zero.) Rather, if you get a bunch of people to flip coins a bunch of times, you'll get a distribution. Most of the results will cluster close to 50/50 (as was true in this case), but you'll get outliers.
This is often pointed out in the case of mutual fund managers, as John Bogle does using this graph:
And indeed, my finance profs taught me that the top mutual funds in a given year are not any more likely to show up as next year's top funds. Indeed, they may be less likely to do well the next year. Why? Because funds have strategies, which do better or worse depending on market conditions. The funds that do well in a given year are probably the funds that were especially well positioned to show outsized fluctuations in response to whatever changed that year--but that also means that they're especially likely to do lose money when those conditions change. Because the fluctuations are a random walk, they do not vindicate the fund manager's strategy or perspicacity--but they may seem to, temporarily.
Which may cast some light on why liberal pundits did especially well in this test. If you were the sort of person who is systematically biased towards predicting a bad end for Republicans, and a rosy future for Democrats, then election year 2008 was going to make you look like a genius. If you were the sort of person who takes a generally dim view of anything Democrats get up to, then your pessimism was probably going to hit more often than it missed.
It would be interesting to go back and look at the same group in the year running up to 2010. But even then, it would tell us very little. To do any sort of a true test, we'd have to get a bunch of these prognosticators to all make predictions about the same binary events, over a lengthy period of time, and then see how they fared over a multi-year period. I suspect that they'd end up looking a lot like mutual fund managers: little variation that could be distinguished from random variance.
Once you take into account their fees, mutual fund managers, as a group, underperform the market. And I suspect you'd see the same thing with pundits: as a group, they'd slightly underperform a random coin flip. People like Lindsay Graham cannot go on Meet the Press and say "Yup, we're going to lose on November 2nd" even when it is completely obvious that this is what will happen; they need to present an optimistic bias for their base. Over time, that optimistic bias about no-hope causes will cause a slight negative drag on the predictive power of their statements.
Does that undermine the credibility of pundits? I don't think that predictions are the fundamental purpose of punditry (though I do encourage people to make them as a way of raising the stakes on the truth claims they make, and in order to give us a benchmark against which to analyze our reasoning). Pundits offer predictions, yes, but more importantly, they offer you facts, context, and analysis. Their really important work is to help you make your own wrong predictions about the world.
It isn’t the only democratic institution that finds itself in danger.
Four years ago, as a speechwriter for President Obama, I commissioned a binder full of women.
A little context. It was the morning of the Al Smith Dinner, the election-year tradition in which both parties’ nominees don white-tie attire and deliver comedy monologues to New York City’s elite. Our opponent, Governor Mitt Romney had recently used the words “binders full of women” while discussing gender parity in government. Eager to mock the clumsy phrase, I asked a staffer on the advance team to put together a prop.
But our binder never saw the light of day. Obama nixed the idea. I remember being disappointed by the president’s decision, and wondering if POTUS was phoning it in. Of the jokes that did make it into the final draft, one in particular stood out for its authenticity.
First there was McCain’s caving to Bush’s signing statement on his own torture bill, then his selection of an extremely unqualified and unvetted running mate, then he backed Trump until nearly the bitter end—even after Trump insulted his POW experience and his fellow vets with PTSD. And now, a shameless betrayal of constitutional principle that would have gotten far more attention this week if Trump hadn’t one-upped McCain with all his incendiary “rigged” rhetoric. Reader Don explains:
I don’t know if your readers have seen this yet, but it seems that McCain has announced that his fellow GOP Senators will not confirm any Supreme Court nomination by Clinton. Trump is an ignorant, narcissistic, nasty piece of work. But McCain used to be a guy who remembered and honored (at least sometimes) the old bipartisan traditions of the Senate. His statement is just outrageous and inexcusable. What he’s basically saying is that only Republican presidents get to appoint Supreme Court Justices.
I understand that their thinking is that they don’t want the bias of the Court to shift from conservative to liberal. But the Court has shifted back and forth over the years, and we have managed to survive those changes. Apparently, today’s Republican Party feels that the country somehow won’t survive a Democratic administration or a liberal Supreme Court.
We have what might be described as an asymmetric politics. One party disagrees with the other party’s policy domestic policy positions, but recognizes the legitimacy of an opposition party and accepts that the other party is patriotic and loyal to the country. The other party rejects the legitimacy and loyalty of the other party. The efforts to de-legitimize former President Clinton, President Obama, and likely future President Hillary Clinton are part of this effort. The refusal of the GOP Congress to allow Obama any legislative accomplishments was another part of it. I expect that a GOP House will adopt the same obstructionist tactics starting in 2017.
People predict that the U.S. population will continue to get younger, better educated, and less white. I hope our political experiment lasts long enough to see that day.
“Light” events are some of the heaviest lifting in political life. Comedy is hard to begin with, and for the kinds of people involved in politics, jokes are vastly more difficult to write or deliver than “substantive” remarks. And for presidents or presidential aspirants, we’re talking about a special kind of joke. These eminent figures need to come across as “modest” and self-deprecatory, but only up to a humble-brag point. (That is, just enough so the audience and reviewers will say, “Oh, isn’t it charming that he’s willing to laugh at himself!”) Real comedy often includes a “what the hell!” willingness to say something that will genuinely shock or offend, which national politicians can’t afford to do. The White House Correspondents Dinner, the Gridiron, the Al Smith Dinner—any event like this is hard (as David Litt, a former member of the Obama speechwriting team, explains in a very nice item just now).
What began as a two-hour morning outage spanned well into the afternoon as Twitter, Reddit, Spotify, Github, and many other popular websites and services became effectively inaccessible for many American web users, especially those on the East Coast.
The websites were not targeted individually. Instead, an unknown attacker deployed a massive botnet to wage a distributed denial-of-service attack on Dyn (pronounced like dine), the domain name service (DNS) provider that they all share.
A distributed denial of service attack, or DDoS, is not an uncommon attack on the web, and web hosts have been fending them off for years. But according to reports, Friday’s attack was distinguished by its distinctive approach. The perpetrator used a botnet composed of so-called “internet-of-things” devices—namely, webcams and DVRs—to spam Dyn with more requests than it could handle.
The candidates are back on the campaign trail, following the third, and final, debate on Wednesday night.
It’s Friday, October 21—the election is now less than three weeks away. Donald Trump and Hillary Clinton are back on the campaign trail to deliver their final pitch to voters, ahead of Election Day. We’ll bring you the latest updates from the trail, as events unfold. Also see our continuing coverage:
The easiest way to take down the web is to attack people’s access to it.
For more than two hours on Friday morning, much of the web seemed to grind to a halt—or at least slow to dial-up speed—for many users in the United States.
More than a dozen major websites experienced outages and other technical problems, according to user reports and the web-tracking site downdetector.com. They included The New York Times, Twitter, Pinterest, Reddit, GitHub, Etsy, Tumblr, Spotify, PayPal, Verizon, Comcast, EA, the Playstation network, and others.
How was it possible to take down all those sites at once?
Someone attacked the architecture that held them together—the domain-name system, or DNS, the technical network that redirects users from easy-to-remember addresses like theatlantic.com to a company’s actual web servers. The assault took the form of a distributed denial-of-service attack (DDoS) on one of the major companies that provides other companies access to DNS. A DDoS attack is one in which an attacker floods sites “with so much junk traffic that it can no longer serve legitimate visitors,” as the security researcher Brian Krebs put it in a blog post Friday morning.
Science says lasting relationships come down to—you guessed it—kindness and generosity.
Every day in June, the most popular wedding month of the year, about 13,000 American couples will say “I do,” committing to a lifelong relationship that will be full of friendship, joy, and love that will carry them forward to their final days on this earth.
Except, of course, it doesn’t work out that way for most people. The majority of marriages fail, either ending in divorce and separation or devolving into bitterness and dysfunction. Of all the people who get married, only three in ten remain in healthy, happy marriages, as psychologist Ty Tashiro points out in his book The Science of Happily Ever After, which was published earlier this year.
Social scientists first started studying marriages by observing them in action in the 1970s in response to a crisis: Married couples were divorcing at unprecedented rates. Worried about the impact these divorces would have on the children of the broken marriages, psychologists decided to cast their scientific net on couples, bringing them into the lab to observe them and determine what the ingredients of a healthy, lasting relationship were. Was each unhappy family unhappy in its own way, as Tolstoy claimed, or did the miserable marriages all share something toxic in common?
Her “personal” comeback album uses retro references in songs that don’t quite communicate what makes her special.
“I want your everything as long as it’s free”—right there, in her biggest single, Lady Gaga nailed the eternal tease of pop music. In three easy minutes, you feel immortal, unbeatable, the ultimate person. You stand at the edge, the edge, the edge, but know you won’t tumble over. It was a proposition Gaga tested with ever-more gusto until the safety harness snapped for 2013’s Artpop, where each songs seemed to have six different choruses and 42 layers of synthesizer and zero filter on its lyrics about the insatiable need to feed off of human attention. Suddenly, the listener felt implicated; the rush became lurid; everything was no longer free.
Gaga then retreated into tribute performances and the grounding wisdom of Tony Bennett, resulting finally in her new album Joanne, a self-described return to pop “without makeup.” It used to be that although she was among one of the most famous performers in the world, most people wouldn’t have been able to identify her in plainclothes. Now she sits unadorned on her album cover, with the only controversial fashion choice for the related marketing campaign being a bit of underboob. Decent move, PR-wise, perhaps: Here I am, humbled by my Icarus fall. But musically, she has overcorrected and hired a team with more gimmicks than guts, resulting in a “personal” album that—while often enjoyable—seems like it’s trying to hide its personality.
The third episode of the new season is one of the most disturbing of the series.
Sophie Gilbert and David Sims will be discussing the new season of Netflix’s Black Mirror, considering alternate episodes. The reviews contain spoilers; don’t read further than you’ve watched. See all of their coverage here.
David, I agree with you that the ending of “Playtest” fell flat. After so many twists (bullies! spiders! spider bullies! Terminator hookups!), the end didn’t evoke pathos so much as a sense of absurdity. In terms of focusing on the evils of technology, though, it seems to me that Black Mirror has always seen technology as something with the potential to enable and encourage human evil, rather than something that’s inherently evil by itself. It takes our worst instincts as people, as societies, and magnifies them.
How the national mythos and U.S. labor laws influence geographic mobility.
Kevin Bacon moves from a big city to a small town in Middle America where dancing is outlawed. Ralph Macchio moves from New Jersey to California, where he learns the art of life and combat. Dianne Wiest moves with her two sons to a California town stocked with vampires.
The trope of American families settling in faraway places isn’t just a plotline for terrible 1980s movies, but a national phenomenon. Decades of data, including a more recent Gallup study, characterizes the United States as one of the most geographically mobile countries in the world. “About one in four U.S. adults (24 percent) reported moving within the country in the past five years,” the report noted. With the comparable exceptions of Finland (23 percent) and Norway (22 percent), Americans also move considerably more than their European peers.