I know that Paul Krugman was not really serious when he linked this study naming him the most accurate prognosticator in America. Nonetheless, it's getting some play around the internet, and a warm reception from people who don't seem to know any better, so it's worth pointing out why this sort of thing is so dreadful. I mean, I'm sure it was a very fine senior project for the Hamilton College students who produced it, but the results tell us nothing at all about the state of prognostication in this country.
Krugman quotes this segment from the Hamilton College press release:
Now, a class at Hamilton College led by public policy professor P. Gary Wyckoff has analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.
The students found that only nine of the prognosticators they studied could predict more accurately than a coin flip. Two were significantly less accurate, and the remaining 14 were not statistically any better or worse than a coin flip.
The top prognosticators - led by New York Times columnist Paul Krugman - scored above five points and were labeled "Good," while those scoring between zero and five were "Bad." Anyone scoring less than zero (which was possible because prognosticators lost points for inaccurate predictions) were put into "The Ugly" category. Syndicated columnist Cal Thomas came up short and scored the lowest of the 26.
I myself read Paul Krugman more often than Cal Thomas, so perhaps I should take this as evidence of my perspicacity . . . but no. This is nonsense. The study runs for a little over a year, between September 2007 and 2008. They didn't even look at all of the statements made by the prognosticators, but at a "representative sample", presumably because they couldn't handle the volume that would be required to analyze all of it. Some of the prognosticators made too few testable predictions to generate good results, and the riskiness of the prediction varied--someone who predicted that Obama was going to win the election in October 2008 seems to have gotten the same "score" for that flip as someone who predicted that Obama would do so in September 2007. The number of predictions varied between commentators, making comparison even more difficult.
Against this background, it makes no sense to say--as the students and the press release do--that this study shows that "a number of individuals in our sample, including Paul Krugman, Maureen Dowd, Ed Rendell, Chuck Schumer, Nancy Pelosi, and Kathleen Parker were better than a coin flip (sometimes, substantially so.)" One of the commonest fallacies you see among beginning students of probability is the belief that if a coin has a 50% chance of turning up heads, then anyone who flips a coin multiple times should end up getting half heads, and half tails.
This is not true--especially when you have a small number of "flips", as most of the prognosticators did. (It's not surprising that George Will, who made the greatest number of predictions, was statistically very close to zero.) Rather, if you get a bunch of people to flip coins a bunch of times, you'll get a distribution. Most of the results will cluster close to 50/50 (as was true in this case), but you'll get outliers.
This is often pointed out in the case of mutual fund managers, as John Bogle does using this graph:
And indeed, my finance profs taught me that the top mutual funds in a given year are not any more likely to show up as next year's top funds. Indeed, they may be less likely to do well the next year. Why? Because funds have strategies, which do better or worse depending on market conditions. The funds that do well in a given year are probably the funds that were especially well positioned to show outsized fluctuations in response to whatever changed that year--but that also means that they're especially likely to do lose money when those conditions change. Because the fluctuations are a random walk, they do not vindicate the fund manager's strategy or perspicacity--but they may seem to, temporarily.
Which may cast some light on why liberal pundits did especially well in this test. If you were the sort of person who is systematically biased towards predicting a bad end for Republicans, and a rosy future for Democrats, then election year 2008 was going to make you look like a genius. If you were the sort of person who takes a generally dim view of anything Democrats get up to, then your pessimism was probably going to hit more often than it missed.
It would be interesting to go back and look at the same group in the year running up to 2010. But even then, it would tell us very little. To do any sort of a true test, we'd have to get a bunch of these prognosticators to all make predictions about the same binary events, over a lengthy period of time, and then see how they fared over a multi-year period. I suspect that they'd end up looking a lot like mutual fund managers: little variation that could be distinguished from random variance.
Once you take into account their fees, mutual fund managers, as a group, underperform the market. And I suspect you'd see the same thing with pundits: as a group, they'd slightly underperform a random coin flip. People like Lindsay Graham cannot go on Meet the Press and say "Yup, we're going to lose on November 2nd" even when it is completely obvious that this is what will happen; they need to present an optimistic bias for their base. Over time, that optimistic bias about no-hope causes will cause a slight negative drag on the predictive power of their statements.
Does that undermine the credibility of pundits? I don't think that predictions are the fundamental purpose of punditry (though I do encourage people to make them as a way of raising the stakes on the truth claims they make, and in order to give us a benchmark against which to analyze our reasoning). Pundits offer predictions, yes, but more importantly, they offer you facts, context, and analysis. Their really important work is to help you make your own wrong predictions about the world.
Biology textbooks tell us that lichens are alliances between two organisms—a fungus and an alga. They are wrong.
In 1995, if you had told Toby Spribille that he’d eventually overthrow a scientific idea that’s been the stuff of textbooks for 150 years, he would have laughed at you. Back then, his life seemed constrained to a very different path. He was raised in a Montana trailer park, and home-schooled by what he now describes as a “fundamentalist cult.” At a young age, he fell in love with science, but had no way of feeding that love. He longed to break away from his roots and get a proper education.
At 19, he got a job at a local forestry service. Within a few years, he had earned enough to leave home. His meager savings and non-existent grades meant that no American university would take him, so Spribille looked to Europe.
The Democratic National Committee chair has resigned amid an email controversy.
NEWS BRIEF Debbie Wasserman Schultz has resigned as the chair of the Democratic National Committee (DNC)following a leak of thousands of emails that appeared to show committee staffers favoring Hillary Clinton over Bernie Sanders for the party’s presidential primary contest.
The Florida congresswoman said in a statement Sunday she will step down from the job at the end of the Democratic National Convention, which begins Monday in Philadelphia.
“I know that electing Hillary Clinton as our next president is critical for America’s future. I look forward to serving as a surrogate for her campaign in Florida and across the country to ensure her victory,” she said. “Going forward, the best way for me to accomplish those goals is to step down as party chair at the end of this convention.”
It’s known as a modern-day hub of progressivism, but its past is one of exclusion.
PORTLAND, Ore.— Victor Pierce has worked on the assembly line of a Daimler Trucks North America plant here since 1994. But he says that in recent years he’s experienced things that seem straight out of another time. White co-workers have challenged him to fights, mounted “hangman’s nooses” around the factory, referred to him as “boy” on a daily basis, sabotaged his work station by hiding his tools, carved swastikas in the bathroom, and written the word “nigger” on walls in the factory, according to allegations filed in a complaint to the Multnomah County Circuit Court in February of 2015.
Pierce is one of six African Americans working in the Portland plant whom the lawyer Mark Morrell is representing in a series of lawsuits against Daimler Trucks North America. The cases have been combined and a trial is scheduled for January of 2017.
Yet nearly half of all married couples are likely to divorce, and many couples report feeling unhappy in their relationships. Instructors of Northwestern University’s Marriage 101 class want to change that. The goal of their course is to help students have more fulfilling love relationships during their lives. In Marriage 101 popular books such as Mating in Captivity and For Better: The Science of a Good Marriage are interspersed with meaty academic studies. Students attend one lecture a week and then meet in smaller breakout groups to discuss the weekly topics, which range from infidelity to addiction, childrearing to sexuality in long-term relationships.
Why Millennials aren’t buying cars or houses, and what that means for the economy
In 2009, Ford brought its new supermini, the Fiesta, over from Europe in a brave attempt to attract the attention of young Americans. It passed out 100 of the cars to influential bloggers for a free six-month test-drive, with just one condition: document your experience online, whether you love the Fiesta or hate it.
Young bloggers loved the car. Young drivers? Not so much. After a brief burst of excitement, in which Ford sold more than 90,000 units over 18 months, Fiesta sales plummeted. As of April 2012, they were down 30 percent from 2011.
Don’t blame Ford. The company is trying to solve a puzzle that’s bewildering every automaker in America: How do you sell cars to Millennials (a k a Generation Y)? The fact is, today’s young people simply don’t drive like their predecessors did. In 2010, adults between the ages of 21 and 34 bought just 27 percent of all new vehicles sold in America, down from the peak of 38 percent in 1985. Miles driven are down, too. Even the proportion of teenagers with a license fell, by 28 percent, between 1998 and 2008.
The virtues that Hillary Clinton identified in Tim Kaine are also the ones that have led her astray in the past.
In 2008, Barack Obama famously wanted a “team of rivals” in his administration. He began with his running mate, who was utterly unlike him. Obama was a political newcomer; Joe Biden was a Beltway veteran. Obama appealed to African Americans and upscale liberals; Biden appealed to blue collar whites. Obama was disciplined; Biden was unruly. Obama was cool; Biden was warm.
Hillary Clinton, by contrast, has chosen a male version of herself. Like Clinton, Tim Kaine is a culturally conservative liberal. He’s a devout Catholic who personally opposes abortion despite believing it should be legal. For her part, Clinton is a devout Methodist—she’s taught Sunday school, lectured on Methodist theology and participated in various prayer groups—who is personally skeptical of abortion, too. In 2005, she called it “a sad, even tragic choice to many, many women” and looked forward to the day when “the choice guaranteed under our Constitution either does not ever have to be exercised or only in very rare circumstances.”
As the Democratic National Convention prepares to kick off, a massive leak of hacked emails renews old questions about how the Clintons and their associates operate.
PHILADELPHIA—What’s with Hillary Clinton and email? The Democratic presidential nominee who shattered her credibility over a rogue email system while serving as secretary of state now must deal with an electronic snafu at the Democratic National Committee.
Among 20,000 DNC emails posted by WikiLeaks on the eve of Clinton’s nominating convention, there are scores in which party employees criticized and mocked Bernie Sanders during his primary campaign against Clinton. (Caveat: We don’t formally know the emails are authentic).
The email dump jeopardizes Clinton’s ability to unify the party in Philadelphia and avoid the public fratricide that spoiled Donald Trump’s convention in Cleveland. While some of the DNC emails criticized Clinton, the overwhelming number of anti-Sanders correspondences create an indelible impression that the DNC violated its oath of neutrality.
Narcissism, disagreeableness, grandiosity—a psychologist investigates how Trump’s extraordinary personality might shape his possible presidency.
In 2006, Donald Trump made plans to purchase the Menie Estate, near Aberdeen, Scotland, aiming to convert the dunes and grassland into a luxury golf resort. He and the estate’s owner, Tom Griffin, sat down to discuss the transaction at the Cock & Bull restaurant. Griffin recalls that Trump was a hard-nosed negotiator, reluctant to give in on even the tiniest details. But, as Michael D’Antonio writes in his recent biography of Trump, Never Enough, Griffin’s most vivid recollection of the evening pertains to the theatrics. It was as if the golden-haired guest sitting across the table were an actor playing a part on the London stage.
“It was Donald Trump playing Donald Trump,” Griffin observed. There was something unreal about it.
Fulfilling what might be the Russian autocrat’s dearest wish, Trump has openly questioned whether the U.S. should keep its commitments to NATO.
The Republican nominee for president, Donald J. Trump, has chosen this week to unmask himself as a de facto agent of Russian President Vladimir Putin, a KGB-trained dictator who seeks to rebuild the Soviet empire by undermining the free nations of Europe, marginalizing NATO, and ending America’s reign as the world’s sole superpower.
I am not suggesting that Donald Trump is employed by Putin—though his campaign manager, Paul Manafort, was for many years on the payroll of the Putin-backed former president of Ukraine, Viktor Yanukovych. I am arguing that Trump’s understanding of America’s role in the world aligns with Russia’s geostrategic interests; that his critique of American democracy is in accord with the Kremlin’s critique of American democracy; and that he shares numerous ideological and dispositional proclivities with Putin—for one thing, an obsession with the sort of “strength” often associated with dictators. Trump is making it clear that, as president, he would allow Russia to advance its hegemonic interests across Europe and the Middle East. His election would immediately trigger a wave of global instability—much worse than anything we are seeing today—because America’s allies understand that Trump would likely dismantle the post-World War II U.S.-created international order. Many of these countries, feeling abandoned, would likely pursue nuclear weapons programs on their own, leading to a nightmare of proliferation.
A crop of books by disillusioned physicians reveals a corrosive doctor-patient relationship at the heart of our health-care crisis.
For someone in her 30s, I’ve spent a lot of time in doctors’ offices and hospitals, shivering on exam tables in my open-to-the-front gown, recording my medical history on multiple forms, having enough blood drawn in little glass tubes to satisfy a thirsty vampire. In my early 20s, I contracted a disease that doctors were unable to identify for years—in fact, for about a decade they thought nothing was wrong with me—but that nonetheless led to multiple complications, requiring a succession of surgeries, emergency-room visits, and ultimately (when tests finally showed something was wrong) trips to specialists for MRIs and lots more testing. During the time I was ill and undiagnosed, I was also in and out of the hospital with my mother, who was being treated for metastatic cancer and was admitted twice in her final weeks.