Ideas 2011 July/August 2011

The World’s Schoolmaster

How a German scientist is using test data to revolutionize global learning

Ultimately, in the spring of 2000, nearly all 30 OECD members signed on, plus several other countries: 15-year-olds from 32 countries took the Programme for International Student Assessment (PISA). The exam tested more same-aged students in more developed countries than any other. And it measured not students’ retention of facts, but their readiness for “knowledge worker” jobs—their ability to think critically and solve real-world problems.

The results were so stunning that international newspapers leaked the rankings. The United States rang in somewhere above Greece and below Canada, a middling performance we’ve repeated every round since. To the astonishment of the Germans, who had believed their system among the best in the world, Germany ranked even lower.

U.S. officials defended their schools—blaming poor performance on the relative prevalence of immigrant families in the United States. But Schleicher and his colleagues noted that native-born Americans performed just as unimpressively. In fact, worldwide, the share of children from immigrant backgrounds explains only 3 percent of the variance between countries. A country’s wealth does not predict success, either. Gross domestic product per capita predicts only 6 percent of the difference in scores. Schleicher also noticed, however, that in the U.S. in particular, poverty was destiny. Low-income American students did (and still do) much worse than high-income ones on PISA. But poor kids in Finland and Canada do far better relative to their more privileged peers, despite their disadvantages.

In Germany, the test became a household name and inspired a prime-time TV quiz show, The PISA Show. Even Schleicher’s father began taking his work more seriously. Meanwhile, Schleicher visited dozens of schools and pored over the data. He concluded that the best school systems became great after undergoing a series of crucial changes. They made their teacher-training schools much more rigorous and selective; they put developing high-quality principals and teachers above efforts like reducing class size or equipping sports teams; and once they had these well-trained professionals in place, they found ways to hold the teachers accountable for results while allowing creativity in their methods. Notably, in every case, these school systems devoted equal or more resources to the schools with the poorest kids.

These days, Schleicher travels the world with a PowerPoint presentation detailing his findings. It seems to have more data points embedded in its scatter plots than our galaxy has stars. When his audiences get distracted by the tribal disputes that plague education, he returns to the facts with a polite smile, like C-3PO with a slight German accent. He likes to end his presentation with a slide that reads, in a continuously scrolling ticker, “Without data, you are just another person with an opinion … Without data, you are just another person with an opinion …”

Still, on almost every continent, Schleicher and PISA provoke a chorus of critics. In the U.S., Mark Schneider, a vice president at the American Institutes for Research and a former member of PISA’s governing board, calls Schleicher “a remarkably good salesman,” but says the test’s U.S. sample of 5,233 students in 165 schools is too small—and that the OECD should just collect data, not overreach by making policy recommendations too.

But Schleicher’s willingness to convert data into pragmatic advice is precisely what has made him so influential. “Andreas’s knowledge is more comprehensive, more relevant, more actionable than the kind of data you’ll hear from many researchers,” says Jon Schnur, who co-founded the U.S. reform group New Leaders for New Schools, and who has worked closely with the Obama administration. Oregon, Japan, and Germany now include PISA questions on their own standardized tests. Steven Paine, who until this year was West Virginia’s superintendent of schools, redesigned his state’s curriculum to make it more demanding—based in part on PISA findings. “We had set the bar too low,” Paine says.

Today, 70 countries collectively give PISA to representative samples of more than 500,000 15-year-olds every three years. A longitudinal study of 30,000 Canadian students recently found PISA scores to be more accurate than report-card grades in predicting which kids will go to college. The latest results came out in 2010, and for the first time the test included Shanghai—which trounced every single country. Schleicher credits Shanghai’s success in part to a policy of rotating the best teachers into the region’s worst-performing schools (the opposite of what tends to happen in the U.S.). The Shanghai delegation came to the New York summit to share its secrets, much to Schleicher’s satisfaction. “You could see, when the minister from Shanghai was speaking, everybody started to write notes,” he told me afterward. “It was incredible! Ten years ago, you know, everybody would’ve said, ‘We are unique. We have a specific culture.’ And now we understand that culture is created by what we do.”

That may be wishful thinking. Most Americans still believe that the interplay of schools and culture is a complex and hard-to-untangle knot. But Schleicher hopes to change their minds, partly by creating a test that individual schools can use to compare themselves with students worldwide; a pilot project is planned to launch next school year in 50 to 100 U.S. schools.

Ironically, Schleicher’s own three children currently attend public school in France, a country that houses the OECD’s headquarters but, according to PISA, has solidly mediocre schools. “It was a difficult decision. I don’t think the French school system is great,” Schleicher says, his voice trailing off. “You never really know whether that was the right decision,” he says, sounding suddenly like many American parents—worried about his children’s school but hoping for the best.

Presented by

Amanda Ripley is a Bernard L. Schwartz Fellow at the New America Foundation, and the author of the forthcoming book The Smart Kids Club: How Other Countries Saved Their Schools (And Taught Their Kids to Think).

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register with Disqus.

Please note that The Atlantic's account system is separate from our commenting system. To log in or register with The Atlantic, use the Sign In button at the top of every page.

blog comments powered by Disqus