Department of Awful Statistics: Small Schools Edition

More

It seems even Bill Gates can be taken in by poor understanding of statistics.  Specifically, this one:

The chart at left, for example, shows by size the percentSchools1age of schools in North Carolina which were ever ranked in the top 25 of schools for performance.  Notice that nearly 30% of the smallest decile (10%) of schools were in the top 25 at some point during 1997-2000 but only 1.2% of the schools in the largest decile ever made the top 25.

Seeing this data many people concluded that small schools were better and so they began to push to build smaller schools and break up larger schools. Can you see the problem?

The problem is that because small school don't have a lot of students, scores are much more variable.  If for random reasons a few geniuses happen to enroll one year in a small school scores jump up and if a few extra dullards enroll the next year scores fall.   

Thus, for purely random reasons we would expect small schools to be among the best performing schools in any givenyear.  Of course we would also expect small schools to be among the worst performing schools in any given year!  And in fact, once we look at all the data this is exactly what we see.  The figure below shows changes in fourth grade math scores against school size.  Note that small schools have more variable scores but there is no evidence at all that scores on average increase with school size. 

The Gates foundation, which pushed for smaller schools on the basis of this finding, has apparently now acknowledged the mistake.  Victory: math!


Jump to comments
Presented by

Megan McArdle is a columnist at Bloomberg View and a former senior editor at The Atlantic. Her new book is The Up Side of Down.

Get Today's Top Stories in Your Inbox (preview)

What's the Number One Thing We Could Do to Improve City Life?

A group of journalists, professors, and non-profit leaders predict the future of livable, walkable cities


Elsewhere on the web

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

Adventures in Legal Weed

Colorado is now well into its first year as the first state to legalize recreational marijuana. How's it going? James Hamblin visits Aspen.

Video

What Makes a Story Great?

The storytellers behind House of CardsandThis American Life reflect on the creative process.

Video

Tracing Sriracha's Origin to Thailand

Ever wonder how the wildly popular hot sauce got its name? It all started in Si Racha.

Video

Where Confiscated Wildlife Ends Up

A government facility outside of Denver houses more than a million products of the illegal wildlife trade, from tigers and bears to bald eagles.

Video

Is Wine Healthy?

James Hamblin prepares to impress his date with knowledge about the health benefits of wine.

Video

The World's Largest Balloon Festival

Nine days, more than 700 balloons, and a whole lot of hot air

Writers

Up
Down

More in Business

Just In