So long, farewell, auf wiedersehn goodbye . . .

The gold standard of health insurance studies is the 1982 RAND study, which was a randomized controlled study of health care usage. One of the surprising findings was that when you pushed the cost down, usage went up, but health didn't.

However, Alex Tabarrok points to a major flaw in the study:

Of the 1,294 adult participants who were randomly assigned to the free plan, 5 participants (0.4 percent) left the experiment voluntarily during the observation period, while of the 2,664 who were assigned to any of the cost-sharing plans, 179 participants (6.7 percent) voluntarily left the experiment. This represented a greater than sixteenfold increase in the percentage of dropouts, a difference that was highly significant and a magnitude of response that was nowhere else duplicated in the experiment.

What explains this? The explanation that makes the most sense is that the dropouts were participants who had just been diagnosed with an illness that would require a costly hospital procedure. … If they dropped out, their coverage would automatically revert to their original insurance policies, which were likely to cover major medical expenses (such as hospitalizations) with no copayments.

Who drops out of your study is an important factor that is far too often overlooked, especially by journalists. Weight loss studies are particularly bad for this--the people who aren't losing weight are, naturally, the ones who tend to drop out, which vastly overstates the success figures. But all sorts of medical studies are prone, including, it seems, this one.

Presented by

Megan McArdle is a columnist at Bloomberg View and a former senior editor at The Atlantic. Her new book is The Up Side of Down.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register with Disqus.

Please note that The Atlantic's account system is separate from our commenting system. To log in or register with The Atlantic, use the Sign In button at the top of every page.

blog comments powered by Disqus

Video

A Stop-Motion Tour of New York City

A filmmaker animated hundreds of still photographs to create this Big Apple flip book

Video

The Absurd Psychology of Restaurant Menus

Would people eat healthier if celery was called "cool celery?"

Video

This Japanese Inn Has Been Open For 1,300 Years

It's one of the oldest family businesses in the world.

Video

What Happens Inside a Dying Mind?

Science cannot fully explain near-death experiences.

More in Business

Just In