More on Burnham

More

Tim Lambert snarks:  "McArdle does not seem to have understood what Roberts was saying was in agreement: the excess deaths in the Lancet study (about 650,000) and in the IFHS study (about 400,000)."

Of course I didn't understand it, because it was arrant nonsense.  That's why the WHO team took care to say, in their paper:

The IFHS results for trends and distribution of deaths according to province are consistent with what has been reported from the scanning of press reports for civilian casualties through the Iraq Body Count project. The estimated number of deathsin the IFHS is about three times as high as that reported by the Iraq Body Count. Both sources indicate that the 2006 study by Burnham et al. considerably overestimated the number of violent deaths. For instance, to reach the 925 violent deaths per day reported by Burnham et al. for June 2005 through June 2006, as many as 87% of violent deaths would have been missed in the IFHS and more than 90% in the Iraq Body Count. This level of underreporting is highly improbable, given the internal and external consistency of the data and the much larger sample size and quality-control measures taken in the implementation of the IFHS.

Given that almost all the deaths in their study resulted from violence, this is the same as saying that they overcounted.

Moreover, if I made a mistake, apparently every conflict epidemiologist I talked to made the same mistake, because they had trouble believing that I was quoting Les Roberts correctly.  I worked with his statement in front of me, and asked whether there was any possibility that these studies agreed with each other on the overall level of deaths in Iraq.  That's one point were everyone I talked to was unanimous:  they didn't, and also, you couldn't compare the violent deaths figure to the overall deaths estimate that Kieran Healy tried to back out of the raw data.  The people I asked included Olivier Degomme, one of the very few researchers who had access to both data sets.

That does not prove that Burnham was wrong, only that the two studies do not, in any sense recognized by the other conflict epidemiologists I talked to, agree.  Iraq in 2006 was a terrible place to collect data, and even with a large data set it wouldn't be totally shocking if the WHO study were off.  And though I think that the WHO is the most likely to be accurate, given its much larger sample size and better supervised research teams, that certainly doesn't prove that Burnham et al. did anything wrong--only that there was something wrong with their methodology, or that they simply hit the jackpot and got two outlying results.  But the attempt to salvage the Burnham study by claiming it basically found the same thing as the WHO did is deeply silly.

Jump to comments

Megan McArdle is a former writer and editor at The Atlantic.

Get Today's Top Stories in Your Inbox (preview)


Elsewhere on the web

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

Miami: The Next Big Start-Up City?

How the city became a center for innovation

Video

Video

A Brief History of Romantic Comedies

From The Atlantic's Chris Orr

Video

Video

Life in 'the New Arctic'

A moving portrait of a fading landscape

Video

Video

The Rise of New York City

A fascinating look at Manhattan in the 1940s

Video

'I Thought It Was Really Funny, but No One Else Did'

A day with New Yorker cartoonist Joe Dator

Video

New Yorkers: The Winemaker

Make your own wine ... in New York City

Video

What Is Methane Hydrate?

"Flaming ice" is a vast natural energy source

Video

NASA's Time-Lapse of the Sun

Now with epic dubstep music

Video

A Video Letter From the Editor

Highlights from the May 2013 issue

Video

Shaken Not Tuned: Cocktail Experiments

Can a tuning fork improve a cocktail?

Video

Video

The Rise of Environmentalism

Tracking 50 years, from the Love Canal disaster to Greenpeace

Video

Is He Cheating? A 1950s Guide

'That little blonde secretary from the office?’

Video

New Yorkers: Vintage Vacuum-Tube Amps

Risking electric shock to restore old amplifiers

Video

The DIY Piano-Bicycle

Everybody needs a hobby

Writers

Up
Down

More in Business

In Focus

2013 National Geographic Traveler Photo Contest

Just In