This is all as it should be, right? As Redfield told the Washington Post's Marc Kaufman, "A very flawed paper was published and received an inordinate amount of publicity. ... Now refutations of the work by two independent research groups are appearing in the same high-profile journal, and the refutations are being well publicized. This is how science is supposed to work."
But there's something lacking in this. All is not well just because it has ended well. Perhaps that's true for the scientific core of the story, the narrow question of whether GFAJ-1 depends on phosphate. But the bigger story -- how the original, shoddy paper was hyped by NASA and Science beyond responsible levels; how the authors of that paper handled the criticism; right up until how Science kept the new papers and their authors under lock and key until last night, even while Redfield's paper was already available on arXiv.org; and, notably, how the open fora of science blogs and Twitter provided a platform for public analysis and scrutiny -- this story demonstrates the large problems with the process of how science is packaged and delivered, and how the tools of the web could be deployed to make that process better, smarter, and more efficient.
The problems showed their fanged teeth right from the get-go, on November 29, 2010, with the news arriving in the form of a NASA press release. Okay, okay I jest. No news really arrived in the press release. Rather, NASA announced that they *would be announcing later* "an astrobiology finding that will impact the search for evidence of extraterrestrial life."
This, predictably, had the entire Internet dying with anticipation. Could there be a more tantalizing press release? Jason Kottke asked, "Has NASA discovered extraterrestrial life?" Gawker followed suit: "Did NASA discover life on one of Saturn's moons?" Alexis Madrigal jumped in and ruined all the speculation-fun, tweeting, "I'm sad to quell some of the @kottke-induced excitement about possible extraterrestrial life. I've seen the Science paper. It's not that." But that wasn't anywhere near the end of it: Four days later -- once the paper was released, embargo lifted, science revealed -- the news of arsenic-based life (even arsenic-based life here on Earth) was still pretty dope. As Phil Plait of Bad Astronomy wrote, "First off, just to be straight and to dispel the rumors: this is not aliens on Titan, or Mars, or anywhere else. This bizarre life form was found right here on good ol' Earth. And don't be disappointed: this is still pretty cool news." Life, whatever that magical quality is, was more diverse, resilient, and possible than we had ever previously had reason to believe.
But pretty soon even the Earth-based claims began to fall apart, most prominently and thoroughly on Rosie Redfield's blog, RRResearch, where she wrote, NASA's shameful analysis of the alleged bacteria in the Mars meteorite made me very suspicious of their microbiology, an attitude that's only strengthened by my reading of this paper. Basically, it doesn't present ANY convincing evidence that arsenic has been incorporated into DNA (or any other biological molecule)." And then she proceeded to eviscerate the paper's claims. Six months later, she, along with seven others, published in Science their criticisms of the study, and the study's authors, led by Felisa Wolfe-Simon, responded at length. As Carl Zimmer wrote in Slate at the time:
For scientists who only get their information in print, this may be the first they've heard anything about a longstanding controversy that's come to be known over the past six months by its Twitter hashtag: #arseniclife.
For those of us who have been tracking #arseniclife since last Thanksgiving, however, today comes as an anticlimax. There's not much in the letters to Science that we haven't read before. In the past, scientists might have kept their thoughts to themselves, waiting for journals to decide when and how they could debate the merits of a study. But this time, they started talking right away, airing their criticisms on the Internet.
Now today, more than a year later, the fruits of some of those criticisms have been published on the Science website, pushed out from under their own embargo by Redfield's talk.