On December 20, 2002, a Senate Intelligence Committee that included Sen. Ron Wyden, D-Ore., today one of the most vociferous critics of the so-called "surveillance state," came to the following conclusion in its official report on the mistakes that led to 9/11: The National Security Agency had harmed U.S. counterterrorism efforts that might have prevented that terrible day because of the agency's "failure to address modern communications technology aggressively."
The report, a joint effort of the Senate committee and the House Permanent Select Committee on Intelligence, blamed "NSA's cautious approach to any collection of intelligence relating to activities in the United States, and insufficient collaboration between NSA and the FBI regarding the potential for terrorist attacks within the United States."
The Senate-House report said the NSA simply could not keep up with the explosion of information technology. "Only a tiny fraction" of the NSA's 650 million daily intercepts worldwide "are actually ever reviewed by humans, and much of what is collected gets lost in the deluge of data," the report said. In interviews at the time, then-NSA Director Michael Hayden explained why: The NSA, originally authorized to conduct monitoring only overseas, was effectively a Cold War dinosaur that was going "deaf" since its main mission of tracking "signals intelligence," known as Sigint, from the Soviet Union had ended.
"We have gone from chasing the telecommunications structure of a slow-moving, technologically inferior, resource-poor nation-state--and we could do that pretty well - to chasing a communications structure in which an al-Qaida member can go into a storefront in Istanbul and buy for $100 a communications device that is absolutely cutting edge, and for which he has had to make no investment in its development. That's what we've got to deal with," Hayden told me in an interview in mid-2002.
In congressional testimony leading up to that critical Senate-House report, Hayden explained the NSA had gone from tracking a relatively small number of Soviet communications pipelines -- microwave transmissions, for example, from Moscow to various ICBM bases -- to trying to keep up with billions of conversations on phones and emails in a world in which technological borders had been erased, and much of this traffic was now being routed through the United States. This huge new challenge was coming at a time when the super-secret agency had "downsized about a third of its manpower and about the same proportion of its budget in the '90s," the era of the so-called post-Cold War peace dividend, Hayden said in his testimony. "That's the same decade when mobile cell phones increased from 16 million to 741 million--an increase of 50 times. That's the same decade when Internet users went from about four to 361 million."
These perceived deficiencies, and the NSA's aggressive efforts to redress them since then, make up the real backdrop to the latest scandal that has engulfed Washington, this time over what appears to be a massive infringement of American civil liberties. And despite the outrage voiced by senators such as Wyden and other critics, the truth about what the NSA and intelligence and investigative community is doing is far more complex than the rhetoric might lead you to believe.
Most important of all, almost the entire U.S. government has been on board in promoting it.
After many struggles and failures in the last decade, the NSA did finally come up with new approaches to keeping up with the traffic. One such approach was the NSA's "PRISM" program, disclosed Thursday by The Washington Post and the Guardian newspaper. The newspapers revealed that the NSA and FBI have set up a program to tap directly into the central servers of nine leading U.S. Internet companies, "extracting audio and video chats, photographs, e-mails, documents, and connection logs that enable analysts to track one target or trace a whole network of associates," as the Post wrote. The program was reportedly set up in cooperation with the major companies, including Microsoft, Yahoo, Google, Facebook, PalTalk, AOL, Skype, YouTube and Apple. Congress, following up on its original report, had given the government authority to do this under the Protect America Act in 2007 and the FISA, or Foreign Intelligence Surveillance Act, Amendments Act of 2008, which immunized private companies that cooperated voluntarily with U.S. intelligence collection.
The NSA has also conducted a regular program to monitor phone conversations. The agency and the FBI, now cooperating much as the original Senate-House report urged them to do, won a secret order from the Foreign Intelligence Surveillance Court on April 25, giving the government unlimited authority for three months to amass the telephone records of millions of U.S. customers of Verizon, according a report in The Guardian. Sen. Dianne Feinstein, D-Calif., the chairwoman of the Senate Intelligence Committee, said the order appeared to be merely a "three-month renewal of what has been in place for the past seven years." Feinstein and many other senators defended the program that they themselves set in motion in the last decade. Rep. Mike Rogers, R-Mich., chair of the House intelligence committee, said that "within the last few years, this program was used to stop a terrorist attack in the United States."
Nonetheless, the NSA/FBI programs have raised very real concerns over whether this domestic surveillance has violated constitutional protections of privacy for Americans, despite efforts to restrict the data collection to foreign sources. Intelligence professionals counter that the perception of a Big-Brother-like surveillance state must be balanced against the equally real concerns about tracking terrorists that date back to 9/11, issues that have still not been fully resolved today.