That Glorious Fireworks Fail Last Week? Imagine That's Your Data


In the age of apps, it's easy to forget how many of our systems depend on complex code -- creating hidden, and potentially dangerous, risks.


The Los Angeles Times reports on one of the most spectacular failures in recent pyrotechnic history: the simultaneous ignition of all 7,000 fireworks on July 4th:

The explanation from Garden State Fireworks, the company responsible for the mishap, is so convoluted no one seems to be sure exactly what happened. It had something to do with an overzealous backup computer file that overlapped with the primary file to accidentally set off all the fireworks at once.

"Contrary to numerous opinions and theories, the simultaneous ignition was not due to any sabotage or massive computer hardware failure," Garden State Fireworks wrote in a lengthy statement that may require a PhD in firework-ology to fully understand." The display sequence started exactly when it was expected to and the systems executed the file the way it appeared. Sadly, the file executed was the double file created in the back-up plan download process."

I have read and re-read the statement and am as perplexed as the Times reporter. But that's part of the point. In the age of apps, it's easy to forget how many of our systems depend on complex code that may be difficult to understand even for information technology professionals with other specialties. This software is sometimes custom-developed and sometimes sold in small quantities. And these systems increasingly interact with each other to create the "seamless" Web.

Our security attention has been focused on viruses, worms, and sabotage. But there's also a complexity risk in as the scope of cloud computing increases -- including risks to backups in the cloud. The Technology Review blog recently presented the concerns of Professor Bryan Ford at Yale University:

"Non-transparent layering structures...may create unexpected and potentially catastrophic failure correlations, reminiscent of financial industry crashes," he says.

But the lack of transparency is only part of the story. A more general risk arises when systems are complex because seemingly unrelated parts can become coupled in unexpected ways.

A growing number of complexity theorists are beginning to recognise this problem. The growing consensus is that bizarre and unpredictable  behaviour often emerges in systems made up of "networks of networks".

An obvious example is the flash crashes that now plague many financial markets in which prices plummet dramatically for no apparent reason.

The very difficulty of explaining the failure of one of the many specialized programs like fireworks sequencing shows how hard it is to even estimate how large our network risks are -- Rumsfeldian "unknown unknowns."

Will Professor Ford's warnings be taken seriously? Sadly, there is probably too much money to be made by disregarding them, as there was in ignoring danger signs of the bubble. But the San Diego Fourth of July fiasco, though it did not directly involve the cloud, may someday be seen as a harbinger.

Jump to comments
Presented by

Edward Tenner is a historian of technology and culture. He was a founding advisor of Smithsonian's Lemelson Center and holds a Ph.D in European history. More

Edward Tenner is an independent writer and speaker on the history of technology and the unintended consequences of innovation. He holds a Ph.D. in European history from the University of Chicago and was executive editor for physical science and history at Princeton University Press. A former member of the Harvard Society of Fellows and John Simon Guggenheim fellow, he has been a visiting lecturer at Princeton and has held visiting research positions at the Institute for Advanced Study, Woodrow Wilson International Center for Scholars, and the Princeton Center for Information Technology Policy. He is now an affiliate of the Center for Arts and Cultural Policy of Princeton's Woodrow Wilson School. He was a founding advisor of Smithsonian's Lemelson Center, where he remains a senior research associate.

Get Today's Top Stories in Your Inbox (preview)

Saving Central: One High School's Struggle After Resegregation

Meet the students and staff at Tuscaloosa’s all-black Central High School in a short documentary film by Maisie Crow. 

Elsewhere on the web

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus


Where Time Comes From

The clocks that coordinate your cellphone, GPS, and more


Computer Vision Syndrome and You

Save your eyes. Take breaks.


What Happens in 60 Seconds

Quantifying human activity around the world



More in Technology

From This Author

Just In