Twitter: We'll Stop Breaking Soon, We Swear

Fail Whale -- coletivomambembe-flickr -- photo.png
coletivomambembe/flickr

Twitter wants you to forget the fail whale. The service has struggled to deal with its rapid growth and the problems that arise as a result, but the company hopes that a new data center and some innovative back-end solutions will help hasten updates and reduce downtime.

In a post yesterday, Twitter engineer Jean-Paul Cozzatti explained that a database request locked up the service on Monday, leaving many users unable to sign in or sign up for Twitter. The problem was the latest issue for the rapidly growing service, the maintenance of which is like "building a rocket in mid-flight," Cozzatti wrote.

Building that rocket should become a little easier soon, though. In a separate post yesterday, the company announced that it would be moving into its first custom data center in Utah and plans to open more over the next two years. "
Having our own data center will give us the flexibility to more quickly make adjustments as our infrastructure needs change," Cozzatti wrote.

And, last week, engineer Larry Gadea explained that a new project called Murder -- which is also the collective noun for a group of crows -- was able to reduce the time it took to update Twitter's servers from 40 minutes to 12 seconds. Murder uses the BitTorrent protocol to decentralize updates: rather than relying on one system to distribute an update, each server downloads the update and then starts sharing it with the other servers. Gadea explained the process in-depth in a talk he gave in Montreal (below).

Twitter - Murder Bittorrent Deploy System from Larry Gadea on Vimeo.


Presented by

Niraj Chokshi is a former staff editor at TheAtlantic.com, where he wrote about technology. He is currently freelancing and can be reached through his personal website, NirajC.com. More

Niraj previously reported on the business of the nation's largest law firms for The Recorder, a San Francisco legal newspaper. He has also been published in The Hartford Courant, The Seattle Times and The Age, in Melbourne, Australia. He's also a longtime programmer and sometimes website designer.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register with Disqus.

Please note that The Atlantic's account system is separate from our commenting system. To log in or register with The Atlantic, use the Sign In button at the top of every page.

blog comments powered by Disqus

Video

Cryotherapy's Dubious Appeal

James Hamblin tries a questionable medical treatment.

Video

Confessions of Moms Around the World

In Europe, mothers get maternity leave, discounted daycare, and flexible working hours.

Video

How Do Trees Know When It's Spring?

The science behind beautiful seasonal blooming

More in Technology

Just In