Twitter: We'll Stop Breaking Soon, We Swear

Fail Whale -- coletivomambembe-flickr -- photo.png
coletivomambembe/flickr

Twitter wants you to forget the fail whale. The service has struggled to deal with its rapid growth and the problems that arise as a result, but the company hopes that a new data center and some innovative back-end solutions will help hasten updates and reduce downtime.

In a post yesterday, Twitter engineer Jean-Paul Cozzatti explained that a database request locked up the service on Monday, leaving many users unable to sign in or sign up for Twitter. The problem was the latest issue for the rapidly growing service, the maintenance of which is like "building a rocket in mid-flight," Cozzatti wrote.

Building that rocket should become a little easier soon, though. In a separate post yesterday, the company announced that it would be moving into its first custom data center in Utah and plans to open more over the next two years. "
Having our own data center will give us the flexibility to more quickly make adjustments as our infrastructure needs change," Cozzatti wrote.

And, last week, engineer Larry Gadea explained that a new project called Murder -- which is also the collective noun for a group of crows -- was able to reduce the time it took to update Twitter's servers from 40 minutes to 12 seconds. Murder uses the BitTorrent protocol to decentralize updates: rather than relying on one system to distribute an update, each server downloads the update and then starts sharing it with the other servers. Gadea explained the process in-depth in a talk he gave in Montreal (below).

Twitter - Murder Bittorrent Deploy System from Larry Gadea on Vimeo.


Presented by

Niraj Chokshi is a former staff editor at TheAtlantic.com, where he wrote about technology. He is currently freelancing and can be reached through his personal website, NirajC.com. More

Niraj previously reported on the business of the nation's largest law firms for The Recorder, a San Francisco legal newspaper. He has also been published in The Hartford Courant, The Seattle Times and The Age, in Melbourne, Australia. He's also a longtime programmer and sometimes website designer.

Google Street View, Transformed Into a Tiny Planet

A 360-degree tour of our world, made entirely from Google's panoramas

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register.

blog comments powered by Disqus

Video

Google Street View, Transformed Into a Tiny Planet

A 360-degree tour of our world, made entirely from Google's panoramas

Video

The 86-Year-Old Farmer Who Won't Quit

A filmmaker returns to his hometown to profile the patriarch of a family farm

Video

Riding Unicycles in a Cave

"If you fall down and break your leg, there's no way out."

Video

Carrot: A Pitch-Perfect Satire of Tech

"It's not just a vegetable. It's what a vegetable should be."

Video

The Benefits of Living Alone on a Mountain

"You really have to love solitary time by yourself."

More in Technology

Just In