Twitter: We'll Stop Breaking Soon, We Swear

More

Fail Whale -- coletivomambembe-flickr -- photo.png
coletivomambembe/flickr

Twitter wants you to forget the fail whale. The service has struggled to deal with its rapid growth and the problems that arise as a result, but the company hopes that a new data center and some innovative back-end solutions will help hasten updates and reduce downtime.

In a post yesterday, Twitter engineer Jean-Paul Cozzatti explained that a database request locked up the service on Monday, leaving many users unable to sign in or sign up for Twitter. The problem was the latest issue for the rapidly growing service, the maintenance of which is like "building a rocket in mid-flight," Cozzatti wrote.

Building that rocket should become a little easier soon, though. In a separate post yesterday, the company announced that it would be moving into its first custom data center in Utah and plans to open more over the next two years. "
Having our own data center will give us the flexibility to more quickly make adjustments as our infrastructure needs change," Cozzatti wrote.

And, last week, engineer Larry Gadea explained that a new project called Murder -- which is also the collective noun for a group of crows -- was able to reduce the time it took to update Twitter's servers from 40 minutes to 12 seconds. Murder uses the BitTorrent protocol to decentralize updates: rather than relying on one system to distribute an update, each server downloads the update and then starts sharing it with the other servers. Gadea explained the process in-depth in a talk he gave in Montreal (below).

Twitter - Murder Bittorrent Deploy System from Larry Gadea on Vimeo.


Jump to comments
Presented by

Niraj Chokshi is a former staff editor at TheAtlantic.com, where he wrote about technology. He is currently freelancing and can be reached through his personal website, NirajC.com. More

Niraj previously reported on the business of the nation's largest law firms for The Recorder, a San Francisco legal newspaper. He has also been published in The Hartford Courant, The Seattle Times and The Age, in Melbourne, Australia. He's also a longtime programmer and sometimes website designer.
Get Today's Top Stories in Your Inbox (preview)

CrossFit Versus Yoga: Choose a Side

How a workout becomes a social identity


Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register. blog comments powered by Disqus

Video

CrossFit Versus Yoga: Choose a Side

How a workout becomes a social identity

Video

Is Technology Making Us Better Storytellers?

The minds behind House of Cards and The Moth weigh in.

Video

A Short Film That Skewers Hollywood

A studio executive concocts an animated blockbuster. Who cares about the story?

Video

In Online Dating, Everyone's a Little Bit Racist

The co-founder of OKCupid shares findings from his analysis of millions of users' data.

Video

What Is a Sandwich?

We're overthinking sandwiches, so you don't have to.

Video

Let's Talk About Not Smoking

Why does smoking maintain its allure? James Hamblin seeks the wisdom of a cool person.

Writers

Up
Down

More in Technology

Just In