Facebook Workers Try to Spend Less Than 1 Second Determining Whether Content Is 'Appropriate'

Emily Bazelon's deeply reported piece on bullying at Woodrow Wilson Middle School in Watertown, Connecticut is full of important information. But for me, the most telling moment occurred when she traveled to Facebook headquarters to see how they dealt with so-called "third party" reports of about inappropriate content.

Once there, she found someone who scans through the requests. And she asked him how long he might spend deciding if a page should stay up or come down. In the section below, he tells her that they "optimize for half a second." Half a second! As it happens, in this story, a bullying Facebook group at Woodrow Wilson was incorrectly labeled as appropriate twice, despite not having been organized under a real name, so that it was clearly in violation of Facebook's terms of service, among other problems. The mislabeling by two reps also meant that any further requests to take it down would be ignored. Though no one making requests to take the page down -- like, say, the people working at the school -- would be informed that they were being ignored.

Facebook's come up with some remarkable tools for managing conflict on its site. They've pioneered efforts to identify suicidal users. And they've got a really, really tough problem on their hands when it comes to kids and bullying. Middle- and high-schoolers are all on Facebook and that means all their drama is on Facebook, too. (I should also note that no other social network handles these issues particularly well, either.)

But Facebook purports to be a safer, real-namey Internet. That's part of the pitch, right? And they claim to have ways of handling problems like this, which serves as a defense to the suggestion that perhaps a government agency should try to regulate them, especially around minors' use of the service. These methods they have, though, are almost always opaque. They claim everything is working well and we have to believe that's true because there are no independent audits being made.

And that's why Bazelon's account from inside Facebook is so important. She got to see the tools and management practices at work. And what she saw dismays me. Facebook could clearly provide better customer service, but they don't want to. Why not? It costs money. Even when they do hire people, of whom they clearly don't have enough, they force them to work at a pace that ensures mistakes. It strikes me that they're optimizing not for actual responsiveness to real concerns but the appearance of responsiveness to real concerns.

This probably isn't surprising. This is how businesses work. Facebook itself recognizes this is an issue and how they might solve it. Here's one of their disclosures in the company's annual report to the SEC:

We have in the past experienced, and we expect that in the future we will continue to experience, media, legislative, or regulatory scrutiny of our decisions regarding user privacy or other issues, which may adversely affect our reputation and brand. We also may fail to provide adequate customer service, which could erode confidence in our brand. Our brand may also be negatively affected by the actions of users that are deemed to be hostile or inappropriate to other users, or by users acting under false or inauthentic identities. Maintaining and enhancing our brand may require us to make substantial investments and these investments may not be successful. If we fail to successfully promote and maintain the Facebook brand or if we incur excessive expenses in this effort, our business and financial results may be adversely affected.

The bet Facebook is making is this: they'll catch most baldly inappropriate content if they give their reviewers half a second to look at each page. Sure, they'll miss some, but that's good enough to keep users on the platform and operations cost low enough for investors.

Presented by

Before Tinder, a Tree

Looking for your soulmate? Write a letter to the "Bridegroom's Oak" in Germany.

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register.

blog comments powered by Disqus


Before Tinder, a Tree

Looking for your soulmate? Write a letter to the "Bridegroom's Oak" in Germany.


The Health Benefits of Going Outside

People spend too much time indoors. One solution: ecotherapy.


Where High Tech Meets the 1950s

Why did Green Bank, West Virginia, ban wireless signals? For science.


Yes, Quidditch Is Real

How J.K. Rowling's magical sport spread from Hogwarts to college campuses


Would You Live in a Treehouse?

A treehouse can be an ideal office space, vacation rental, and way of reconnecting with your youth.

More in Technology

Just In