Facebook Workers Try to Spend Less Than 1 Second Determining Whether Content Is 'Appropriate'

Emily Bazelon's deeply reported piece on bullying at Woodrow Wilson Middle School in Watertown, Connecticut is full of important information. But for me, the most telling moment occurred when she traveled to Facebook headquarters to see how they dealt with so-called "third party" reports of about inappropriate content.

Once there, she found someone who scans through the requests. And she asked him how long he might spend deciding if a page should stay up or come down. In the section below, he tells her that they "optimize for half a second." Half a second! As it happens, in this story, a bullying Facebook group at Woodrow Wilson was incorrectly labeled as appropriate twice, despite not having been organized under a real name, so that it was clearly in violation of Facebook's terms of service, among other problems. The mislabeling by two reps also meant that any further requests to take it down would be ignored. Though no one making requests to take the page down -- like, say, the people working at the school -- would be informed that they were being ignored.

Facebook's come up with some remarkable tools for managing conflict on its site. They've pioneered efforts to identify suicidal users. And they've got a really, really tough problem on their hands when it comes to kids and bullying. Middle- and high-schoolers are all on Facebook and that means all their drama is on Facebook, too. (I should also note that no other social network handles these issues particularly well, either.)

But Facebook purports to be a safer, real-namey Internet. That's part of the pitch, right? And they claim to have ways of handling problems like this, which serves as a defense to the suggestion that perhaps a government agency should try to regulate them, especially around minors' use of the service. These methods they have, though, are almost always opaque. They claim everything is working well and we have to believe that's true because there are no independent audits being made.

And that's why Bazelon's account from inside Facebook is so important. She got to see the tools and management practices at work. And what she saw dismays me. Facebook could clearly provide better customer service, but they don't want to. Why not? It costs money. Even when they do hire people, of whom they clearly don't have enough, they force them to work at a pace that ensures mistakes. It strikes me that they're optimizing not for actual responsiveness to real concerns but the appearance of responsiveness to real concerns.

This probably isn't surprising. This is how businesses work. Facebook itself recognizes this is an issue and how they might solve it. Here's one of their disclosures in the company's annual report to the SEC:

We have in the past experienced, and we expect that in the future we will continue to experience, media, legislative, or regulatory scrutiny of our decisions regarding user privacy or other issues, which may adversely affect our reputation and brand. We also may fail to provide adequate customer service, which could erode confidence in our brand. Our brand may also be negatively affected by the actions of users that are deemed to be hostile or inappropriate to other users, or by users acting under false or inauthentic identities. Maintaining and enhancing our brand may require us to make substantial investments and these investments may not be successful. If we fail to successfully promote and maintain the Facebook brand or if we incur excessive expenses in this effort, our business and financial results may be adversely affected.

The bet Facebook is making is this: they'll catch most baldly inappropriate content if they give their reviewers half a second to look at each page. Sure, they'll miss some, but that's good enough to keep users on the platform and operations cost low enough for investors.

Presented by

Google Street View, Transformed Into a Tiny Planet

A 360-degree tour of our world, made entirely from Google's panoramas

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register.

blog comments powered by Disqus

Video

Google Street View, Transformed Into a Tiny Planet

A 360-degree tour of our world, made entirely from Google's panoramas

Video

The 86-Year-Old Farmer Who Won't Quit

A filmmaker returns to his hometown to profile the patriarch of a family farm

Video

Riding Unicycles in a Cave

"If you fall down and break your leg, there's no way out."

Video

Carrot: A Pitch-Perfect Satire of Tech

"It's not just a vegetable. It's what a vegetable should be."

Video

The Benefits of Living Alone on a Mountain

"You really have to love solitary time by yourself."

More in Technology

Just In