For example, almost 20 percent of the harassment section is dedicated to allegations about crisis actors:
[Do not] target victims or survivors of violent tragedies by name or by image, with claims that they are
- Lying about being a victim of an event
- Acting/pretending to be a victim of an event
- Otherwise paid or employed to mislead people about their role in the event.
Why spell all this out here? Perhaps the bad press generated quite recently around the Parkland shooting?
In the child-abuse section, the guidelines note specifically that videos depicting “tossing, rotating, or shaking of an infant (too young to stand) by their wrists/ankles, arms/legs, or neck” will be considered videos of child abuse. Why is the parenthetical “too young to stand” necessary? Wouldn’t doing the same thing to a 2-year-old qualify? The phrasing suggests that there is some specific case where this was relevant, even if it is hard for us to imagine what it might have been. And it implies that the document records some subset of the exceptions and difficult decisions that the company has come to.
The forum for such decisions is known. There is a regular meeting at Facebook that Monika Bickert, the company’s vice president of global policy management, has described as a “mini legislative session.” In it, different teams across the company come together to agree on what to include in the community guidelines.
If the policy meeting determines legislation, the content moderators then try to apply the law to individual cases. This “legal system”—to keep with the governmental metaphors—metes out decisions, but what kind of institutional memory does Facebook preserve of particularly hard calls or mistakes made? What does the escalation process look like if an individual content moderator cannot make a judgment?
Over the last decade, Facebook users have become accustomed to the existence of these documents, but guidelines of this nature are unprecedented. The closest analogue I have thought of are the covenants, conditions, and restrictions that are sometimes used in real-estate developments. Except that this planned community does not serve a few hundred people, but billions.
These guidelines are needed because the social platforms have created new conditions for humans, and there is no plausible mechanism for people to work things out in the ways that they have in the past. The platforms turned relationships into entities with infinite memory, searchability, concreteness. To build the social graph, to create models of the human social world, what we say to each other in the normal course of human life had to become fixed in text, photos, and videos.
While boundaries of acceptable discourse have always existed, they could remain fuzzy and vague, human-scale. In a real-world community, no “Community Guidelines” beyond actual laws exist because they are policed by the people themselves, not a quasi-governmental entity in the form of a corporation’s content moderators. The guidelines are for the third party (i.e. Facebook) that has inserted itself between and inside and around human communication.