The Test We Can—and Should—Run on Facebook

How to reclaim power in the era of perpetual experiment engines

In 1959, the sociologist Edward Shils wrote an influential essay called “Social Inquiry and The Autonomy of the Individual.” He discussed the nature of studying humans with new techniques—which, for him, included concealed cameras, microphones, and forms of “chemical and psychological manipulation.” These could be powerful tools, but they came at a great cost:

There is no doubt that some social scientists, with their zeal for novelty, will be attracted by the possibilities offered by these means of manipulating the external and internal lives of other persons. It is all the more necessary therefore, that the leading persons in these fields should declare themselves as strenuously and decisively opposed to such tampering with human autonomy.

Shils expresses many of the anxieties and conundrums we’ve heard this week about massive human studies on networked platforms.

For a widely criticized study, the Facebook emotional contagion experiment—which deployed its own type of new techniques—managed to make at least one significant contribution. It has triggered the most far-reaching debate we’ve seen on the ethics of large-scale user experimentation: not just in academic research, but in the technology sector at large.

Most of the attention has been focused on the particulars: how almost 700,000 Facebook users were subjected to a psychological experiment without their knowledge or explicit consent, the decision to manipulate their News Feeds to suppress either positive or negative updates, and why this study was accepted to a journal without academic ethics approval. But beyond this horizon, some truly difficult questions lie in wait: What kinds of accountability should apply to experiments on humans participating on social platforms? Apart from issues of consent and possible harm, what are the power dynamics at work? And whose interests are being served by these studies?

But this is not the first time emerging technologies have come into conflict with the reigning beliefs about how human experiments should be done. Not unlike today, the late 1950s and early 1960s were a time of rapid change for social science, with new approaches and a growing appetite for experimental interventions. “Manipulative experimentation,” according to Shils, “is not a relation between equals; it is a relationship in which power is exercised.” For him, the less a subject is informed about or agrees with the aims of the experimenter, and the less intelligible the means of the study, the more ethically problematic it becomes.

We have now had a glimpse within the black box of Facebook’s experiments, and we’ve seen how highly centralized power can be exercised. It is clear that no one in the emotional contagion study knew they were participants, and even now, the full technical means and mechanisms of the study are only legible to the researchers. Nor can we know if anyone was harmed by the negatively skewed feeds. What we do know is that Facebook, like many social media platforms, is an experiment engine: a machine for making A/B tests and algorithmic adjustments, fueled by our every keystroke. This has been used as a justification for this study, and all studies like it: Why object to this when you are always being messed with? If there is no ‘natural’ News Feed, or search result or trending topic, what difference does it make if you experience A or B?

Presented by

Kate Crawford is a visiting professor at MIT’s Center for Civic Media, a principal researcher at Microsoft Research, and a senior fellow at NYU’s Information Law Institute.

Google Street View, Transformed Into a Tiny Planet

A 360-degree tour of our world, made entirely from Google's panoramas

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register.

blog comments powered by Disqus


Google Street View, Transformed Into a Tiny Planet

A 360-degree tour of our world, made entirely from Google's panoramas


The 86-Year-Old Farmer Who Won't Quit

A filmmaker returns to his hometown to profile the patriarch of a family farm


Riding Unicycles in a Cave

"If you fall down and break your leg, there's no way out."


Carrot: A Pitch-Perfect Satire of Tech

"It's not just a vegetable. It's what a vegetable should be."


The Benefits of Living Alone on a Mountain

"You really have to love solitary time by yourself."

More in Technology

Just In