Algorithms are shaping how we see the world around us, with big consequences. What a machine thinks we need to know can become what we fear.
On February 8, 2012, I was on Yahoo's homepage when a headline caught my eye: "Mo. teen gets life with possible parole in killing." Curious, I clicked to see what atrocity had transpired in the state where I live. Alyssa Bustamante, a teenager from Jefferson City, had strangled and stabbed her nine-year-old neighbor for the sheer thrill of it, later describing the event in her diary as an "ahmazing" experience. Horrified, I closed the page. Like many whose homepage defaults to Yahoo, this quick scan of a story was a rote action, information via procrastination, almost subconsciously performed every morning before I move on to other things. In this case, the story was so awful that I wanted to get away. Except, it turned out, I couldn't.
For the next month, I woke up to a barrage of horrifying stories that seemed to signal an epidemic of child torture in America. "3-year-old recovering after swallowing 37 powerful magnets," Yahoo solemnly informed me on March 5; "Police: Alaska girl locked in frigid bedroom dies" on March 6. Occasionally the child in question survived their ordeal ("7-year-old boy survives brush with tornado in North Carolina", March 4) but more often than not they were the adversary ("Boy, 9, charged in shooting of third-grade classmate", February 23; "11-year-old California girl dies after fight with classmate", February 26; "Texas boy, 12, accused of brandishing loaded gun", February 27; "10-year-old girl's death in fight with student ruled homicide", February 27).
I rarely clicked on any of these headlines, and at first, I didn't notice the way they had crept into my Yahoo homepage -- and into my mind -- until their pervasiveness became impossible to ignore.
That's when I realized: Yahoo had decided I liked child murder.
* * *
"If there is one unambiguous trend in how the Internet is developing today," writes Evgeny Morozov, "it's the drive toward the personalization of our online experience. Everything we click, read, search, and watch online is increasingly the result of some delicate optimization effort, whereby our previous clicks, searches, 'likes,' purchases, and interactions determine what appears in our browsers and apps."
Morozov was writing about algorithmic optimization, a concept outlined in Eli Pariser's "The Filter Bubble," which describes the way that websites like Yahoo and Google tailor what they show someone according to the previous online activity of that user. By capitalizing on what are assumed to be your pre-existing interests, it intends to make you more likely to read stories or click on ads.
Opponents of the practice, like Parisier, fear that filter bubbles prevent users from experiencing viewpoints other than their own. They strip online worlds of their serendipity, imprisoning users in an informational comfort zone. But I had the opposite experience: child murder was my presumed interest. Yahoo News had become my own personal Hunger Games, making me a spectator to violence I would never voluntarily seek out.
Filter bubbles are usually criticized on material or political grounds: They reinforce pre-existing tastes, manipulate consumers into buying products, and limit knowledge of opposing views. But what if the filter is wrong? What if it's not a true reflection, but a false mirror -- one that does not respond to fears and prejudices, but creates them?
* * *
We live in one of the safest eras in recent history to raise kids. Violence against children has dropped over the past four decades, yet the perception that times are more dangerous has made American parents more over-protective than ever before. David Robert Hogg, who runs the parenting website My Little Nomads, attributes this to the "TV bubble -- where the world is filled with risks and crime and violence." Hogg supports the philosophy, popularized by journalist Lenore Skenazy, of "free range kids": a movement that seeks to debunk media myths of rampant child endangerment and encourage a more laissez-faire approach.
Is the filter bubble replacing the TV bubble? It's possible, but, crucially, it's impossible to tell. Unlike tabloid television, algorithmic personalization does not announce that it's pandering to base interests. When sensationalized reports about violence against children are on TV, I can change the channel -- an act that is harder to do on the Internet when seemingly "neutral" spaces, like Yahoo's homepage, leave no tell-tale trace of manipulation. You can't change the channel when you don't know you're watching the program.