Daniel Kahneman on 'Emergent Weirdness' in Artifical Intelligences

Our machines' computational biases are not the same as our brain's cognitive biases, which is going to be weird

creepyAI-body.jpg

Daniel Kahneman is a Nobel laureate, eminent Princeton psychologist, and godfather of behavioral economics. So, when he speaks about emergent phenomenon, it's probably worth listening.

In this case, he submitted himself to a group Q&A by the readers of Freakonomics, and someone asked him about Apple's Siri and how artificial intelligence more generally might reflect human cognitive biases.

Q. With the launch of Siri and a stated aim to be using the data collected to improve the performance of its AI, should we expect these types of quasi-intelligences to develop the same behavioral foibles that we exhibit, or should we expect something completely different? And if something different, would that something be more likely to reflect the old "rational" assumptions of behavior, or some totally other emergent set of biases and quirks based on its own underlying architecture? My money's on emergent weirdness, but then, I don't have a Nobel Prize. -Peter Bennett

A. Emergent weirdness is a good bet. Only deduction is certain. Whenever an inductive short-cut is applied, you can search for cases in which it will fail. It is always useful to ask "What relevant factors are not considered?" and "What irrelevant factors affect the conclusions?" By their very nature, heuristic shortcuts will produce biases, and that is true for both humans and artificial intelligence, but the heuristics of AI are not necessarily the human ones.

The emphasis above is mine. If what he's saying is a little opaque, let me unpack it. Human brains take shortcuts in making decisions. Finding where those shortcuts lead us to dumb places is what his life work has been all about. Artificial intelligences, say, Google, also have to take shortcuts, but they are *not* the same ones that our brains use. So, when an AI ends up in a weird place by taking a shortcut, that bias strikes us as uncannily weird.

Get ready, too, because AI bias is going to start replacing human cognitive bias more and more regularly.

Via @FelixSalmon

Image: imredesiuk/Shutterstock.

Presented by

The 86-Year-Old Farmer Who Won't Quit

A filmmaker returns to his hometown to profile the patriarch of a family farm

Join the Discussion

After you comment, click Post. If you’re not already logged in you will be asked to log in or register.

blog comments powered by Disqus

Video

The 86-Year-Old Farmer Who Won't Quit

A filmmaker returns to his hometown to profile the patriarch of a family farm

Video

Riding Unicycles in a Cave

"If you fall down and break your leg, there's no way out."

Video

Carrot: A Pitch-Perfect Satire of Tech

"It's not just a vegetable. It's what a vegetable should be."

Video

An Ingenious 360-Degree Time-Lapse

Watch the world become a cartoonishly small playground

Video

The Benefits of Living Alone on a Mountain

"You really have to love solitary time by yourself."

More in Technology

Just In