But there are two big problems with Musk’s explanation.
For one, how does Tesla quantify Autopilot’s safety record compared with an ordinary car? Musk says that, in a car without Autopilot, there is on average one death for every 89 million miles traveled; but in a car with Autopilot, the first death won’t happen for more than twice as many miles. It’s not clear, however, how he reaches this conclusion. Academics like Missy Cummings, a roboticist at Duke, and John Leonard, an engineer at MIT, have long called for more transparency from the manufacturers working in the self-driving car space. (Tesla didn’t immediately respond to a request for clarification on Thursday morning.)
The second problem with the way Musk talks about Autopilot is a much broader messaging problem. In its enthusiasm to stake a claim in the self-driving car space, Tesla has arguably given the impression that Autopilot is more autonomous than it actually is. To be fair, the company has been very careful about underscoring the technology’s limitations. Notice that, even in Musk’s bold statement about his company’s moral obligation to the public, he highlights that Autopilot is safer “when used correctly.”
(As a side note, this is why it’s so important for Tesla to be transparent about the data behind its safety claims: Otherwise “when used correctly” becomes an unlimited get-out-of-jail-free card, because anything can be dismissed as incorrect usage.)
Tesla was similarly careful in the wording of a statement it released after a driver using Autopilot died in a collision with a tractor trailer in May. “It is important to note that Tesla disables Autopilot by default and requires explicit acknowledgement that the system is new technology and still in a public beta phase before it can be enabled,” Tesla wrote at the time. “Additionally, every time that Autopilot is engaged, the car reminds the driver to ‘Always keep your hands on the wheel. Be prepared to take over at any time.’”
It’s still unknown whether the driver who was killed was following those instructions, but it’s obvious that many Tesla drivers treat Autopilot as more autonomous than it actually is. There’s proof of this all over YouTube, where several Tesla drivers have uploaded videos of themselves pushing (and in some cases blowing past) the limits of how Tesla says Autopilot should be used.
“They advise you keep your hands on the steering wheel when using the auto-steer, but as we’re testing, you really don’t need to,” says one man in a video that’s had nearly 2 million hits on YouTube. “No hands, no feet, and I’m not nervous at all, really,” he adds, while cruising at 75 miles per hour on a highway.
In Tesla’s new master plan, Musk made it clear that the company has no plans to pivot from its incremental approach to autonomy. “It would no more make sense to disable Tesla's Autopilot, as some have called for, than it would to disable autopilot in aircraft, after which our system is named,” he wrote.
But by continuing to talk about Autopilot as a facet of eventual driverlessness, Musk may be undermining the very safety he’s promising to the public.