Imagine sitting down to watch an episode of Game of Thrones—and hardly being able to understand anything. That’s the case for non-native English speakers or any of the 36 million deaf or hard-of-hearing Americans. HBO doesn’t expect its viewers to have a knowledge of High Valyrian; that’s why it takes care to offer subtitles to viewers understand exactly how Daenerys intends to free the slaves of Essos.
If only most online streaming companies took as much care in everyday captioning.
Machine translation is responsible for much of today’s closed-captioning and subtitling of broadcast and online streaming video. It can’t register sarcasm, context, or word emphasis. It can’t capture the cacophonous sounds of multiple voices speaking at once, essential for understand the voice of an angry crowd of protestors or a cheering crowd. It just types what it registers. Imagine watching classic baseball comedy Major League and only hearing the sound of one fan shouting from the stands. Or only hearing every other line of lightning-fast dialogue when watching reruns of the now-classic sitcom 30 Rock.
As of April 30, streaming video companies are now required to provide closed captioning. On all programming. There’s no doubt that we’re in a better place than we were even five years ago, when streaming video companies weren’t required to closed-caption any of its content. But, there still is a long way to go in improving the accuracy of subtitles. Netflix and Amazon Prime users have bemoaned the quality of the streaming companies’ closed captions, citing nonsense words, transcription errors, and endless “fails.” These companies blame the studios for not wanting to pay for accurate translations but excuses aren’t flying with paying streaming video subscribers.
Marlee Matlin, the Oscar-winning actress and longtime advocate for better closed captions for the deaf and hard of hearing, recently mentioned in an interview that she knows that she’s missing out on most of the action when she’s watching streaming video. “I rely on closed captioning to tell me the entire story,” she says. “I constantly spot mistakes in the closed-captions. Words are missing or something just doesn’t make sense. My kids spot it too, they’re aware of sloppy captions and the pieces of information that I’m not being given.”
Context and Knowledge of Cultural Nuance Matters
Machines also fall short when it comes to translating one language into another. It isn’t sufficient to merely exchange words in one language for its equivalent. When it comes to translating emotional writing and an actor’s subtle delivery of a piece of dialogue, there’s no substitute for the human touch. Let’s take it a step further. Imagine being a Japanese person watching the 1995 film Trainspotting and having to rely on a word-for-word translation of heavy Scottish dialect and slang. To say that much would get lost in translation is an understatement.