Google reassures critics that Duplex AI will disclose its robot identity

When Google demoed the Duplex voice assistant at its I/O developer conference, it was met with mixed reactions. On one hand, the AI, which can take phone calls on behalf of users, was praised as a technological achievement, especially from the bias developers in attendance. But others had a different impression and are questioning the ethics of an AI deceiving people by acting human.

Now the tech giant is hoping to dispel those concerns by reassuring critics that the robot will disclose its identity.

“We are designing this feature with disclosure built-in, and we’ll make sure the system is appropriately identified,” a Google spokesperson told CNET. “What we showed at I/O was an early technology demo, and we look forward to incorporating feedback as we develop this into a product.”

At I/O, Google unsurprisingly showed off an innocent demonstration of its AI calling a salon to book a haircut appointment and a restaurant to book a table. Unlike the robotic voices we’ve grown used to over the years—Siri, Cortana, and even Google’s Assistant—the Duplex AI was surprisingly convincing, using words like “um” and expertly changing the inflection of its voice. It was so convincing, it fooled the employees on the other end, who had no idea they were speaking to a program, not an actual human.

When the applause faded, criticism against Google was unleashed. TechCrunch’s Natasha Lomas slammed Google in an article titled “Duplex shows Google failing at ethical and creative AI design” while the Washington Post’s Drew Harwell asked, “Should it be required to tell people it’s a machine?“

In its defense, Google made it clear it’s aware of potential ethical concerns in a lengthy write-up about the in-development technology.

“It’s important to us that users and businesses have a good experience with this service, and transparency is a key part of that,” the company wrote. “We want to be clear about the intent of the call so businesses understand the context. We’ll be experimenting with the right approach over the coming months.”

Sundar Pichai eerily echoed that sentiment, reaffirming the potential dangers of AI while explaining the importance of taking the right steps in developing it.

“There are very real and important questions being raised about the impact of technology and the role it will play in our lives,” Pichai said. “We know the path ahead needs to be navigated carefully and deliberately—and we feel a deep sense of responsibility to get this right.”

Google did not specify what its Duplex disclosures would sound like. In the demo it showed, the AI did not reveal its true self, perhaps for testing purposes or to further the illusion for crowd members. However, it wouldn’t be difficult for Google to simply add a “This is the Google Assistant calling…” prompt at the start of each conversation.

Even then, this is only the tip of the iceberg when it comes to ethical decisions around AI. As technology grows more advanced, AI will spread further into our daily lives. Prominent figures, including Elon Musk and the late Stephen Hawking, think it’s better left alone, with Hawking once saying AI could be the “worst event in the history of our civilization.”