This is Atlantic Intelligence, a limited-run series in which our writers help you wrap your mind around artificial intelligence and a new machine age. Sign up here.
Itβs a good bet that the generative-AI era will be stranger than anyone expects. In a new feature for The Atlantic, my colleague Charlie Warzel profiles ElevenLabs, an AI company that specializes in replicating voices.
βItβs easy, when you play around with the ElevenLabs software, to envision a world in which you can listen to all the text on the internet in voices as rich as those in any audiobook,β Charlie writes. βBut itβs just as easy to imagine the potential carnage: scammers targeting parents by using their childrenβs voice to ask for money, a nefarious October surprise from a dirty political trickster. I tested the tool to see how convincingly it could replicate my voice saying outrageous things. Soon, I had high-quality audio of my voice clone urging people not to vote, blaming βthe globalistsβ for COVID, and confessing to all kinds of journalistic malpractice. It was enough to make me check with my bank to make sure any potential voice-authentication features were disabled.β
You may have already encountered ElevenLabsβ technology without realizing it. The Atlantic and The Washington Post use the software to produce audio versions of some stories. Nike cloned the NBA star Luka DonΔiΔβs voice with the software for a recent marketing campaign. New York City Mayor Eric Adamsβs office used it to mimic the politicianβs voice for multilingual robocalls. And a gun-control nonprofit used it to re-create the voices of children killed in the Parkland school shooting.
The company has established safeguards in an attempt to head off nefarious usage, but itβs reasonable to expect surprises. As Charlie writes, βThere are simply too many motivated people constantly searching for ways to use these tools in strange, unexpected, even dangerous ways.β
β Damon Beres, senior editor
ElevenLabs Is Building an Army of Voice Clones
By Charlie Warzel
My voice was ready. Iβd been waiting, compulsively checking my inbox. I opened the email and scrolled until I saw a button that said, plainly, βUse voice.β I considered saying something aloud to mark the occasion, but that felt wrong. The computer would now speak for me.
I had thought itβd be fun, and uncanny, to clone my voice. Iβd sought out the AI start-up ElevenLabs, paid $22 for a βcreatorβ account, and uploaded some recordings of myself. A few hours later, I typed some words into a text box, hit βEnter,β and there I was: all the nasal lilts, hesitations, pauses, and mid-Atlantic-by-way-of-Ohio vowels that make my voice mine.
What to Read Next
P.S.
Apple received a ton of blowback this week for a new iPad commercial that, to many viewers, seemed like an uncomfortable reminder of generative AIβs threats to human creativity: It depicts a variety of artistic tools getting crushed in a hydraulic press, leaving a new tablet behind. βApple wants to show you that the bulk of human ingenuity and history can be compressed into an iPad, and thereby wants you to believe that the device is a desirable entry point to both the consumption of culture and the creation of it β¦ But good Lord, Apple, read the room,β I wrote with Charlie this week. (The company apologized yesterday for the ad.)
β Damon
