Shocking stuff, we know. Surely nobody could have seen this coming.Īmong other abuses, Motherboard reports that one 4Chan-er posted a voice that sounded very much like Emma Watson reading a section of Hitler's 'Mein Kampf,' while another used a Ben Shapiro-esque voice to make 'racist remarks' about US House representative Alexandria Ocasio-Cortez. Now, a little over a week later, ElevenLabs is already being forced to reckon with, as they put it in a Monday Twitter thread, 'an increasing number of voice cloning misuse cases.' And though the company didn't clarify any details about said misuse, a Motherboard deep dive into the 4Chan gutters found that a number of the site's chaos monsters strongly appear to have abused the tech to produce phony clips of celebrities saying racist, violent, or otherwise terrible things. 'Eleven brings the most compelling, rich and lifelike voices to creators and publishers seeking the ultimate tools for storytelling.' 'The most realistic and versatile AI speech software, ever,' reads the venture's website. On January 23, ElevenLabs - an AI startup founded by former Google and Palantir employees - announced two things: a $2 million funding round, and the release of a beta for a AI voice generator called Eleven, described in a company press release as an 'AI speech platform promising to revolutionize audio storytelling.'
