This new AI video tool clones your voice in 7 languages — and it's blowing up

A group of people talking in front of the Eiffel Tower
(Image credit: Shutterstock)

How many languages do you speak? Thanks to AI, that number could be as many as seven. Los Angeles-based AI video platform HeyGen has launched a new tool that clones your voice from a video and translates what you’re saying into seven different languages. If that wasn't enough, it also syncs your lips to your new voice so the final clip looks (and sounds) as realistic as possible.

Called Video Translate, the tool allows you to upload a video of yourself speaking in English, Spanish, French, Chinese, German, Italian, Portuguese, Dutch, Hindi or Japanese. The requirements are pretty basic so you don’t need any fancy cameras, microphones or software. The clip has to be at least 30 seconds long and should ideally feature just one person. But other than that, you just upload your video and in a single click HeyGen can translate what you’re saying.

You can choose whether you want the output to be in Spanish, French, Hindi, Italian, German, Polish, Portuguese or English.

Twitter user Jon Finger uploaded a video he made speaking English with translations in both French and German. The results were stunning and the video has since racked up more than 6 million views.

See more

French and German speakers have confirmed that the artificial intelligence tool did a pretty accurate job.

Finger also asked some people he knew for their thoughts and they told him the results were “just a little robotic but pretty incredible.”

We tried to test it

HayGen AI video translate tool

(Image credit: Future)

Following its September 7 launch, HeyGen’s AI tool has since gone viral and Jon Finger’s video added fuel to the raging fire.

We wanted to try the tool for ourselves but our 30-second test clip ended up at the back of a queue that was, *deep breath*, over 141,000 videos long.

One Twitter user said when they uploaded their video they were in the 95,000th spot. After 18 hours of waiting they ended up even further back than their original starting spot and found themselves behind 122,000 other eager users.

Finger replied saying that his video took 10 minutes to process because “there was basically no line” when he tested it out just a few days ago. He said it currently seems impossible to test the free version.

See more

HeyGen said that they are trying to scale up their GPU capacity as fast as possible to accommodate the increased demand. It also added that paid users get to skip the line and get their videos within 10 minutes. The cheapest paid option currently costs $29 per month with an annual subscription slashing 20% off.

Support for even more languages is also expected by the end of September. 

More from Tom's Guide

Christoph Schwaiger

Christoph Schwaiger is a journalist who mainly covers technology, science, and current affairs. His stories have appeared in Tom's Guide, New Scientist, Live Science, and other established publications. Always up for joining a good discussion, Christoph enjoys speaking at events or to other journalists and has appeared on LBC and Times Radio among other outlets. He believes in giving back to the community and has served on different consultative councils. He was also a National President for Junior Chamber International (JCI), a global organization founded in the USA. You can follow him on Twitter @cschwaigermt.