This new AI tool from HeyGen dubs your voice in seven languages
The ability to translate your voice and videos into different languages easily is now as easy as pressing a button.
Key takeaways
- The clip has to be at least 30 seconds long and should ideally feature just one person.
- The results were stunning and the video has since racked up more than 6 million views.
- One Twitter user said when they uploaded their video they were in the 95,000th spot.
Cite or link to this article
Griffin, M. (2024) 'This new AI tool from HeyGen dubs your voice in seven languages', 311 Institute, 3 January. Available at: https://www.311institute.com/this-new-ai-tool-clones-your-voice-in-seven-languages/ (Accessed: 1 October 2026).
How many languages do you speak? Thanks to Artificial Intelligence (AI), that number could be as many as seven. Los Angeles-based AI video platform HeyGen has launched a new tool that clones your voice from a video and dubs and translates what you’re saying into seven different languages. If that wasn't enough, it also syncs your lips to your new voice so the final clip looks - and sounds - as realistic as possible.
Called Video Translate, the tool allows you to upload a video of yourself speaking in English, Spanish, French, Chinese, German, Italian, Portuguese, Dutch, Hindi or Japanese. The requirements are pretty basic so you don’t need any fancy cameras, microphones or software. The clip has to be at least 30 seconds long and should ideally feature just one person. But other than that, you just upload your video and in a single click HeyGen can translate what you’re saying. And you can choose whether you want the output to be in Spanish, French, Hindi, Italian, German, Polish, Portuguese or English.
See it in action
Twitter user Jon Finger uploaded a video he made speaking English with translations in both French and German. The results were stunning and the video has since racked up more than 6 million views. French and German speakers have confirmed that the AI tool did a pretty accurate job. Finger also asked some people he knew for their thoughts and they told him the results were “just a little robotic but pretty incredible.”
Following its September 7 launch, HeyGen’s AI tool has since gone viral and Jon Finger’s video added fuel to the raging fire.
I wanted to try the tool for ourselves but our 30-second test clip ended up at the back of a queue that was - deep breath - over 141,000 videos long! One Twitter user said when they uploaded their video they were in the 95,000th spot. After 18 hours of waiting they ended up even further back than their original starting spot and found themselves behind 122,000 other eager users.
Finger replied saying that his video took 10 minutes to process because “there was basically no line” when he tested it out just a few days ago. He said it currently seems impossible to test the free version.
HeyGen said that they are trying to scale up their GPU capacity as fast as possible to accommodate the increased demand. It also added that paid users get to skip the line and get their videos within 10 minutes. The cheapest paid option currently costs $29 per month with an annual subscription slashing 20% off with support for even more languages is also expected by the end of this month.
FAQ
Why does this matter?
The ability to translate your voice and videos into different languages easily is now as easy as pressing a button.
About the author
Matthew Griffin Founder, 311 Institute
Matthew Griffin is a multi-award winning Futurist and expert in Disruption and Innovation, Geopolitics, Leadership, and Technology, who NASA have described as a "walking encyclopaedia of the future" and a "futurist Polymath."
Read full bio
Matthew Griffin is a multi-award winning Futurist and expert in Disruption and Innovation, Geopolitics, Leadership, and Technology, who NASA have described as a "walking encyclopaedia of the future" and a "futurist Polymath." 15-time best selling author of the "Codex of the Future" series, Matthew is the Founder and Futurist in Chief of the 311 Institute, a global Futures and Deep Futures advisory firm working with royal households, world leaders, G7, G20, and G77 governments, NGOs, and multi-national mid and mega cap firms to help them explore, shape, and lead the next 50 years of business and society.
An award-winning YouTube creator with over a million followers, with an unrivalled global reach and impact, Matthew is a highly sought-after international keynote speaker, lecturer, and mentor who collaborates with global leaders through the United Nations Alliance of Civilizations (UNAOC) and United Nations General Assembly (UNGA) to shape pivotal initiatives such as the UN’s AI for Humanity program, the United Nations Conference of the Parties (UN COP), and the World Economic Forum in Davos.
As the former Global Head of Cloud, National Security, and Enterprise Sales for companies including Atos, Dell-EMC, and IBM, Matthew has a proven track record of building multi-billion dollar business units and turning failing divisions into market leaders. His ability to identify, analyse, and communicate the implications of hundreds of emerging technologies and trends is unparalleled, and his insights are trusted by many of the world’s most respected organisations, including ABB, Accenture, Adidas, AON, ARM, BCG, Centrica, Citi, Coca-Cola, Dentons, Deloitte, Dow Jones, EY, Google, KPMG, Lego, Legal & General, LinkedIn, Microsoft, PepsiCo, Qualcomm, RWE, Samsung, Siemens AG and Siemens Energy, T-Mobile, UBS, VISA, Walmart, Workday, Worldpay and many others.
Regularly featured in the global media including the AP, BBC, Bloomberg, CNBC, Discovery, Forbes, Khaleej Times, Telegraph, TIME, ViacomCBS, WIRED, and the WSJ, Matthews mission is to help organisations create a fair and sustainable future whose benefits are shared by everyone irrespective of their ability, background, or circumstances.
What future do you need to see?
Choose one to get started on AI and intelligence and the future of your organisation.
Sources and further reading
- Video translate labs.heygen.com
Source: first published by the 311 Institute on 3 January 2024. Cite as: Griffin, M. (2024). This new AI tool from HeyGen dubs your voice in seven languages. 311 Institute. https://www.311institute.com/this-new-ai-tool-clones-your-voice-in-seven-languages/
You are welcome to quote this article with credit and a link to the original.