Dubbing in foreign movies or TV shows has never been great. A perfect example is the Korean hit drama series on Netflix, Squid Game. The lack of continuity between the actor’s mouths and the words spoken took away from the viewing experience for the dubbed version of Squid Game. In addition, they used different actors for the dubbing, which made it awkward and not in sync. AI startup Klleon is the creator of KLling, a next-generation auto dubbing solution that enables the characters in a video to speak directly in the language the user wants. Want the character to speak in English? Korean? Chinese? Japanese? No problem with KLling. They can covert content so naturally that you will not be able to know it was dubbed. 

KLling by Klleon

Studios, streaming platforms, or any content creator will find using KLling both fast and easy. They must input their movie or show into the KLling machine learning model and select the language. Then, KLling will do the rest. They can analyze the actor’s voice in just 30 seconds. Can you imagine your favorite actor speaking in your native language? Previously, casting voice actors in each language was necessary to dub a video. It took around 30 days and cost between $20,000 to $80,000 to dub an hour-and-a-half movie. In addition, there were many limitations in terms of awkwardness due to the voice of the original characters and the voice actors not matching. With KLing, anyone can generate multilingual dubbing videos in about three days at $5,000 for an hour-and-a-half-long video. 

How does it work?

KLling uses AI and machine learning-based systems to translate an actor’s voice and expressiveness into other languages. The system can bring the emotion of the original actor’s voice, which other TTS products cannot do. In addition, the system can analyze various lip movements and quickly produce the right lip movement for any speech, so it matches the dubbed sound.

The result is a voice translation indistinguishable from the original actor’s voice. It is a more scalable and cheaper alternative to pure human dubbing. This means when someone watches a dubbed foreign language film, they will not be distracted by the voice-over. The goal is to retain the performance and the original actor’s voice. The key is to preserve as much of the performance of the original actor. 

Only one video is needed for automatic dubbing. Users only need to upload the video and wait while KLing’s one-stop solution automatically dubs it. While other companies require a new voice with only 30 seconds of voice data. KLing is the only automatic video dubbing solution in the world that includes 11 processes, such as creating multilingual voices with the voices of the original characters and synchronizing lip motion that fits the sound.

A Game Changer for Studios and Streaming Platforms. 

People avoid dubbed foreign films because the voice actors are different from the original ones. Therefore, KLling has the potential to become the future of foreign language film consumption all around the world. Moreover, it can reshape the international film landscape and allow actors and directors to reach new audiences with little effort. 

Studios and platforms no longer have to hire actors or rent expensive studios to dub foreign movies. This process is expensive and takes a very long time, so most content is constrained regarding how many languages they can accommodate. A typical 2-hour film can take more than 30 days to get the film dubbed. However, KLling can complete this process in only 3 days. 

There are billions of hours of video content on Youtube and thousands of hours of content on Netflix and other streaming platforms. However, there is no simple and cost-effective way to translate content beyond using subtitles. Global streaming platforms like Netflix, Amazon Prime, Disney+, and Hulu now have a cheap and quick process to dub their content to reach international markets. Furthermore, individual creators, MCN, educational institutions, and business marketing teams can create video content in their native language and have KLling extend your videos worldwide. 

This new dubbing technology is expected to be highly marketable in Europe, where many multilingual speakers exist. Their vision is to expand the dubbing industry from what was limited to the film industry due to its high-cost and long-term resources to broader YouTube content and documentaries, which emerged from one-person media with KLing’s cost and time-efficient solution.

Klleon Partners with CJ E&M

One of KLling’s top clients in Korea is CJ ENM. CJ ENM runs 16 cable TV channels across South Korea, including drama channel tvN and music channel Mnet. They are considered South Korea’s top leading film producer and distributor. Therefore, look out for perfectly dubbed Korean dramas to come out of CJ ENM in the future, thanks to Klleon.

DIA TV, an MCN under CJ ENM, is Korea’s first and largest influencer business group. Famous DIA TV influencers include the Acappella group, “maytree’, and beauty YouTuber ‘Sinnim’ who has more than 5 million subscribers, including famous celebrities such as AKMU’s Lee Soo-hyun and Mr. Trot winner Lim Young-woong. 

KLleon has made a ‘multilingual dubbing multi-content MOU contract with DIA TV to dub YouTubers’ videos in languages worldwide. Until now, influencers’ content has been shared only in Korea, so there were limits on the number of views and subscribers. However, applying KLing can increase the number of views and subscribers, and viewers can enjoy more global content, resulting in a win-win effect. Various videos are being tested, and influencers will start using them within the second half of this year.

Other Creative Services by Klleon

KAMELO 

Kamelo, is a social media platform where users can make and share videos without filming. Users can easily produce video by changing the main character into a different person with a single image and 30 seconds of voice data. Using the Kamelo-Face technology users can:

• Change faces in any video in real-time with just one photo
• turn the face of a character in a movie, drama, or sports clip with the face of someone else
• create a virtual character with any makeup the user desires
• Combine faces to create new faces
• Try on virtual clothes by changing the face of the model to yours

KLONE

KLONE is a digital human solution. These AI Virtual Chatbots can be a user interface for people to interact with. It is an ideal match for KIOSKS in stores such as coffee shops. Moreover, the Virtual Chatbot will be able to answer the customer’s questions and grow more intelligent based on the feedback it receives. Therefore, KLONE could be applied to virtual announcers and even virtual teachers. Samsung is using KLONE for their AI virtual assistant for their Samsung display. 

Klleon at CES 2022 

Klleon received two innovation awards for CES 2022 and connected with content creators and providers. There was a strong presence of Korean startups at CES 2022; those involved in content creation and production saw the latest technologies Klleon has to offer.

“At CES 2022, KLleon will meet many partners in various industries to develop our global business in the United States and enhance the status of Korean startup,” said CEO of Klleon, Seungkyuk Jin.

Klleon at IFA

Klleon will unveil its products at IFA, the world’s largest consumer electronics trade show held every September in Berlin, Germany. IFA will be holding its first offline event in three years since COVID-19. Nearly 20,000 manufacturers and brands are set to introduce their latest products and services. Klleon will participate in the IFA NEXT, where promising startups gather to show new trends in technology.

“Our participation in IFA with our officially launched product will be a great opportunity to strengthen our position in the European market from the previous MWC event,” said Seungkyuk Jin.