Panjaya's BodyTalk is a dubbing platform that synchronizes speakers voices, lips, and bodies
Panjaya's new AI dubbing platform BodyTalk synchronizes lip movements and body gestures for natural-looking video translations. BodyTalk early adopter TED reports doubled viewer completion rates and a 115% increase in views of dubbed content.
Panjaya recently emerged from stealth with $9.5 million in funding and the launch of its BodyTalk AI-powered dubbing platform. BodyTalk aims to overcome the limitations of current video localization solutions, such as captioning and traditional dubbing. The company makes a compelling point for its AI-powered dubbing solutions: the main drawback of current localization solutions is that they unavoidably lose aspects of the connection between speakers' words and body language. Thus, the BodyTalk platform's selling point lies in its capability to deliver dubbed videos in which the audio aligns with the facial expressions and movements of the speaker.
BodyTalk's AI system automatically adjusts translations while modulating speech rhythm, tone, and pacing to match the original performance, including natural elements like pauses and breaths. According to Panjaya, the platform can handle videos depicting complex environments, such as videos where two speakers address each other, or a speaker walks across a stage or turns away from the camera to face a whiteboard. The BodyTalk platform also offers tools to modify translations or performance nuances so users can control the final message.
TED is one of BodyTalk's early adopters, recently launching a pilot program to create multilingual versions of selected TED Talks. According to Panjaya, the multilingual TED talks have experienced a 115% increase in views and are twice as likely to be seen from start to finish. Regarding BodyTalk's unique offering, Panjaya.ai CEO Guy Piekarz said, "By focusing on synchronization, our platform delivers content that feels aligned with the original, helping partners connect with their global audiences in a more impactful way."
The platform plans to invest the $9.5 million in funding it has secured from notable investors—including Viola Ventures and R-Squared Ventures—into product development and continued work to connect the world with its AI-powered dubbing solutions.
