Panjaya: The New Kid on the Translation Block
Well, well, well! Look what the cat dragged in—generative AI is now dressing up as a translator, and it’s got a fancy new calling card! Enter Panjaya, the startup that’s claiming a golden ticket in the world of video dubbing with its shiny new product, BodyTalk. Now, before you think, “Oh great, another AI tool,” let me tell you, this one promises to take your videos from drab to fab by re-creating the original speaker’s voice in the language of your choice—without sounding like a robot in a blender!
From Stealth Mode to Standing Ovation
After three years of pulling a “Mission: Impossible” in stealth mode, Panjaya has come into the limelight with not just a dazzling product but also a funding boost of $9.5 million. Who needs a red carpet when you’ve got deep learning specialists like Hilik Shani and Ariel Shalom leading the charge? These two have hung up their government spy hats (okay, maybe not actual spies, but you get the picture) to shake things up in the world of AI. And if the drama of their backstory isn’t enough to impress, let’s sprinkle in Guy Piekarz—the ex-Apple honcho who sold his own startup to the tech giant. Talk about collector’s edition leadership!
BodyTalk: The Spice of Life!
Now, let’s talk turkey about this BodyTalk. So you upload a video, sit back, and voilà—29 languages rolled into one with a voice that sounds just like yours. It’s like a cultural mash-up party where no one has to learn the awkward art of reading subtitles (because, let’s be real—those can sometimes feel like an Olympic sport). The technology includes audio translation, lip-syncing, and movements that don’t look like your 5-year-old trying to dance. In a world where captions are king, this is a royal shake-up!
Guarding the Gates of Tomorrow
Piekarz and the team are not just about creating cool tech; they’re also laying down the law to ensure that things don’t go awry. By focusing on B2B clients like JFrog and TED, they’re putting safety nets in place to avoid the ugly side of synthetic media that, dare I say, gives deepfakes a bad name (seriously, we don’t want your toddler’s birthday video edited to include flying unicorns—unless, of course, that’s the theme!).
The Competition: Swim or Sink
But hold your horses! It’s not all smooth sailing, as they’ve got some heavyweights to contend with in the AI translation game, from Vimeo to Eleven Labs. It’s like trying to swim against a tidal wave while juggling flaming swords—impressive, but risky! With captions now as ubiquitous as avocado toast on Instagram, Panjaya needs to convince the world why we should bother with dubbing when we can just read what Dr. Phil is saying. Because let’s face it, half the time we only have captions on because we’re curious about what the guy in the corner is actually saying. Spoilers: It’s not always profound.
The Nitty-Gritty: Can They Dub Like a Boss?
In their bid to transform video dubbing, Panjaya aims to create a more natural engagement experience—which they claim is actually resulting in a 115% view increase for TED’s dubbed talks. Completion rates doubling? Sign me up! If only I had a Panjaya video for my last family dinner; that could’ve saved me from explaining Aunt Mildred’s stories for the hundredth time.
What’s Next? Future-Proofing the Medium
As they aim for the future, where’s this tech going? Think API expansions and a dash of real-time processing—because we’re all a little impatient these days, right? The goal is to provide a holistic service that doesn’t just cover the surface but digs in deep, all while keeping the potential for misuse in check.
In Conclusion: The Future’s So Bright…
Panjaya is pushing the envelope towards something uniquely exciting. It’s a brave new world we’re stepping into, one where comprehension can transcend borders without sacrificing the essence of the message. If you thought technology couldn’t make the human experience more profound, think again—because this might just be the start of something monumental in how we communicate. Who knew that an AI could talk the talk and walk the walk? At least now we don’t have to decipher muffled voices of actors in foreign films. Congratulations, Panjaya! You’ve made the world just a little less lost in translation.
A startup called Panjaya is revolutionizing the translation landscape with its innovative generative AI platform. The company has developed a hyperrealistic dubbing tool that seamlessly transforms videos by replicating a person’s original voice in a new language while synchronizing the speaker’s physical movements to match the newly spoken words naturally.
After operating under the radar for the past three years, Panjaya is officially launching its debut product, BodyTalk, alongside a significant investment round that raised $9.5 million.
Panjaya emerged from the combined expertise of Hilik Shani and Ariel Shalom, two seasoned specialists in deep learning. Having dedicated years to developing advanced technologies for the Israeli government, they transitioned into the startup realm in 2021. They later welcomed Guy Piekarz as CEO, who brings a wealth of experience.
While Piekarz didn’t co-found Panjaya, his contributions are invaluable. In 2013, he sold his own startup, Matcha, which gained recognition in the streaming video domain, to Apple. This acquisition occurred during the infancy of Apple TV, ultimately leading to Piekarz’s pivotal role in developing Apple TV and its sports division for nearly a decade.
Piekarz discovered Panjaya through Viola Ventures, a key investor, and was captivated by the potential of its technology. “I had left Apple by then and was planning to do something completely different,” Piekarz remarked. “However, seeing a demo of the tech blew my mind, and the rest is history.”
BodyTalk combines multiple cutting-edge technologies to create a seamless experience for users. The AI can translate audio into 29 languages, with the output not only spoken in a voice that closely resembles the original speaker but also adapted to ensure the speaker’s lip movements and gestures align with the new verbal content. Users can upload videos to the platform, which includes an intuitive dashboard for further editing, with future enhancements including an API and improved real-time processing capabilities.
“We’re using best of breed where we need to,” Piekarz explained, highlighting the company’s strategic collaboration with top-tier third-party language models while simultaneously developing proprietary solutions for unmet needs. This integrated approach particularly shines in its advanced lip-syncing technology, which has been custom-built by Panjaya’s AI research team to deliver unparalleled quality and adaptability for diverse scenarios.
Panjaya currently targets B2B clients, working with industry giants like JFrog and TED Media, while eyeing expansion into sectors such as sports, education, and healthcare. The firm is keen on developing tailored solutions that cater to the specific needs of these markets.
The quality of Panjaya’s translated videos is strikingly realistic, though Piekarz is cautious about comparisons to “deepfakes.” He emphasizes that the company strives to distance itself from the negative associations that term carries, positioning Panjaya within the “deep real category” instead.
By exclusively focusing on the B2B market, Panjaya is implementing deliberate measures to control access to its sophisticated tools. Piekarz aims to incorporate safeguards such as watermarking technology, enhancing detection capabilities for modified videos – whether created for legitimate business uses or maliciously misused.
Numerous startups compete in the AI-driven video translation arena, including well-known names like Vimeo and Eleven Labs, along with emerging players like Speechify and Synthesis. The challenge remains significant, as the prevalence of subtitles has made them the go-to solution for many viewers.
A survey revealed that over half of American TV viewers consistently use subtitles, citing reasons ranging from noisy environments to the entertaining aspects of reading captions. Social media platforms like TikTok have adopted captioning by default to enhance user engagement.
However, international demand for dubbed content remains substantial. Despite English being a common language online, research indicates that content delivered in native languages achieves better audience engagement, particularly in B2B applications. Panjaya’s technology seeks to provide more authentic native-language content tailored for greater impact.
Clients such as TED support this assertion, reporting significant increases in engagement metrics: TED Talks utilizing Panjaya’s dubbing technology have experienced a remarkable 115% rise in views, with completion rates for translated videos doubling.
**Interview with Guy Piekarz, CEO of Panjaya**
**Editor:** Welcome, Guy! It’s great to have you with us today. Your startup, Panjaya, has recently launched the innovative BodyTalk product. Can you tell us what distinguishes BodyTalk from other translation and dubbing technologies currently available?
**Guy Piekarz:** Thanks for having me! BodyTalk is a game changer in video dubbing. What sets it apart is its ability to replicate the speaker’s original voice in a new language while also syncing the speaker’s lip movements and gestures in a natural way. This means that viewers aren’t just hearing a translation; they’re seeing the original speaker and feeling the emotion behind the words, which enhances engagement.
**Editor:** That sounds revolutionary! You mentioned that Panjaya has received significant funding, totaling $9.5 million. How has that investment helped bring BodyTalk to fruition?
**Guy Piekarz:** Absolutely. The funding has enabled us to refine our technology, scale our operations, and invest in marketing. We could not have achieved the level of sophistication in our AI and lip-syncing technology without that capital. It has allowed us to focus not only on the product but also on building a robust team of experts in deep learning.
**Editor:** Speaking of your team, you and your co-founders have fascinating backgrounds. What led you to shift from work in advanced technologies for the Israeli government to launching Panjaya?
**Guy Piekarz:** It was quite a journey! After years in deep learning, Hilik Shani and Ariel Shalom wanted to take their expertise into the startup world, which was a huge draw for me. I was captivated by their vision for improving communication across languages and cultures. When I saw a demo of BodyTalk, it was a lightbulb moment for me. The potential felt limitless, and I knew I wanted to be part of that.
**Editor:** Your product seems suited for a range of industries, such as education and healthcare. Can you expand on the types of clients you’re currently working with and any aspirations for the future?
**Guy Piekarz:** Right now, we work with B2B clients like JFrog and TED Media. We see potential expansions into various sectors, particularly those that rely heavily on video content, like sports and education. We’d love to develop tailored solutions for these markets that address their unique needs.
**Editor:** As you venture further into the market, how do you plan to maintain the quality and integrity of your product, especially in light of concerns around deepfakes and synthetic media?
**Guy Piekarz:** That’s a critical point. While the term “deepfake” carries negative connotations, our goal is to create genuine experiences that respect the original content creator’s message. We’re prioritizing safety and ethical considerations by ensuring our technology is not misused, and we’re partnering with reputable organizations to build trust and transparency in our work.
**Editor:** It sounds like you’re not just pushing new technology but creating meaningful change in how we communicate across languages. What’s your vision for the future of Panjaya?
**Guy Piekarz:** Our vision is pretty ambitious! We want to make video communication more accessible and relatable by transcending language barriers. As we develop features like real-time processing and broader API capabilities, our aim is for BodyTalk to become an essential tool for anyone looking to connect with global audiences while preserving the essence of their message.
**Editor:** Exciting times ahead for Panjaya! Thank you, Guy, for sharing your insights. We look forward to seeing how you and your team will continue to innovate.
**Guy Piekarz:** Thank you! It’s great to share our story, and I appreciate the opportunity.
