TrueSync: Movies with Artificial Intelligence

In the innovative field of artificial intelligence, a company called Flawless is developing a technology that promises to change the way movies are dubbed and localized for global audiences, taking significant steps toward transforming film dubbing.

Using artificial intelligence algorithms and analyzing the original version of the film, TrueSynk captures all the nuances of the performance, creating dubs that are not only accurate but also natural and consistent with the original performance. Thanks to the technology of this software, this dubbing adapts to the actors’ lip movements to ensure perfect synchronization, generating a dub that not only mimics the words but also the cadence and rhythm of the original dialogue. In addition to lip-syncing, it also adjusts facial expressions to match the emotions conveyed in the dubbed dialogue, such as adjustments to eye movements, eyebrows, and other facial features.

The creators of this tool, Scott Mann and Nick Lynes, have been developing AI-powered filmmaking tools for six years with the goal of helping the industry. Scott Mann, who also has an extensive film career, states that AI is the most revolutionary storytelling tool after the film camera, creating opportunities for artists and the industry alike, as films can be better, cost less, and reach more people.

Just as they created TrueSynk, Scott and Nick also took care to create a rights management platform to protect artists, Artistic Rights Treasury (ART), which started as an internal project to implement the responsible use of AI tools — allowing AI tools to be implemented with transparency, consent, credits, and compensation for all rights holders.