HOLLYWOOD is FINISHED!
AI video production with LTX STUDIO
Almost daily I see new, impressive developments in AI. And after AI photos, AI video production is next. LTX STUDIO is not yet available to the general public, but if it can do what it promises, Hollywood is finished!
In my last video we looked together at the clips created by SORA and thought about what that means for media professionals – but also for the industry. OK, yes, even though I’m totally thrilled by the technology, I painted a somewhat gloomy picture for the future of the industry…
…and I can tell you – it doesn’t get better!
Before I go into LTX STUDIO and why Hollywood needs to buckle up, I’ll show you ONE more new thing.
Because in the last video I just said:
LEE: “Still – you have to say – the clips are without sound – but that won’t take long either. Then surely you’ll also be able to specify dialogue or simply a topic – and the characters talk to each other”
And right away I see this.
EMO – Emote Portrait Alive.
EMO is also not publicly accessible yet. So currently just a scientific paper. Through a new method of processing, a character is created from an image and can then reproduce any spoken text. The woman from the SORA video repeats an interview, and not just with synchronously moving lips. The head turns and tilts, the facial expression across the whole face is affected. The eyebrows move and you have the feeling that the speech is being “felt along”. The face becomes more expressive when the voice gets louder or higher. Like in a real conversation.
But not only that. EMO is the first model I’ve seen that lets the images sing! We’ll probably soon find AI singers on Spotify. Incl. music video and interview.
Of course it’s not perfect yet – this is the first version! But you can see how the AI “tries” to convey emotions. The character blinks, the character smirks. Really impressive.
But now to the actual story!
LTX STUDIO. Their claim is: “AI Powered Filmmaking”
“Control every aspect of your video using AI, from ideation to final edits, on one holistic platform.”
So, complete control over the creative process of filmmaking with the help of AI.
Let’s just take a look at the site:
What we’re promised is freely selectable camera settings and camera movements. Whether you only have an idea so far or a complete storyboard, here it becomes reality. It says here…
One of the big challenges in AI video production is reproducing characters and scenery. It’s no use if I can create great shots but my main character looks different after every cut. LTX promises consistency for both here. I create a character and can then use it freely wherever I like. Sound effects, music and voice-over are promised too. What I haven’t seen yet are talking heads. That is, characters who really talk to each other on camera. But since we just saw that with EMO, we can hope for version 2.0! Then they’ll surely talk at LTX too.
Anyway, I’ve talked enough, let’s watch a piece of the trailer:
A holistic movie maker for all. Or in other words: Hollywood for at home!
If everything promised in the trailer really works – I did hear the word dialogue after all – then that’s fantastic. Yes – it doesn’t look quite as “real” yet as the stuff from Sora – but that’s surely a temporary problem too. Or a question of style. There too you’ll be completely free in your choice: historical drama, cyberpunk epic or “real”-life documentary. Documentary especially I find mega exciting. Life tells the best stories – not!
I can already see a documentary about a dragon breeding station in New Zealand.
Or – a lost tribe of Neanderthals that has been hiding in a cave system until now. All footage “shot” handheld to lend the whole thing even more authenticity.
When LTX STUDIO will be available to the broad masses isn’t known yet, I signed up for the waiting list in any case. Let’s see who gets such a tool to market first. OpenAI with Sora? LTX Studio? Or a completely different provider.
I’ll keep you updated and will certainly play around with it, no matter who made it.
LTX STUDIO: https://ltx.studio/
EMO: https://humanaigc.github.io/emote-portrait-alive/