ADOBE PREMIERE PRO & SORA
I’m still happy about the new version of DaVinci Resolve and already Adobe is really topping it with Premiere Pro. What that has to do with SORA, we’ll see today – here we go!
I’ll be honest: Adobe Premiere never really interested me. Even if the collaboration with After Effects is grandiose. Because – my first contact with a professional editing system was in 1999 with AVID Media Composer. The TV standard that is still found in many edit and production shops today. For maybe 5 years, though, I’ve switched completely to DaVinci Resolve and haven’t regretted it for a day. But – if Blackmagic doesn’t jump on the AI video generation train at turbo speed now, another system change may be on the cards after all!
But why switch? Adobe just posted this video. Let’s look at the first 90 seconds – they’re already impressive! But the second part of the video then gets really wild.
This version hasn’t been released yet. Adobe Premiere Pro works here with its own AI: Firefly. With it you can mark objects or people in the video and swap them with the help of artificial intelligence. Here, for example, turning a few diamonds into many diamonds. But not only that. I can just as well make things disappear. Also with Adobe Firefly. Simply hover the mouse over the unwanted object and select it. Like with this electrical box here. We know that from Photoshop! But with moving images? That’s new. It works the same way with this sign here. Cables lying around or unwanted brand logos. Cool. Fast. Without additional tracking – but not mind-blowing yet. Here I swallowed for the first time: in editing, timing matters, or you cut to music, to the beat anyway. Then you often have the problem that the desired clip is just a tiny bit too short. Current workaround: slow the footage down with a speed effect, for example, or attach it again played backwards. That is now a thing of the past. With Adobe Premiere Pro and the Firefly AI I can simply trim my clip and my video is extended automatically. Wow! And – the fact that I used AI-generated material in my video will in future be written unerasably (they say so, at least) into the metadata. YouTube can then surely detect automatically whether it’s shot or generated footage. We’ve already speculated about how that might be solved in the future.
But now it gets really crazy: I can use not only Firefly as an AI model, but also third-party models. That is, the AI of other companies. And now drumroll: one of these models is SORA from OpenAI. I don’t even have to leave my editing software, I generate B-roll right in Premiere Pro and can drop it into my timeline. Poof! What? I still have all the comments in my head: “that will never come”, “far too expensive”, “far too computationally intensive”, “that costs millions” – No – it’s coming this year and is simply being integrated into my editing software! Yes – I didn’t think it would happen so fast either!! But we probably have to get used to the fact that technical development advances MUCH faster than we can imagine. It probably won’t be free. In this trailer video you didn’t see it, but there may be a credit system like Adobe Stock. One minute of SORA footage for 10 tokens. Or it will be billed through my SORA account, which is linked to my Adobe account. For me the more plausible variant. Because with Pika, or as here with Runway, I can also generate videos right in the edit. So, depending on project, taste and wallet, choose which model I want to work with.
As soon as all of this is available in Adobe Premiere Pro, I’ll test it and report back!