AI MUSIC VIDEO with LTX STUDIO
Can you already create a complete music video with AI ONLY?
That is the question we explore in the current episode of ALPHATESTER. What are the limitations, what already works, what can we look forward to?
To create a music video at all, we first need a song, of course.
That works great with SUNO right now. You can simply enter an idea or just a genre and “zack” SUNO has created two versions. But you can also enter your own lyrics and specify a genre – that’s what I did for our video.
The story: boy meets girl in the supermarket and falls in love. He waits for her for hours in the frozen food section. When she finally walks by, the boy is frozen stuck. She finds it funny and frees him with a hairdryer. Together they leave the supermarket and go to an open-air concert (where the song is played)
ChatGPT turned my story into this song text:
Music video lyrics:
Met a girl by the freezer, she had a smile so sweet,
In the frozen food aisle, where our hearts did meet.‘
I waited there for hours, just to see her again,
but it’s getting colder, from my feet to my brain.
Chorus:
Stuck to the freezer, can’t feel my feet,
Waiting for my girl by the frozen meat.
She finally asked for coffee, but now I’m in a jam,
I’m frozen to the freezer, like a popsicle man!
Verse 2:
She said, “Hey stranger, let’s grab a cup of Joe,”
But my legs wouldn’t budge, I was stuck like winter snow.
I said, “I’d love to join you, but I can’t move my feet,”
She laughed and said, “Oh darling, you’re the coolest guy to meet!”
Chorus:
Stuck to the freezer, can’t feel my feet,
Waiting for my girl by the frozen meat.
She finally asked for coffee, but now I’m in a jam,
I’m frozen to the freezer, like a popsicle man!
Bridge:
She called for help and got a hairdryer,
Unfreezing my legs, while my heart was on fire.
We laughed and chatted, as the ice began to melt,
She is so perfect, the coolest love I’d ever felt!
Chorus:
Stuck to the freezer, can’t feel my feet,
Waiting for my girl by the frozen meat.
She finally asked for coffee, but now I’m in a jam,
I’m frozen to the freezer, like a popsicle man!
Outro:
So now we joke about it, every time we’re in the store,
How I waited by the freezer, ‘til my legs were sore.
But love’s a funny story, and I’ll tell you if I can,
How I found my darling, stuck like a popsicle man!
Copy-pasted into SUNO, I got these versions, among others:
For the video, though, I decided on an “INFECTIOUS FUNK” version.
So we have the song, now on to the images!
This was the prompt for LTX Studio:
Supermarket. Boy meets girl and falls in love. He is waiting in the supermarket for hours to see her again. He is waiting next to a huge freezer. When she finally arrives, his feet are frozen to the floor. He is stuck in the ice. She uses a hairdryer to free him of the ice. They are hugging each other. They are leaving the supermarket. They are going to an open air concert.
After 4 rounds of prompting and a few hours of editing, this music video came about:
Yes – the quality isn’t amazing yet, the characters aren’t really consistent. A lot still “morphs” within the shots. But considering that nobody had to leave the house and it was only a few hours from idea to finished video – that is really impressive!!
What is your favorite version and what do you think of the Popsicle Man video? 🙂
Looking forward to your comments!
UPDATE
A valued viewer suggested generating a comic version.
Great idea – here you go!
In LTX STUDIO I changed the style of the video to comic. After that I had to hit “regenerate” quite a few times and touch up shoes, T-shirts etc. with inpainting. But I think the version is presentable. Sometimes the shots still seem “too real” to me, i.e. not “comic-like” enough. But apart from that…
Here are a few more links:
SUNO: https://suno.com/
LTX STUDIO: https://ltx.studio/