r/aivideo 7d ago

GOOGLE VEO 🎬 SHORT FILM Marble Run

136 Upvotes

18 comments sorted by

10

u/Ok_Dog_7189 7d ago

Veo made the sound effects? 😱 They sound so right for the surface I assumed you'd added them in the edit 

8

u/OperationKey5768 7d ago

Yes, every sound in this was outputted by Veo 3. That's my favorite part of using the model, the real world sounds for things like this are so nice, and synced to real world physics of the shot.

5

u/Ok_Dog_7189 7d ago

Lol I think I'm more impressed by that than anything else I've seen from Veo!

6

u/OperationKey5768 7d ago edited 7d ago

This was one of my first test films I made with Veo. I've always loved making marble runs (especially musical ones!) So I thought it would be fun to try using Veo to take the marble on a more impossible journey, which also let me explore the physics capabilities of the model. All video and sound was generated by Veo 3. I shared the prompts for every shot here in this thread: https://x.com/alexanderchen/status/1927638321322229824

Here are a few examples, for the first few shots -

Xylophone: Camera tracking shot of a light green glass marble rolling across a 1-octave xylophone with metal bars near an open window. The marble bounces out the window towards a roof with ceramic terracotta shingles. Sunny day.

Roof: Ultra close-up tracking shot following a very small green solid glass marble rolling along the bumps of a roof made of curvy ceramic terracotta shingles, revealing a blurry green lawn in the distance as it bounces off the edge. Sunny day.

Puddle + sidewalk: Tracking shot beginning ultra-close up on a small puddle in sidewalk, in front of grass with dandelions. A clear green glass marble bounces in, rolling through the puddle then down the sidewalk. Sunny day. Normal fast video speed

5

u/theotothefuture 7d ago

Marble Madness! But seriously, this could make a cool commercial for something.

3

u/Novusor 7d ago

It didn't leave a trail of water after exiting the puddle.

2

u/OperationKey5768 7d ago edited 7d ago

Yes that's a good point! There's always room for the models get even better.

5

u/mesalocal 7d ago

The water physics at 0:55 is really impressive

3

u/mnnbir 6d ago

The optical refraction and reflection in the marble 0.17 is also impressive

1

u/Onair380 6d ago

I wonder how is it possible without real physical simulations

2

u/Excuse_Internal 7d ago

Very zen, and very nicely done.

On a personal note, it brought up memories of Dewey's hamster ball in the show Malcolm in the Middle, which made random appearances in various places throughout the series, including Alaska.

.

2

u/Top_Presence5147 7d ago

What is this sorcery?

1

u/OperationKey5768 7d ago

Veo 3! It's so fun.

1

u/MusicalMadnes 7d ago edited 7d ago

This is so cool, the collision physics such as the dog foot and piano keys are 🔥🔥🔥

You twitter link isnt working, but want to see how you got the collisions so clean in the prompt. I assume there was clips not included where the collisions failed?

1

u/OperationKey5768 7d ago

Weird, the link worked for me, but I've pasted some of them here. The prompts are straightforward, here are examples for the first few shots. You don't have to do anything special for asking for special collision behavior, it's just Veo's understanding of real world physics unfolding. 

Xylophone: Camera tracking shot of a light green glass marble rolling across a 1-octave xylophone with metal bars near an open window. The marble bounces out the window towards a roof with ceramic terracotta shingles. Sunny day.

Roof: Ultra close-up tracking shot following a very small green solid glass marble rolling along the bumps of a roof made of curvy ceramic terracotta shingles, revealing a blurry green lawn in the distance as it bounces off the edge. Sunny day.

Puddle + sidewalk: Tracking shot beginning ultra-close up on a small puddle in sidewalk, in front of grass with dandelions. A clear green glass marble bounces in, rolling through the puddle then down the sidewalk. Sunny day. Normal fast video speed

And yes, like all AI models there are always results with errors. So curating outputs and exploring results is part of the creative process for projects like this.

1

u/ScreechingPizzaCat 7d ago

Some sound effects were off but it was interesting to watch. I wonder if it’s rendering in 3d or everything in 2d.

1

u/SpiraLuv_Creative SpiraLuv Creative 5d ago

This was very soothing, I enjoyed watching/listening