Skip to content
anythingai.space
Generative AIintermediate11 min · 8 steps

Video Generation: Diffusion Across Time

Video is many images that must agree. See how video diffusion denoises across space and time, and how the same machinery powers text-to-video, image-to-video, editing and prediction.

same prompt, 8 timesFRAMES GENERATED INDEPENDENTLYf1 red foxf2 red foxf3 jumps leftf4 grey foxf5 two tailsf6 red foxEach frame is plausible; the sequence is not.Prompt“a fox running in snow”Image modelone frame at a time×8
requestdataresponsesignal
1 / 8
ProblemStep 1 of 8

Generate each frame on its own and the video falls apart

A video is a sequence of images. The naive approach is to run an image model once per frame with the same prompt. Each frame looks fine on its own, but the fox changes colour, grows a second tail and jumps around.

The missing ingredient is temporal consistency: every frame has to agree with its neighbours, and motion has to look physically plausible.

Watch outVideo is not just “many images”. Coherence over time and realistic motion are what make it hard.

Lesson 6 of 8 in Generative AI