FramePack is a next-frame (next-frame-section) prediction neural network structure that generates videos progressively. FramePack compresses input contexts to a constant length so that the generation workload is invariant to video length. FramePack can process a very large number of frames with 13B models even on laptop GPUs. FramePack can be trained with a much larger batch size, similar to the batch size for image diffusion training.

To generate 1-minute video (60 seconds) at 30fps (1800 frames) using 13B model, the minimal required GPU memory is 6GB. (Yes 6 GB, not a typo. Laptop GPUs are okay.)

Tags: ai, app, control, diffusion, framepack, generation, image, LINUX, MOVIE, net, VIDEO

Create AI art, with the latest Stable Diffusion models, on your own PC. Amuse is a dependency free, AI image generation studio optimized for AMD hardware.

Tags: ai, amd, amuse, art, diffusion, free app, generative, optimized, simple, stable