Apr
29th
FramePack is a next-frame (next-frame-section) prediction neural network structure that generates videos progressively. FramePack compresses input contexts to a constant length so that the generation workload is invariant to video length. FramePack can process a very large number of frames with 13B models even on laptop GPUs. FramePack can be trained with a much larger batch size, similar to the batch size for image diffusion training.
To generate 1-minute video (60 seconds) at 30fps (1800 frames) using 13B model, the minimal required GPU memory is 6GB. (Yes 6 GB, not a typo. Laptop GPUs are okay.)
