High GPU memory problem

[zpge]

This is really fantastic work that remains a classic despite the passage of time. For video alignment tasks, storing per-frame activations for multiple videos during training would consume a huge amount of GPU memory. Do you remember how many GPUs were used back then, and what techniques were employed to reduce memory costs?