What image generations speeds are you getting on google colab?

[juan9999]

I'm on a T4 GPU and using SD 1.5 and getting the following numbers generating 512X512 images:

I tried renting an A100 and got similar numbers.

The host of lukium.ai tells me he is getting around 18 it/s on test img at 512x512 on a 3090 so I was wondering why google colab was so slow. Is there anything to do to speed it up?

Are other environments faster (runpod, ...)?

HELP!

[TheLastBen]

with the T4 you get 6.2 it/s for 512 images with euler sampler, try the T4

[juan9999]

This was on the T4- tried the A100 and got similar results too :/

Is this with colab pro? (That's what I'm using) or a dedicated server?

[TheLastBen]

make sure you are using the latest colab https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb, because with the standard GPU you should get 6 it/s and with the A100 at least 13 it/s

[juan9999]

I did use the latest :/

I'll try again later today.

[juan9999]

Is there something I can add to the notebook to monitor the performance or memory of the GPU while it's generating?

I run a !nvidia-smi at the star. if yes, that what and where.