Low GPU VRAM Warning

[zenalv]

Hello,
after the update i get this warning on a 4gb gtx 1650 super

"----------------------
[Low GPU VRAM Warning] Your current GPU free memory is 926.58 MB for this diffusion iteration.
[Low GPU VRAM Warning] This number is lower than the safe value of 1536.00 MB.
[Low GPU VRAM Warning] If you continue the diffusion process, you may cause NVIDIA GPU degradation, and the speed may be extremely slow (about 10x slower).
[Low GPU VRAM Warning] To solve the problem, you can set the 'GPU Weights' (on the top of page) to a lower value.
[Low GPU VRAM Warning] If you cannot find 'GPU Weights', you can click the 'all' option in the 'UI' area on the left-top corner of the webpage.
[Low GPU VRAM Warning] If you want to take the risk of NVIDIA GPU fallback and test the 10x slower speed, you can (but are highly not recommended to) add '--disable-gpu-warning' to CMD flags to remove this warning.
----------------------"

My 2 questions are,

1. where do i place the '--disable-gpu-warning' string exactly?

2. from where does this 'you may cause NVIDIA GPU degradation' warning come from?

A card that is made for doing things wont break by actually doing them.
A car wont break down by normal operation either. Cause its made for it.
An engine wont die by operation cause it just is made for it. ( as long its lubed ofc).
IMO this warning is clueless and has no basis what so ever. Eg, it comes from no experience what so ever.
scratching head

[atbgams]

You may lower the value in the GPU Weights (MB) option, for example to 2500,as my poor NVIDIA GeForce GTX 1050 Ti 4G

[zenalv]

I've seen that window only when using the Flux option, can this be done in sdxl too ?

[xDarkAgentx]

I have this exact same issue running anything on XL now after your recent update.

And in XL mode the gpu weights are now gone from the bar.

Even with anything basic with no loras or includes on a 2080 super with 8GB it's constantly spamming the console

[danilomaiaweb]

Hello,
after the update i get this warning on a 4gb gtx 1650 super

"----------------------
[Low GPU VRAM Warning] Your current GPU free memory is 926.58 MB for this diffusion iteration.
[Low GPU VRAM Warning] This number is lower than the safe value of 1536.00 MB.
[Low GPU VRAM Warning] If you continue the diffusion process, you may cause NVIDIA GPU degradation, and the speed may be extremely slow (about 10x slower).
[Low GPU VRAM Warning] To solve the problem, you can set the 'GPU Weights' (on the top of page) to a lower value.
[Low GPU VRAM Warning] If you cannot find 'GPU Weights', you can click the 'all' option in the 'UI' area on the left-top corner of the webpage.
[Low GPU VRAM Warning] If you want to take the risk of NVIDIA GPU fallback and test the 10x slower speed, you can (but are highly not recommended to) add '--disable-gpu-warning' to CMD flags to remove this warning.
----------------------"

My 2 questions are,

1. where do i place the '--disable-gpu-warning' string exactly?

2. from where does this 'you may cause NVIDIA GPU degradation' warning come from?

A card that is made for doing things wont break by actually doing them.
A car wont break down by normal operation either. Cause its made for it.
An engine wont die by operation cause it just is made for it. ( as long its lubed ofc).
IMO this warning is clueless and has no basis what so ever. Eg, it comes from no experience what so ever.
scratching head

In webui-user.bat add in argument line
--lowvram --disable-model-loading-ram-optimization

[xDarkAgentx]

Hello,
after the update i get this warning on a 4gb gtx 1650 super
"----------------------
[Low GPU VRAM Warning] Your current GPU free memory is 926.58 MB for this diffusion iteration.
[Low GPU VRAM Warning] This number is lower than the safe value of 1536.00 MB.
[Low GPU VRAM Warning] If you continue the diffusion process, you may cause NVIDIA GPU degradation, and the speed may be extremely slow (about 10x slower).
[Low GPU VRAM Warning] To solve the problem, you can set the 'GPU Weights' (on the top of page) to a lower value.
[Low GPU VRAM Warning] If you cannot find 'GPU Weights', you can click the 'all' option in the 'UI' area on the left-top corner of the webpage.
[Low GPU VRAM Warning] If you want to take the risk of NVIDIA GPU fallback and test the 10x slower speed, you can (but are highly not recommended to) add '--disable-gpu-warning' to CMD flags to remove this warning.
----------------------"
My 2 questions are,

1. where do i place the '--disable-gpu-warning' string exactly?
2. from where does this 'you may cause NVIDIA GPU degradation' warning come from?

A card that is made for doing things wont break by actually doing them.
A car wont break down by normal operation either. Cause its made for it.
An engine wont die by operation cause it just is made for it. ( as long its lubed ofc).
IMO this warning is clueless and has no basis what so ever. Eg, it comes from no experience what so ever.
scratching head

In webui-user.bat add in argument line --lowvram --disable-model-loading-ram-optimization

Familiar with lowvram but not sure it's necessary. What's the 2nd command do? Is it specific to forge?

and have you tried these fixes to see if they work?

[danilomaiaweb]

When I only had 4GB I used the --lowvram parameter and it worked perfectly. Now I have 8GB and the automatic system marks it as NORMAL_VRAM

[Giribot]

Hello !

i use NeverOOM and it's solving the problm for me (and it's quick)

[carlmoss22]

i also get that message on a 3060 with 12 gb.
Q6_k model has not enough Vram but the Q8_0 model which is ways bigger works without the error message.

[freecoderwaifu]

[Low GPU VRAM Warning] If you continue the diffusion process, you may cause NVIDIA GPU degradation, and the speed may be extremely slow (about 10x slower).

I would think that's only due to possible higher sustained temps, especially memory temps, due to higher VRAM use and possible longer generation times, and only with less than optimal cooling. I don't think or would like to hope there's no other way for damage to occur just from raw processing, unless there's some really strange edge case.

[Yaruze66]

In the old Forge (f0.0.17v1.8.0rc-latest-276-g29be1da7), I did SDXL model generation with x2 upscaling (Hires. fix) with 8GB VRAM without any problems. Now, I decided to try the latest Forge (f2.0.1v1.10.1-previous-421-g59dd981f), and even without upscaling, I get this warning. If I set the GPU Weights to 7,000 MB, the warning stops, but the speed noticeably drops.
My biggest concern is: What is the strange and scary phrase "you may cause NVIDIA GPU degradation"? Can we get some clarification on this?

[stripealipe]

Don't worry about the warning per se.. it basically means that if you get fallback and the speed drops significantly it could take a long long time to generate an image. If you was then batch processing a load of images, this could take a toll on your GPU and keep it rather toasty for an extended period of time..

[Yaruze66]

Ok, thanks for clarifying! The wording is a bit confusing, and I thought perhaps the new Forge has some aggressive calculations that fried the GPU due to incorrect weights... 😅

[stripealipe]

yeah, you should be fine. Try running the OOM options to see if that helps with your warnings and speed drops.

[Redesordem]

I got this same problem running on a 6gb vram gpu, but what I don't understand is that when I lower the GPU weight, instead of getting more vram space for the diffusion iteration, I get less lol.
So if I load 5gb I get 1gb, if I lower to 3.5gb I get only 100mb ?????

Also, could this be why when I run the Flux NF4 model, it takes 9min to load 10 steps at 512x512 while the SD1.5 takes 50secs to run 40 steps?

Oh and while 5.7 of my VRAM is being used to generate the image, my GPU only 3% of my gpu power is being used in total, so I suspect my GPU is not even being used at all for FLUX for some unknown reason.