Change epsilon value to 1e-8 for optimizers & adamwfp8 and adamwbf16 …#703

NBSTpeterhill wants to merge 2 commits intoostris:mainostris/ai-toolkit:mainfrom

NBSTpeterhill:PAseer-patch-2-Optimizers-Adamwfp8-and-Adamwbf16-&-ep=1e-8NBSTpeterhill/ai-toolkit:PAseer-patch-2-Optimizers-Adamwfp8-and-Adamwbf16-&-ep=1e-8Copy head branch name to clipboard