Replies: 1 comment
-
Looks like a duplicate of #20551 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
The gopher paper mentioned that they found it best to do "random rounding" of parameters from fp32 to bf16 in the forward pass. (https://arxiv.org/pdf/2112.11446.pdf; page 53) I wonder what is the best way to do this in jax?
Beta Was this translation helpful? Give feedback.
All reactions