We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 8a4bb3b commit 0d77a24Copy full SHA for 0d77a24
src/nn/vulkan/cast-forward-f32-q80.comp
@@ -66,7 +66,7 @@ void main() {
66
amax = max(amax, v);
67
}
68
69
- const float d = amax / ((1 << 7) - 1);
+ const float d = amax / 127.0;
70
const float id = d != 0.0 ? 1.0 / d : 0.0;
71
72
y[yiOffset].d = float16_t(d);
0 commit comments