Skip to content

Commit 08358de

Browse files
committed
Add comment for wrapper functions in CuArrays.jl
1 parent 107aa3f commit 08358de

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

src/activation.jl

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,11 @@
11
export σ, sigmoid, hardσ, hardsigmoid, hardtanh, relu, leakyrelu, relu6, rrelu, elu, gelu, swish, selu, celu, softplus, softsign, logσ,
22
logsigmoid, logcosh, mish, tanhshrink, softshrink, thresholdrelu, trelu, lisht
33

4+
## Activation functions
5+
#
6+
# Some of activation functions have its wrapper function for GPU in CuArrays.jl.
7+
# https://github.com/JuliaGPU/CuArrays.jl/issues/614
8+
49
"""
510
σ(x) = 1 / (1 + exp(-x))
611

0 commit comments

Comments
 (0)