Skip to content

Commit 667e062

Browse files
committed
Drop softplus from activation functions supported by LRP
1 parent e7346fd commit 667e062

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

src/types.jl

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,9 +19,7 @@ const PoolingLayer = Union{MaxPoolLayer,MeanPoolLayer}
1919

2020
# Activation functions
2121
"""Union type for ReLU-like activation functions."""
22-
const ReluLikeActivation = Union{
23-
typeof(relu),typeof(gelu),typeof(swish),typeof(softplus),typeof(mish)
24-
}
22+
const ReluLikeActivation = Union{typeof(relu),typeof(gelu),typeof(swish),typeof(mish)}
2523

2624
"""Union type for softmax activation functions."""
2725
const SoftmaxActivation = Union{typeof(softmax),typeof(softmax!)}

0 commit comments

Comments
 (0)