|
# for the middle layers, use bias and relu for the output. |
|
self.linear_layers.append( |
|
LinearLayer( |
|
num_classes=lambda input_shape: int(input_shape[-1]), |
|
use_bias=True, |
|
use_bn=True, |
|
name='nl_%d' % j)) |
|
self.dense = tf.keras.layers.Dense( |
|
num_classes, |
|
kernel_initializer=tf.keras.initializers.RandomNormal(stddev=0.01), |
|
use_bias=self.use_bias and not self.use_bn) |
You said, "for the middle layers, use bias and relu for the output." But as settings here, there will be no bias in the middle layers.
