Activations in this model are ternary {-1,0,1}, not binary {-1,1}

[mrcslws]

This code uses tensor.sign() to binarize the activations and weights.

BinaryNet.pytorch/models/binarized_modules.py

Line 13 in f5c3672

return tensor.sign()

The desired behavior is to always return -1 or 1, but sign() returns 0 for values that are 0.

Batch normalization makes 0 less probable, but it can still happen. The code should probably force every activation to be either -1 or 1.

[Ronalmoo]

Agree.

[donghn]

Actually, No activation or weights equal to 0. I already checked it.

[m-mb]

I faced the same issue and in my case weights and activations with a value of 0 appear quite often.
Replacing the tensor.sign() with torch.where(tensor >= 0, 1., -1.) does the trick