Synthetic gradient of top layer

[eneftci]

Thanks for sharing this code. In your code the top layer is implemented using an exact gradient, so it is not update unlocked. My understading from the Jaderberg et al. paper was that all layers were trained using synthetic gradients. Thanks,
Emre