Recommended Normalization Layer for GAT

[mertkiray]

Hello, I know this is a dumb question but
Which normalization layer should I use default for GATs what is the current "to go" normalization layer? Should I go with Instance Norm, Layer Norm or Graph Norm?

[rusty1s]

I don't think there is any consensus on which normalization to use in combination for which layer. I actually find BatchNorm to work well in most cases, and I would only play around with the other options in case BatchNorm fails :)