Investigate whether embeddings need LayerNorm applied

[jhurliman]

https://pytorch.org/docs/stable/generated/torch.nn.LayerNorm.html

https://fairseq.readthedocs.io/en/latest/_modules/fairseq/models/transformer/transformer_encoder.html