Description
I found this paper to be quite interesting TACTiS: Transformer-Attentional Copulas for Time Series. There seems to be an official repo, https://github.com/servicenow/tactis, but it doesn't seem to work yet.
Also, I found this to give a good overview over Transformer architectures https://github.com/qingsongedu/time-series-transformers-review.