Longformer: The Long-Document Transformer, Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context

[jinmang2]

[import-max]

https://docs.google.com/presentation/d/1YImqaBUhTtjcscfDuAIAL3AY-uzpMSi6sq38eFjiIgs/edit?usp=sharing