Interesting models / kernels to contribute

[konstantinos-p]

Is there a list of kernels or models that would be interesting to contribute to Liger-Kernel? Maybe the maintainers @Tcc0403 can chime in!

[Tcc0403]

Thank you for bringing it up! We will release a roadmap soon.

Here are some we are interested in:

• MoE Moe kernel for latest transformers v5 #958 (we don't have it yet!)
• another MLP implementation Another MLP implementation along with multiplier support #937
• GeGLU numerical issue GeGLU kernel numerical issue #959

[konstantinos-p]

Thanks for the prompt reply :) I'll have a look at these.