Request for public release of the `fla` package for V1-7B-sft-s3-reasoning

[Andrea-Difino]

Hi BICLab team,

I’m trying to use your model V1-7B-sft-s3-reasoning in Colab/other Python environments.
During the loading process, I encountered the following error:

"It seems that the fla package, which contains the implementations for ShortConvolution, GatedLinearAttention, and RMSNorm, is not publicly available."

Could you please consider making the fla package publicly available, or provide instructions on how to install it, so that the model can be run outside your internal environment?

Thank you for your work and for sharing your research!

[SoulFireMage]

I get this error as well. I'm trying to get this going on Windows, and boy, it's not easy with the dependencies at the moment. Got the model loaded in the end but there's some problem with Flash attention _upad_input error in window_attention.py.