Bitnet RWKV-7 #73
Description
I see there are many different bitnet implementations (mamba, moe, ...) .... would it somehow also be possible to create one that does RNN like Transformer as RWKV-7 does or Googles new Titan (also RNN)?
{{ message }}
I see there are many different bitnet implementations (mamba, moe, ...) .... would it somehow also be possible to create one that does RNN like Transformer as RWKV-7 does or Googles new Titan (also RNN)?