No result

[cuczy]

thank you but there have some question
swap_to_collaborative(collab_model, BERTCollaborativeAdapter, dim_shared_query_key=128)
I am also using the bert768 model. Is it here to change the size you want to compress? However, the result can only be output when it is set to 768. There is no way to output the result at 384 and 128. Why is this?

[dns301]

how to use bert？can you provide the BERTCollaborativeAttention code？