How to test the sparsity of the model？

[lw20191012]

I'm looking for guidance on how to test the sparsity of MLP and Attention layers. Could you provide some advice?

[LiuJinzhe-Keepgoing]

I'm looking for guidance on how to test the sparsity of MLP and Attention layers. Could you provide some advice?

I have encountered the same confusion. Have you found a solution? Can you share the code?

[lw20191012]

I'm looking for guidance on how to test the sparsity of MLP and Attention layers. Could you provide some advice?

I have encountered the same confusion. Have you found a solution? Can you share the code?
I'm sorry! I haven't find a proper way to solve the problem.