[Code] The purpose of learnable broadcast sum in UnicornHead

[staurfan]

Thanks for your job,as mentioned in title,did you do Ablations for the learnable broadcast

[MasterBin-IIAU]

Hi, "learnable broadcast sum" performs almost the same as "direct broadcast sum". Both of them perform better than "broadcast multiplication". Thanks.