remove silu for CogView4#12150

Merged

a-r-r-o-w merged 9 commits intohuggingface:mainfrom

lambertwjh:fix/adaln-remove-silu

Aug 18, 2025

Commits on Aug 14, 2025

CogView4: remove SiLU in final AdaLN (match Megatron); add switch to AdaLayerNormContinuous; split temb_raw/temb_blocks

武嘉涵
authored and
武嘉涵
committed

Commits on Aug 15, 2025

CogView4: remove SiLU in final AdaLN (match Megatron); add switch to AdaLayerNormContinuous; split temb_raw/temb_blocks

武嘉涵
authored and
武嘉涵
committed
CogView4: remove SiLU in final AdaLN (match Megatron); add switch to AdaLayerNormContinuous; split temb_raw/temb_blocks

武嘉涵
authored and
武嘉涵
committed
Merge remote-tracking branch 'upstream/main' into fix/adaln-remove-silu

武嘉涵
authored and
武嘉涵
committed
CogView4: use local final AdaLN (no SiLU) per review; keep generic AdaLN unchanged

武嘉涵
authored and
武嘉涵
committed
re-add configs as normal files (no LFS)

武嘉涵
authored and
武嘉涵
committed

Commits on Aug 16, 2025