Fix the Rotary Position Embedding (RoPE) parameter passing in the GLM5 mode#1650

Open

hanxdmech-ship-it wants to merge 1 commit intoTHUDM:mainfrom

hanxdmech-ship-it:fix_glm5_rotary_pos_emb

hanxdmech-ship-it commented Mar 2, 2026

Added: New variable packed_seq that evaluates whether packed_seq_params is not None and qkv_format equals 'thd'
Modified: Changed the parameter passed to rotary_pos_emb() method from packed_seq_params=packed_seq_params to
packed_seq=packed_seq


          fix glm5

52dc355

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet