Skip to content

silu_and_mul: qwen2.5-vl VIT intermediate_size=3420, but vec_size in flashinfer is allways 16 #2526

Open
#5013
#2613
Open
silu_and_mul: qwen2.5-vl VIT intermediate_size=3420, but vec_size in flashinfer is allways 16#2526
#5013
#2613
Labels
bugSomething isn't workingop: miscnorm, activation, sampling, RoPE, quantization, etc.priority: should have (P1)

Description

@CrimsonDump
CrimsonDump
opened on Feb 9, 2026

reproduce by replace dim with 3420

flashinfer/tests/utils/test_activation.py

Line 40 in f84ac1c

@pytest.mark.parametrize("dim", [128, 256, 512, 2048, 4096, 11008, 16384])

Also you can refer to:
https://github.com/alibaba/rtp-llm/blob/main/3rdparty/flashinfer/0010-silu-mul-vec-size.patch

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingop: miscnorm, activation, sampling, RoPE, quantization, etc.priority: should have (P1)

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions