Support variable-length sequences for mamba block with position indices#434

Open

ptxu78 wants to merge 4 commits intostate-spaces:mainfrom

ptxu78:feat/pack_with_position_indices

Commits on Jun 16, 2024

Support position-index at the SSM operator level, enabling SSM operations on packed data without interference between token sequences.
ptxu78
committed

Commits on Jun 21, 2024

Updated a test case, test_mamba_cu_seqlens_equivalence.py, for end-to-end pack experiments with the mamba block. Added support for position_indices in conv1d within mamba_inner_fn. The conv1d code …
ptxu78
committed

Commits on Jun 25, 2024

update test
ptxu78
committed

Commits on Jul 1, 2024

update setup.py
ptxu78
committed