Skip to content

Store transpose attribute in Subgroup2DBlockIO layouts #4549

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 1 commit into
base: alex/use_subgroup_2d_block_encoding_pr
Choose a base branch
from
Draft

Store transpose attribute in Subgroup2DBlockIO layouts #4549

wants to merge 1 commit into from

Conversation

alexbaden
Copy link
Contributor

One of the primary goals of the Subgroup 2D Block IO encoding is to be able to convert to an accurate Linear Layout representation for data produced by Subgroup 2D Block IO instructions. To do this, we need to store transpose information in the layout as an attribute. The attribute tells us to swap the order of the height/width parameters in the layout definition when building the linear layout representation, in effect performing the post-load transpose in registers (this is consistent with the SPV intrinsic documentation, https://github.khronos.org/SPIRV-Registry/extensions/INTEL/SPV_INTEL_2d_block_io. The end result is we get a layout corresponding to the post-transpose loaded data in registers:

./build/cmake.linux-x86_64-cpython-3.10/bin/triton-tensor-layout -l "#ttig.subgroup_2d_block<{warpsPerCTA = [8, 4], instrShape = [32, 16], numBlocks = 1, isTransposed = true, order = [0, 1], kWidth = 2, threadsPerWarp = 16}>" -t "tensor<32x256xf16>" -use-hw-view

depends on #4500 / #4463

@alexbaden
Copy link
Contributor Author

tests: https://github.com/intel/intel-xpu-backend-for-triton/actions/runs/15782086302

@alexbaden alexbaden mentioned this pull request Jul 2, 2025
Draft
@etiotto etiotto marked this pull request as draft July 15, 2025 18:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@kurapov-peter kurapov-peter Awaiting requested review from kurapov-peter

@ienkovich ienkovich Awaiting requested review from ienkovich

@anmyachev anmyachev Awaiting requested review from anmyachev

@whitneywhtsang whitneywhtsang Awaiting requested review from whitneywhtsang

@etiotto etiotto Awaiting requested review from etiotto

@chengjunlu chengjunlu Awaiting requested review from chengjunlu

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@alexbaden