[QST] How to stop unroll in cute.copy in cute dsl?

[monellz]

What is your question?
cute.copy will always fully unroll its inner load/store. But in some case, the unrolling in cute.copy will case serious register spill. So I wonder how to stop unroll in cute.copy elegantly, instead of just manullay copy?

[fengxie]

What is your question? cute.copy will always fully unroll its inner load/store. But in some case, the unrolling in cute.copy will case serious register spill. So I wonder how to stop unroll in cute.copy elegantly, instead of just manullay copy?

@brandon-yujie-sun

[brandon-yujie-sun]

Thanks for the question. cute.copy today fully unrolls when the inner loop size is static. There are probably several options:

1. to avoid serious register spill, you'd probably tweak the atom size for the copy
2. you can also probably try out cute.copy_atom_call with your customized for loop with cutlass.range to control the unrolling behavior yourself.

Please let us know how this would help and we would discuss and plan more examples in future release for 2.

[brandon-yujie-sun]

cc @vickiw973

[monellz]

Thanks a lot! The cute.copy_atom_call seems what I want and I will try it.

[fengxie]

@brandon-yujie-sun it might be useful to add unrolling control to API for copy & gemm?

[brandon-yujie-sun]

Yes, that's a good idea. Will follow up on that.

[github-actions]

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.