Skip to content

Conversation

@sdvillal
Copy link

@sdvillal sdvillal commented Jan 5, 2026

EvoformerAttnBuilder has some problems which preclude compiling the extension on several scenarios and break othewise standard DeepSpeed configuration of target capabilities.

Changes

  • Fix evoformer compilation with no GPU is present (50e371a)
    • this is taken care correctly and more generally by builder.compute_capability_args
    • allow for cross-compilation in systems without GPU
    • allows for compilation against all available virtual architectures and binary outputs
    • see e.g., [REQUEST] build prebuilt wheels #5308

TODO

  • Fix evoformer CUTLASS detection (allow to skip it, fix broken use of deprecated nvidia-cutlass, fix broken version comparison, document)

- this is taken care correctly and more generally by builder.compute_capability_args
- allow for cross-compilation in systems without GPU (see e.g., deepspeedai#5308)

Signed-off-by: Santi Villalba <[email protected]>
@sdvillal sdvillal force-pushed the improve-evoformer-compilation branch from 50e371a to 643cac1 Compare January 5, 2026 10:29
@sdvillal sdvillal changed the title Fix Evoformer compilation when no GPU is present Fix Evoformer compilation Jan 5, 2026
@sdvillal sdvillal force-pushed the improve-evoformer-compilation branch from 0fd060b to 1e71bdb Compare January 5, 2026 11:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant