Curator pip install: flash-attn build issue: ModuleNotFoundError: No module named 'torch'

[pablo-garay]

This is expected behavior for the OPTIONAL pip job!
The error ModuleNotFoundError: No module named 'torch' is the known flash-attn build issue:

• flash-attn's setup.py tries to import torch during build
• But pip can't install build-time dependencies first

pip job fails , while the required uv job passes (uv handles build deps via lockfile)

[ayushdg]

I don't think deduplication_cuda12 or text_cuda12 needs flash attn. From the uv.lock file it wasn't immediately clear to me where it comes from for those optionals.

@pablo-garay how are other libraries that depend on flash-attn working around this?

[pablo-garay]

ack

[pablo-garay]

Potential solution: install torch vefore flash attn