Skip to content

[Client] add MUSA support#41

Open
superleo wants to merge 6 commits intoalibaba:mainfrom
superleo:musa_support_dev
Open

[Client] add MUSA support#41
superleo wants to merge 6 commits intoalibaba:mainfrom
superleo:musa_support_dev

Conversation

@superleo
Copy link

@superleo superleo commented Mar 4, 2026

  • docs/develop/musa_gpu_support.md: design, architecture, build, testing
  • 3rdparty/gpus/test_cuda_regression.sh: verify CUDA not regressed
  • 3rdparty/gpus/test_musa_build.sh: validate MUSA build layout
  • 3rdparty/gpus/test_musa_python_compat.py: Python device abstraction

@CLAassistant
Copy link

CLAassistant commented Mar 4, 2026

CLA assistant check
All committers have signed the CLA.

@wangxiyu191 wangxiyu191 self-requested a review March 4, 2026 12:45
Copy link
Collaborator

@wangxiyu191 wangxiyu191 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

通过抽象出_device_mod和GpuStream等来实现兼容不同GPU运行环境的方式很合理。可以按照这个思路来实现MUSA兼容。

superleo added a commit to superleo/tair-kvcache that referenced this pull request Mar 9, 2026
@superleo superleo changed the title [MUSA PATCH 1/7] docs: add MUSA design doc and test scripts [docs] add MUSA design doc and test scripts Mar 9, 2026
@superleo superleo changed the title [docs] add MUSA design doc and test scripts [docs] add MUSA support design doc and test scripts Mar 9, 2026
superleo added a commit to superleo/tair-kvcache that referenced this pull request Mar 9, 2026
@superleo superleo force-pushed the musa_support_dev branch 2 times, most recently from ea6684e to c622e0c Compare March 9, 2026 07:59
superleo added 3 commits March 9, 2026 20:42
- docs/develop/musa_gpu_support.md: design, architecture, build, testing
- 3rdparty/gpus/test_cuda_regression.sh: verify CUDA not regressed
- 3rdparty/gpus/test_musa_build.sh: validate MUSA build layout
- 3rdparty/gpus/test_musa_python_compat.py: Python device abstraction
…device-agnostic connectors

- .bazelrc, WORKSPACE, 3rdparty/gpus/musa/: add MUSA toolchain and bazel config
  (build:musa, build:client_with_musa, musa_configure repository rule)
- client/sdk: MUSA SDK utils (musa_util.h, hf3fs_musa_util.h), buffer check
  (sdk_buffer_check_util_musa.{mu,cc}), and genrule for mcc compilation
- client/sdk: MUSA branches in local_file_sdk, transfer_client_impl, hf3fs_sdk,
  hf3fs_usrbio_client for stream/memcpy/host-register
- py_connector: device-agnostic GPU module (_get_device_module for cuda/musa),
  conditional tl.float8e4nv fallback in batch_gather_scatter_helper
@superleo superleo changed the title [docs] add MUSA support design doc and test scripts [Client] add MUSA support Mar 10, 2026
@superleo
Copy link
Author

Test Result:

  1. Cuda Regression:
image
  1. musa validation:
image
  1. python compatibility:
image
  1. client sdk
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants