introduce CudaGuard and cudastreamguard #14876
Conversation
Differential Revision: D84122729
Summary: ### Introduce CudaGuard and CudaStreamGuard This diff introduces `CudaGuard` and `CudaStreamGuard` in the Executorch CUDA runtime. These classes provide a convenient way to manage CUDA device and stream selection. #### Changes * Added `CudaGuard` and `CudaStreamGuard` classes in `fbcode/executorch/backends/cuda/runtime/guard.h`. * Implemented `CudaGuard` and `CudaStreamGuard` in `fbcode/executorch/backends/cuda/runtime/guard.cpp`. * Added unit tests for `CudaStreamGuard` in `fbcode/executorch/backends/cuda/runtime/tests/test_cuda_stream_guard.cpp`. * Updated `TARGETS` file to include the new files. #### Purpose The `CudaGuard` class provides a way to select a CUDA device and ensure that it is properly released when the guard goes out of scope. The `CudaStreamGuard` class provides a way to select a CUDA stream and ensure that it is properly synchronized when the guard goes out of scope. #### Usage They will be further used and controled by their shim layer functions. Differential Revision: D84126481
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14876
Note: Links to docs will display an error until the docs builds have been completed. ❗ 1 Active SEVsThere are 1 currently active SEVs. If your PR is affected, please view them below: ⏳ No Failures, 113 PendingAs of commit 681c859 with merge base bba9d26 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
meta-cla
bot
added
the
CLA Signed
This PR needs a
|
1 participant
Summary:
Introduce CudaGuard and CudaStreamGuard
This diff introduces
CudaGuardandCudaStreamGuardin the Executorch CUDA runtime. These classes provide a convenient way to manage CUDA device and stream selection.Changes
CudaGuardandCudaStreamGuardclasses infbcode/executorch/backends/cuda/runtime/guard.h.CudaGuardandCudaStreamGuardinfbcode/executorch/backends/cuda/runtime/guard.cpp.CudaStreamGuardinfbcode/executorch/backends/cuda/runtime/tests/test_cuda_stream_guard.cpp.TARGETSfile to include the new files.Purpose
The
CudaGuardclass provides a way to select a CUDA device and ensure that it is properly released when the guard goes out of scope. TheCudaStreamGuardclass provides a way to select a CUDA stream and ensure that it is properly synchronized when the guard goes out of scope.Usage
They will be further used and controled by their shim layer functions.
Differential Revision: D84126481