[Proof of Concept] Multi-GPU prototype (single node)#89

Draft

efaulhaber wants to merge 8 commits intomainfrom

Commits on Jan 10, 2025

Add backend to use unified memory and multiple GPUs
efaulhaber
committed

Commits on Jan 17, 2025

Update on each GPU in device memory and then copy to unified memory
efaulhaber
committed

Commits on Jan 20, 2025

Add workaround for system atomics

efaulhaber
and
vchuravy
committed

Commits on Jan 22, 2025

Add semi-fast second and slower third approach
efaulhaber
committed

Commits on Jan 24, 2025

Define custom type to make broadcasting fast
efaulhaber
committed

Commits on Jan 29, 2025

Merge branch 'main' into ef/multi-gpu
efaulhaber
committed

Commits on Jan 30, 2025

Implement `MultiGPUArray`
efaulhaber
committed

Commits on Jan 31, 2025

Make all approaches work
efaulhaber
committed