Skip to content

Commit ef01d3b

Browse files
Add RPC server support for distributed inference (#55)
* Enable RPC-Server * Update .github/workflows/build-llamacpp-rocm.yml
1 parent f40a8fa commit ef01d3b

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

.github/workflows/build-llamacpp-rocm.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -312,6 +312,7 @@ jobs:
312312
-DGGML_HIP=ON ^
313313
-DGGML_OPENMP=OFF ^
314314
-DGGML_CUDA_FORCE_CUBLAS=OFF ^
315+
-DGGML_RPC=ON ^
315316
-DGGML_HIP_ROCWMMA_FATTN=OFF ^
316317
-DLLAMA_CURL=OFF ^
317318
-DGGML_NATIVE=OFF ^
@@ -720,6 +721,7 @@ jobs:
720721
-DGGML_HIP=ON \
721722
-DGGML_OPENMP=OFF \
722723
-DGGML_CUDA_FORCE_CUBLAS=OFF \
724+
-DGGML_RPC=ON \
723725
-DGGML_HIP_ROCWMMA_FATTN=OFF \
724726
-DLLAMA_CURL=OFF \
725727
-DGGML_NATIVE=OFF \

0 commit comments

Comments
 (0)