Skip to content

Latest commit

 

History

History
46 lines (35 loc) · 1.12 KB

File metadata and controls

46 lines (35 loc) · 1.12 KB

ozone-AI

Starting Ozone Docker with UCX capability over Mac

Docker creation and running

UCX native library is required for UCX env to communicate

  1. Build docker image with the Dockerfile

    docker build -t ucx-mac-rdma .

  2. configure .env in compose/ozone (hadoop-ozone/dist/target/compose/ozone/.env) OR other varition of docker compose .env

    OZONE_RUNNER_VERSION=latest
    OZONE_RUNNER_IMAGE=ucx-mac-rdma
    
  3. Start docker env via compose

Java dependency

For compile UCX support client server, need below pom depenency,

    <dependency>
      <groupId>org.openucx</groupId>
      <artifactId>jucx</artifactId>
      <version>1.19.1</version>
    </dependency>

For Mac runtime, needed below aarch version java jar:

<dependency>
      <groupId>org.openucx</groupId>
      <artifactId>jucx</artifactId>
      <version>1.19.1-aarch64</version>
</dependency>

env varialbe to choose UCX over same machine docker

export UCX_NET_DEVICES=lo  // using lo as loopback NIC
export UCX_TLS=sm,tcp,self  // choice of protocol
export UCX_MAX_RNDV_RAILS=1  // limit number of network to 1