Skip to content

Commit 874ee6c

Browse files
amolnar-rhamolnar-rh
committed
TELCODOCS-781: Factory precaching cli tool ZTP integration
1 parent 0665834 commit 874ee6c

File tree

4 files changed

+240
-4
lines changed

4 files changed

+240
-4
lines changed

‎modules/ztp-precaching-downloading-artifacts.adoc

Lines changed: 21 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,24 @@ The {factory-prestaging-tool} allows you to download the following images to you
1717
The list of available Operator images can vary in different {product-title} releases.
1818
====
1919

20+
[id="ztp-downloading-images-parallel-workers_{context}"]
21+
== Downloading with parallel workers
22+
23+
The {factory-prestaging-tool} uses parallel workers to download multiple images simultaneously.
24+
You can configure the number of workers with the `--parallel` or `-p` option.
25+
The default number is set to 80% of the available CPUs to the server.
26+
27+
[NOTE]
28+
====
29+
Your login shell may be restricted to a subset of CPUs, which reduces the CPUs available to the container.
30+
To remove this restriction, you can precede your commands with `taskset 0xffffffff`, for example:
31+
32+
[source,terminal]
33+
----
34+
# taskset 0xffffffff podman run --rm quay.io/openshift-kni/telco-ran-tools:latest factory-precaching-cli download --help
35+
----
36+
====
37+
2038
[id="ztp-preparing-ocp-images_{context}"]
2139
== Preparing to download the {product-title} images
2240

@@ -109,7 +127,7 @@ The {factory-prestaging-tool} allows you to pre-cache all the container images r
109127
<3> Defines the {rh-rhacm} version.
110128
<4> Defines the MCE version.
111129
<5> Defines the folder where you want to download the images on the disk.
112-
<6> Defines the repository where you store your additional images. These images are downloaded and pre-cached on the disk.
130+
<6> Optional. Defines the repository where you store your additional images. These images are downloaded and pre-cached on the disk.
113131

114132
+
115133
.Example output
@@ -199,7 +217,7 @@ You need to include the {rh-rhacm} hub and MCE Operator versions by using the `-
199217
<3> Defines the {rh-rhacm} version.
200218
<4> Defines the MCE version.
201219
<5> Defines the folder where you want to download the images on the disk.
202-
<6> Defines the repository where you store your additional images. These images are downloaded and pre-cached on the disk.
220+
<6> Optional. Defines the repository where you store your additional images. These images are downloaded and pre-cached on the disk.
203221
<7> Specifies pre-caching the Operators included in the DU configuration.
204222

205223
+
@@ -372,7 +390,7 @@ factory-precaching-cli download \ <1>
372390
<3> Defines the {rh-rhacm} version.
373391
<4> Defines the MCE version.
374392
<5> Defines the folder where you want to download the images on the disk.
375-
<6> Defines the repository where you store your additional images. These images are downloaded and pre-cached on the disk.
393+
<6> Optional. Defines the repository where you store your additional images. These images are downloaded and pre-cached on the disk.
376394
<7> Specifies pre-caching the Operators included in the DU configuration.
377395
<8> The `--skip-imageset` argument allows you to download the images that you specified in your customized `ImageSetConfiguration` CR.
378396

‎modules/ztp-precaching-troubleshooting.adoc

Lines changed: 62 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
// Module included in the following assemblies:
2+
//
3+
// * scalability_and_performance/ztp_far_edge/ztp-pre-staging-tool.adoc
4+
5+
:_module-type: PROCEDURE
6+
[id="ztp-pre-staging-troubleshooting_{context}"]
7+
= Troubleshooting
8+
9+
== Rendered catalog is invalid
10+
11+
When you download images by using a local or disconnected registry, you might see the `The rendered catalog is invalid` error. This means that you are missing certificates of the new registry you want to pull content from.
12+
13+
[NOTE]
14+
====
15+
The {factory-prestaging-tool} image is built on a UBI {op-system-base} image. Certificate paths and locations are the same on {op-system}.
16+
====
17+
18+
.Example error
19+
[source,terminal]
20+
----
21+
Generating list of pre-cached artifacts...
22+
error: unable to run command oc-mirror -c /mnt/imageset.yaml file:///tmp/fp-cli-3218002584/mirror --ignore-history --dry-run: Creating directory: /tmp/fp-cli-3218002584/mirror/oc-mirror-workspace/src/publish
23+
Creating directory: /tmp/fp-cli-3218002584/mirror/oc-mirror-workspace/src/v2
24+
Creating directory: /tmp/fp-cli-3218002584/mirror/oc-mirror-workspace/src/charts
25+
Creating directory: /tmp/fp-cli-3218002584/mirror/oc-mirror-workspace/src/release-signatures
26+
backend is not configured in /mnt/imageset.yaml, using stateless mode
27+
backend is not configured in /mnt/imageset.yaml, using stateless mode
28+
No metadata detected, creating new workspace
29+
level=info msg=trying next host error=failed to do request: Head "https://eko4.cloud.lab.eng.bos.redhat.com:8443/v2/redhat/redhat-operator-index/manifests/v4.11": x509: certificate signed by unknown authority host=eko4.cloud.lab.eng.bos.redhat.com:8443
30+
31+
The rendered catalog is invalid.
32+
33+
Run "oc-mirror list operators --catalog CATALOG-NAME --package PACKAGE-NAME" for more information.
34+
35+
error: error rendering new refs: render reference "eko4.cloud.lab.eng.bos.redhat.com:8443/redhat/redhat-operator-index:v4.11": error resolving name : failed to do request: Head "https://eko4.cloud.lab.eng.bos.redhat.com:8443/v2/redhat/redhat-operator-index/manifests/v4.11": x509: certificate signed by unknown authority
36+
----
37+
38+
.Procedure
39+
40+
. Copy the registry certificate into your server:
41+
+
42+
[source,terminal]
43+
----
44+
# cp /tmp/eko4-ca.crt /etc/pki/ca-trust/source/anchors/.
45+
----
46+
47+
. Update the certificates trust store:
48+
+
49+
[source,terminal]
50+
----
51+
# update-ca-trust
52+
----
53+
54+
. Mount the host `/etc/pki` folder into the factory-cli image:
55+
+
56+
[source,terminal]
57+
----
58+
# podman run -v /mnt:/mnt -v /root/.docker:/root/.docker -v /etc/pki:/etc/pki --privileged -it --rm quay.io/openshift-kni/telco-ran-tools:latest -- \
59+
factory-precaching-cli download -r 4.11.5 --acm-version 2.5.4 \
60+
--mce-version 2.0.4 -f /mnt \--img quay.io/custom/repository
61+
--du-profile -s --skip-imageset
62+
----

‎modules/ztp-precaching-ztp-config.adoc

Lines changed: 152 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,152 @@
1+
// Module included in the following assemblies:
2+
//
3+
// * scalability_and_performance/ztp_far_edge/ztp-pre-staging-tool.adoc
4+
5+
:_module-type: CONCEPT
6+
[id="ztp-pre-caching-config-con_{context}"]
7+
= Pre-caching images in ZTP
8+
9+
The `SiteConfig` manifest defines how an OpenShift cluster is to be installed and configured.
10+
In the ZTP provisioning workflow, the {factory-prestaging-tool} requires the following additional fields in the `SiteConfig` manifest:
11+
12+
* `clusters.ignitionConfigOverride`
13+
* `nodes.installerArgs`
14+
* `nodes.ignitionConfigOverride`
15+
16+
.Example SiteConfig with additional fields
17+
[source,yaml]
18+
----
19+
apiVersion: ran.openshift.io/v1
20+
kind: SiteConfig
21+
metadata:
22+
name: "example-5g-lab"
23+
namespace: "example-5g-lab"
24+
spec:
25+
baseDomain: "example.domain.redhat.com"
26+
pullSecretRef:
27+
name: "assisted-deployment-pull-secret"
28+
clusterImageSetNameRef: "img4.9.10-x86-64-appsub"
29+
sshPublicKey: "ssh-rsa ..."
30+
clusters:
31+
- clusterName: "sno-worker-0"
32+
clusterImageSetNameRef: "eko4-img4.11.5-x86-64-appsub"
33+
clusterLabels:
34+
group-du-sno: ""
35+
common-411: true
36+
sites : "example-5g-lab"
37+
vendor: "OpenShift"
38+
clusterNetwork:
39+
- cidr: 10.128.0.0/14
40+
hostPrefix: 23
41+
machineNetwork:
42+
- cidr: 10.19.32.192/26
43+
serviceNetwork:
44+
- 172.30.0.0/16
45+
networkType: "OVNKubernetes"
46+
additionalNTPSources:
47+
- clock.corp.redhat.com
48+
ignitionConfigOverride: '{"ignition":{"version":"3.1.0"},"systemd":{"units":[{"name":"var-mnt.mount","enabled":true,"contents":"[Unit]\nDescription=Mount partition with artifacts\nBefore=precache-images.service\nBindsTo=precache-images.service\nStopWhenUnneeded=true\n\n[Mount]\nWhat=/dev/disk/by-partlabel/data\nWhere=/var/mnt\nType=xfs\nTimeoutSec=30\n\n[Install]\nRequiredBy=precache-images.service"},{"name":"precache-images.service","enabled":true,"contents":"[Unit]\nDescription=Extracts the precached images in discovery stage\nAfter=var-mnt.mount\nBefore=agent.service\n\n[Service]\nType=oneshot\nUser=root\nWorkingDirectory=/var/mnt\nExecStart=bash /usr/local/bin/extract-ai.sh\n#TimeoutStopSec=30\n\n[Install]\nWantedBy=multi-user.target default.target\nWantedBy=agent.service"}]},"storage":{"files":[{"overwrite":true,"path":"/usr/local/bin/extract-ai.sh","mode":755,"user":{"name":"root"},"contents":{"source":"data:,%23%21%2Fbin%2Fbash%0A%0AFOLDER%3D%22%24%7BFOLDER%3A-%24%28pwd%29%7D%22%0AOCP_RELEASE_LIST%3D%22%24%7BOCP_RELEASE_LIST%3A-ai-images.txt%7D%22%0ABINARY_FOLDER%3D%2Fvar%2Fmnt%0A%0Apushd%20%24FOLDER%0A%0Atotal_copies%3D%24%28sort%20-u%20%24BINARY_FOLDER%2F%24OCP_RELEASE_LIST%20%7C%20wc%20-l%29%20%20%23%20Required%20to%20keep%20track%20of%20the%20pull%20task%20vs%20total%0Acurrent_copy%3D1%0A%0Awhile%20read%20-r%20line%3B%0Ado%0A%20%20uri%3D%24%28echo%20%22%24line%22%20%7C%20awk%20%27%7Bprint%241%7D%27%29%0A%20%20%23tar%3D%24%28echo%20%22%24line%22%20%7C%20awk%20%27%7Bprint%242%7D%27%29%0A%20%20podman%20image%20exists%20%24uri%0A%20%20if%20%5B%5B%20%24%3F%20-eq%200%20%5D%5D%3B%20then%0A%20%20%20%20%20%20echo%20%22Skipping%20existing%20image%20%24tar%22%0A%20%20%20%20%20%20echo%20%22Copying%20%24%7Buri%7D%20%5B%24%7Bcurrent_copy%7D%2F%24%7Btotal_copies%7D%5D%22%0A%20%20%20%20%20%20current_copy%3D%24%28%28current_copy%20%2B%201%29%29%0A%20%20%20%20%20%20continue%0A%20%20fi%0A%20%20tar%3D%24%28echo%20%22%24uri%22%20%7C%20%20rev%20%7C%20cut%20-d%20%22%2F%22%20-f1%20%7C%20rev%20%7C%20tr%20%22%3A%22%20%22_%22%29%0A%20%20tar%20zxvf%20%24%7Btar%7D.tgz%0A%20%20if%20%5B%20%24%3F%20-eq%200%20%5D%3B%20then%20rm%20-f%20%24%7Btar%7D.gz%3B%20fi%0A%20%20echo%20%22Copying%20%24%7Buri%7D%20%5B%24%7Bcurrent_copy%7D%2F%24%7Btotal_copies%7D%5D%22%0A%20%20skopeo%20copy%20dir%3A%2F%2F%24%28pwd%29%2F%24%7Btar%7D%20containers-storage%3A%24%7Buri%7D%0A%20%20if%20%5B%20%24%3F%20-eq%200%20%5D%3B%20then%20rm%20-rf%20%24%7Btar%7D%3B%20current_copy%3D%24%28%28current_copy%20%2B%201%29%29%3B%20fi%0Adone%20%3C%20%24%7BBINARY_FOLDER%7D%2F%24%7BOCP_RELEASE_LIST%7D%0A%0A%23%20workaround%20while%20https%3A%2F%2Fgithub.com%2Fopenshift%2Fassisted-service%2Fpull%2F3546%0A%23cp%20%2Fvar%2Fmnt%2Fmodified-rhcos-4.10.3-x86_64-metal.x86_64.raw.gz%20%2Fvar%2Ftmp%2F.%0A%0Aexit%200"}},{"overwrite":true,"path":"/usr/local/bin/agent-fix-bz1964591","mode":755,"user":{"name":"root"},"contents":{"source":"data:,%23%21%2Fusr%2Fbin%2Fsh%0A%0A%23%20This%20script%20is%20a%20workaround%20for%20bugzilla%201964591%20where%20symlinks%20inside%20%2Fvar%2Flib%2Fcontainers%2F%20get%0A%23%20corrupted%20under%20some%20circumstances.%0A%23%0A%23%20In%20order%20to%20let%20agent.service%20start%20correctly%20we%20are%20checking%20here%20whether%20the%20requested%0A%23%20container%20image%20exists%20and%20in%20case%20%22podman%20images%22%20returns%20an%20error%20we%20try%20removing%20the%20faulty%0A%23%20image.%0A%23%0A%23%20In%20such%20a%20scenario%20agent.service%20will%20detect%20the%20image%20is%20not%20present%20and%20pull%20it%20again.%20In%20case%0A%23%20the%20image%20is%20present%20and%20can%20be%20detected%20correctly%2C%20no%20any%20action%20is%20required.%0A%0AIMAGE%3D%24%28echo%20%241%20%7C%20sed%20%27s%2F%3A.%2A%2F%2F%27%29%0Apodman%20image%20exists%20%24IMAGE%20%7C%7C%20echo%20%22already%20loaded%22%20%7C%7C%20echo%20%22need%20to%20be%20pulled%22%0A%23podman%20images%20%7C%20grep%20%24IMAGE%20%7C%7C%20podman%20rmi%20--force%20%241%20%7C%7C%20true"}}]}}'
49+
nodes:
50+
- hostName: "snonode.sno-worker-0.example.domain.redhat.com"
51+
role: "master"
52+
bmcAddress: "idrac-virtualmedia+https://10.19.28.53/redfish/v1/Systems/System.Embedded.1"
53+
bmcCredentialsName:
54+
name: "worker0-bmh-secret"
55+
bootMACAddress: "e4:43:4b:bd:90:46"
56+
bootMode: "UEFI"
57+
rootDeviceHints:
58+
deviceName: /dev/nvme0n1
59+
cpuset: "0-1,40-41"
60+
installerArgs: '["--save-partlabel", "data"]'
61+
ignitionConfigOverride: '{"ignition":{"version":"3.1.0"},"systemd":{"units":[{"name":"var-mnt.mount","enabled":true,"contents":"[Unit]\nDescription=Mount partition with artifacts\nBefore=precache-ocp-images.service\nBindsTo=precache-ocp-images.service\nStopWhenUnneeded=true\n\n[Mount]\nWhat=/dev/disk/by-partlabel/data\nWhere=/var/mnt\nType=xfs\nTimeoutSec=30\n\n[Install]\nRequiredBy=precache-ocp-images.service"},{"name":"precache-ocp-images.service","enabled":true,"contents":"[Unit]\nDescription=Extracts the precached OCP images into containers storage\nAfter=var-mnt.mount\nBefore=machine-config-daemon-pull.service nodeip-configuration.service\n\n[Service]\nType=oneshot\nUser=root\nWorkingDirectory=/var/mnt\nExecStart=bash /usr/local/bin/extract-ocp.sh\nTimeoutStopSec=60\n\n[Install]\nWantedBy=multi-user.target"}]},"storage":{"files":[{"overwrite":true,"path":"/usr/local/bin/extract-ocp.sh","mode":755,"user":{"name":"root"},"contents":{"source":"data:,%23%21%2Fbin%2Fbash%0A%0AFOLDER%3D%22%24%7BFOLDER%3A-%24%28pwd%29%7D%22%0AOCP_RELEASE_LIST%3D%22%24%7BOCP_RELEASE_LIST%3A-ocp-images.txt%7D%22%0ABINARY_FOLDER%3D%2Fvar%2Fmnt%0A%0Apushd%20%24FOLDER%0A%0Atotal_copies%3D%24%28sort%20-u%20%24BINARY_FOLDER%2F%24OCP_RELEASE_LIST%20%7C%20wc%20-l%29%20%20%23%20Required%20to%20keep%20track%20of%20the%20pull%20task%20vs%20total%0Acurrent_copy%3D1%0A%0Awhile%20read%20-r%20line%3B%0Ado%0A%20%20uri%3D%24%28echo%20%22%24line%22%20%7C%20awk%20%27%7Bprint%241%7D%27%29%0A%20%20%23tar%3D%24%28echo%20%22%24line%22%20%7C%20awk%20%27%7Bprint%242%7D%27%29%0A%20%20podman%20image%20exists%20%24uri%0A%20%20if%20%5B%5B%20%24%3F%20-eq%200%20%5D%5D%3B%20then%0A%20%20%20%20%20%20echo%20%22Skipping%20existing%20image%20%24tar%22%0A%20%20%20%20%20%20echo%20%22Copying%20%24%7Buri%7D%20%5B%24%7Bcurrent_copy%7D%2F%24%7Btotal_copies%7D%5D%22%0A%20%20%20%20%20%20current_copy%3D%24%28%28current_copy%20%2B%201%29%29%0A%20%20%20%20%20%20continue%0A%20%20fi%0A%20%20tar%3D%24%28echo%20%22%24uri%22%20%7C%20%20rev%20%7C%20cut%20-d%20%22%2F%22%20-f1%20%7C%20rev%20%7C%20tr%20%22%3A%22%20%22_%22%29%0A%20%20tar%20zxvf%20%24%7Btar%7D.tgz%0A%20%20if%20%5B%20%24%3F%20-eq%200%20%5D%3B%20then%20rm%20-f%20%24%7Btar%7D.gz%3B%20fi%0A%20%20echo%20%22Copying%20%24%7Buri%7D%20%5B%24%7Bcurrent_copy%7D%2F%24%7Btotal_copies%7D%5D%22%0A%20%20skopeo%20copy%20dir%3A%2F%2F%24%28pwd%29%2F%24%7Btar%7D%20containers-storage%3A%24%7Buri%7D%0A%20%20if%20%5B%20%24%3F%20-eq%200%20%5D%3B%20then%20rm%20-rf%20%24%7Btar%7D%3B%20current_copy%3D%24%28%28current_copy%20%2B%201%29%29%3B%20fi%0Adone%20%3C%20%24%7BBINARY_FOLDER%7D%2F%24%7BOCP_RELEASE_LIST%7D%0A%0Aexit%200"}}]}}'
62+
nodeNetwork:
63+
config:
64+
interfaces:
65+
- name: ens1f0
66+
type: ethernet
67+
state: up
68+
macAddress: "AA:BB:CC:11:22:33"
69+
ipv4:
70+
enabled: true
71+
dhcp: true
72+
ipv6:
73+
enabled: false
74+
interfaces:
75+
- name: "ens1f0"
76+
macAddress: "AA:BB:CC:11:22:33"
77+
----
78+
79+
[id="ztp-pre-caching-config-clusters-ignitionconfigoverride_{context}"]
80+
== Understanding the clusters.ignitionConfigOverride field
81+
82+
The `clusters.ignitionConfigOverride` field adds a configuration in Ignition format during the ZTP discovery stage.
83+
The configuration includes `systemd` services in the ISO mounted in virtual media. This way, the scripts are part of the discovery {op-system} live ISO and they can be used to load the Assisted Installer (AI) images.
84+
85+
`systemd` services:: The `systemd` services are `var-mnt.mount` and `precache-images.services`. The `precache-images.service` depends on the disk partition to be mounted in `/var/mnt` by the `var-mnt.mount` unit.
86+
The service calls a script called `extract-ai.sh`.
87+
`extract-ai.sh`:: The `extract-ai.sh` script extracts and loads the required images from the disk partition to the local container storage.
88+
When the script finishes successfully, you can use the images locally.
89+
`agent-fix-bz1964591`:: The `agent-fix-bz1964591` script is a workaround for an AI issue.
90+
To prevent AI from removing the images, which can force the `agent.service` to pull the images again from the registry, the `agent-fix-bz1964591` script checks if the requested container images exist.
91+
92+
[id="ztp-pre-caching-config-nodes-installerargs_{context}"]
93+
== Understanding the nodes.installerArgs field
94+
95+
The `nodes.installerArgs` field allows you to configure how the `coreos-installer` utility writes the {op-system} live ISO to disk. You need to indicate to save the disk partition labeled as `data` because the artifacts saved in the `data` partition are needed during the {product-title} installation stage.
96+
97+
The extra parameters are passed directly to the `coreos-installer` utility that writes the live {op-system} to disk.
98+
On the next reboot, the operating system starts from the disk.
99+
100+
You can pass several options to the `coreos-installer` utility:
101+
102+
[source,terminal]
103+
----
104+
OPTIONS:
105+
...
106+
-u, --image-url <URL>
107+
Manually specify the image URL
108+
109+
-f, --image-file <path>
110+
Manually specify a local image file
111+
112+
-i, --ignition-file <path>
113+
Embed an Ignition config from a file
114+
115+
-I, --ignition-url <URL>
116+
Embed an Ignition config from a URL
117+
...
118+
--save-partlabel <lx>...
119+
Save partitions with this label glob
120+
121+
--save-partindex <id>...
122+
Save partitions with this number or range
123+
...
124+
--insecure-ignition
125+
Allow Ignition URL without HTTPS or hash
126+
----
127+
128+
[id="ztp-pre-caching-config-nodes-ignitionconfigoverride_{context}"]
129+
== Understanding the nodes.ignitionConfigOverride field
130+
131+
Similarly to `clusters.ignitionConfigOverride`, the `nodes.ignitionConfigOverride` field allows the addtion of configurations in Ignition format to the `coreos-installer` utility, but at the {product-title} installation stage.
132+
When the {op-system} is written to disk, the extra configuration included in the ZTP discovery ISO is no longer available. During the discovery stage, the extra configuration is stored in the memory of the live OS.
133+
134+
[NOTE]
135+
====
136+
At this stage, the number of container images extracted and loaded is bigger than in the discovery stage. Depending on the {product-title} release and whether you install the Day-2 Operators, the installation time can vary.
137+
====
138+
139+
At the installation stage, the `var-mnt.mount` and `precache-ocp.services` `systemd` services are used.
140+
141+
`precache-ocp.service`:: The `precache-ocp.service` depends on the disk partition to be mounted in `/var/mnt` by the `var-mnt.mount` unit.
142+
The `precache-ocp.service` service calls a script called `extract-ocp.sh`.
143+
+
144+
[IMPORTANT]
145+
====
146+
To extract all the images before the {product-title} installation, you must execute `precache-ocp.service` before executing the `machine-config-daemon-pull.service` and `nodeip-configuration.service` services.
147+
====
148+
149+
`extract-ocp.sh`:: The `extract-ocp.sh` script extracts and loads the required images from the disk partition to the local container storage.
150+
When the script finishes successfully, you can use the images locally.
151+
152+
When you upload the `SiteConfig` and the optional `PolicyGenTemplates` custom resources (CRs) to the Git repo, which Argo CD is monitoring, you can start the ZTP workflow by syncing the CRs with the hub cluster.

‎scalability_and_performance/ztp_far_edge/ztp-precaching-tool.adoc

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -45,4 +45,8 @@ include::modules/ztp-precaching-downloading-artifacts.adoc[leveloffset=+1]
4545

4646
* To access the online Red Hat registries, see link:https://console.redhat.com/openshift/downloads#tool-pull-secret[OpenShift installation customization tools].
4747
48-
* For more information about using the multicluster engine, see link:https://access.redhat.com/documentation/en-us/red_hat_advanced_cluster_management_for_kubernetes/2.6/html/multicluster_engine/multicluster_engine_overview#mce-intro[About the multicluster engine for Kubernetes operator].
48+
* For more information about using the multicluster engine, see link:https://access.redhat.com/documentation/en-us/red_hat_advanced_cluster_management_for_kubernetes/2.6/html/multicluster_engine/multicluster_engine_overview#mce-intro[About the multicluster engine for Kubernetes operator].
49+
50+
include::modules/ztp-precaching-ztp-config.adoc[leveloffset=+1]
51+
52+
include::modules/ztp-precaching-troubleshooting.adoc[leveloffset=+1]

0 commit comments

Comments
 (0)