Skip to content

Commit 45a55ea

Browse files
Merge pull request #1749 from jasonrandrews/review
Reviewing Ollama on GKE
2 parents 120c7c4 + fa8322c commit 45a55ea

File tree

2 files changed

+7
-7
lines changed

2 files changed

+7
-7
lines changed

content/learning-paths/servers-and-cloud-computing/multiarch_ollama_on_gke/0-spin_up_gke_cluster.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -6,19 +6,19 @@ weight: 2
66
layout: learningpathall
77
---
88

9-
## Overview
9+
## Project overview
1010

1111
Arm CPUs are widely used in traditional AI/ML use cases. In this Learning Path, you learn how to run [Ollama](https://ollama.com/) on Arm-based CPUs in a hybrid architecture (amd64 and arm64) K8s cluster.
1212

13-
To demonstrate this as a real life scenario, you're going to bring up an initial Kubernetes cluster (depicted as "*1. Inital Cluster (amd64)*" in the image below) with an amd64 node running an Ollama Deployment and Service.
13+
To demonstrate this, you can bring up an initial Kubernetes cluster (depicted as "*1. Initial Cluster (amd64)*" in the image below) with an amd64 node running an Ollama Deployment and Service.
1414

1515
Next, as depicted by "*2. Hybrid Cluster amd64/arm64*", you'll add the arm64 node, and apply an arm64 Deployment and Service to it, so that you can now test both architectures together, and separately, to investigate performance.
1616

17-
When satisfied with the arm64 performance over amd64, its easy to delete the amd64-specific node, deployment, and service, to complete the migration, as depicted in "*3. Migrated Cluster (arm64)*".
17+
When you are satisfied with the arm64 performance over amd64, its easy to delete the amd64-specific node, deployment, and service, to complete the migration, as depicted in "*3. Migrated Cluster (arm64)*".
1818

1919
![Project Overview](images/general_flow.png)
2020

21-
Once you've seen how easy it is to add an arm64 to an existing cluster, you can apply the knowledge to experiment with the value arm64 brings to other workloads in your environment as you see fit.
21+
Once you've seen how easy it is to add arm64 nodes to an existing cluster, you can apply the knowledge to experiment with arm64 nodes on other workloads in your environment.
2222

2323
### Create the cluster
2424

@@ -36,7 +36,7 @@ The *Cluster basics* tab appears.
3636
![Select and Configure Cluster Type](images/cluster_basics.png)
3737

3838
{{% notice Note %}}
39-
Although this will work in all regions and zones where C4 and C4a instance types are supported, for this demo, we use *us-central1* and *us-central1-1a* regions and zones. In addition, with simplicity and cost savings in mind, only one node per architecture is used.
39+
Although this will work in all regions and zones where C4 and C4a instance types are supported, the `us-central1` and `us-central1-1a` regions and zones are used. For simplicity and cost savings, only one node per architecture is used.
4040
{{% /notice %}}
4141

4242
5. Click on *NODE POOLS*->*default-pool*
@@ -52,7 +52,7 @@ Although this will work in all regions and zones where C4 and C4a instance types
5252
10. For *Machine Type*, select *c4-standard-4*
5353

5454
{{% notice Note %}}
55-
We've chosen node types that will support one pod per node. If you wish to run multiple pods per mode, assume each node should provide ~10GB per pod.
55+
The chosen node types support only one pod per node. If you wish to run multiple pods per node, assume each node should provide about 10GB memory per pod.
5656
{{% /notice %}}
5757

5858
![Configure amd64 node type](images/configure-x86-note-type.png)

content/learning-paths/servers-and-cloud-computing/multiarch_ollama_on_gke/_index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: Use GKE to run Ollama on arm64 and amd64 nodes using a multi-architecture
33

44
minutes_to_complete: 30
55

6-
who_is_this_for: This topic explains how migrate a homogenous amd64 k8s cluster to a hybrid (arm64 and amd64) cluster using a multi-architecture container image on GKE. Ollama is the application used to demonstrate the migration.
6+
who_is_this_for: This topic explains how developers can migrate a homogenous amd64 k8s cluster to a hybrid (arm64 and amd64) cluster using a multi-architecture container image on GKE. Ollama is the application used to demonstrate the migration.
77

88

99
learning_objectives:

0 commit comments

Comments
 (0)