You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/build-s390x.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -121,21 +121,21 @@ All models need to be converted to Big-Endian. You can achieve this in three cas
121
121
122
122
### 1. Virtualization Setup
123
123
124
-
We strongly recommend using only LPAR (Type-1) virtualization to get the most performance.
125
-
126
-
Note: Type-2 virtualization is not supported at the moment, while you can get it running, the performance will not be the best.
124
+
We strongly recommend using only LPAR (Type-1) virtualization to get the most performance.
125
+
126
+
Note: Type-2 virtualization is not supported at the moment, while you can get it running, the performance will not be the best.
127
127
128
128
### 2. IFL (Core) Count
129
129
130
-
We recommend a minimum of 8 shared IFLs assigned to the LPAR. Increasing the IFL count past 8 shared IFLs will only improve Prompt Processing performance but not Token Generation.
131
-
132
-
Note: IFL count does not equate to vCPU count.
130
+
We recommend a minimum of 8 shared IFLs assigned to the LPAR. Increasing the IFL count past 8 shared IFLs will only improve Prompt Processing performance but not Token Generation.
131
+
132
+
Note: IFL count does not equate to vCPU count.
133
133
134
134
### 3. SMT vs NOSMT (Simultaneous Multithreading)
135
135
136
-
We strongly recommend disabling SMT via the kernel boot parameters as it negatively affects performance. Please refer to your Linux distribution's guide on disabling SMT via kernel boot parameters.
136
+
We strongly recommend disabling SMT via the kernel boot parameters as it negatively affects performance. Please refer to your Linux distribution's guide on disabling SMT via kernel boot parameters.
137
137
138
138
### 4. BLAS vs NOBLAS
139
139
140
-
We strongly recommend using BLAS for llama.cpp as there are no custom kernels for s390x for llama.cpp at the moment.
140
+
We strongly recommend using BLAS for llama.cpp as there are no custom kernels for s390x for llama.cpp at the moment.
0 commit comments