Skip to content

Commit d9faae5

Browse files
committed
whisper modified the flags section
1 parent c898459 commit d9faae5

File tree

2 files changed

+16
-56
lines changed

2 files changed

+16
-56
lines changed

content/learning-paths/servers-and-cloud-computing/whisper/optimization.md

Lines changed: 0 additions & 55 deletions
This file was deleted.

content/learning-paths/servers-and-cloud-computing/whisper/whisper.md

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -116,4 +116,19 @@ msg = f'\nInferencing elapsed time: {seconds:4.2f} seconds\n'
116116

117117
print(msg)
118118

119-
```
119+
```
120+
121+
## Use the Arm specific flags:
122+
123+
Use the following flags to enable fast math GEMM kernels, Linux Transparent Huge Page (THP) allocations, logs to confirm kernel and set LRU cache capacity and OMP_NUM_THREADS to run the Whisper efficiently on Arm machines.
124+
125+
```bash
126+
export DNNL_DEFAULT_FPMATH_MODE=BF16
127+
export THP_MEM_ALLOC_ENABLE=1
128+
export LRU_CACHE_CAPACITY=1024
129+
export OMP_NUM_THREADS=32
130+
export DNNL_VERBOSE=1
131+
```
132+
{{% notice Note %}}
133+
BF16 support is merged into PyTorch versions greater than 2.3.0.
134+
{{% /notice %}}

0 commit comments

Comments
 (0)