Skip to content

Commit d2e7952

Browse files
readme
1 parent 6b5d425 commit d2e7952

File tree

1 file changed

+9
-1
lines changed

1 file changed

+9
-1
lines changed

README.md

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,15 @@ Recommended Python version: 3.9/3.10.
118118
`--B`: Batch Size.
119119

120120
`--K, --L`: LSH hyper-parameter (when K=0, we use full attention).
121-
121+
122+
`numactl` can improve the throughput. On different CPU platforms, the OpenMP threads need to be manually reset to achieve the best performance (Now we use 64).
123+
124+
`library/sparse_attention/sparse_attention.h:Line 10` : `ATTENTION_THREADS`
125+
126+
`library/lsh/lsh.h:Line 12` : `LSH_THREADS`
127+
128+
The number of threads is recommended to set as (or slightly smaller than) the number of physical CPU cores (not hyper-thread) to achieve the best performance.
129+
122130

123131
## Evaluations
124132

0 commit comments

Comments
 (0)