Skip to content

Commit b23ae1a

Browse files
Update generative-proof-of-concept-CPU-preprocessing-in-memory.py
reduce to fit the CICD test
1 parent b6ec52c commit b23ae1a

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

generative-proof-of-concept-CPU-preprocessing-in-memory.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ def objective(trial: optuna.Trial) -> float:
5959
# Number of text samples to create: # Number of text samples (of approximately max_seq_len) to create
6060
# Raises RAM in a linear fashion
6161

62-
SAMPLES_TO_CREATE = 100
62+
SAMPLES_TO_CREATE = 10
6363

6464
# How many tokens to provide before expecting the next token to be predicted.
6565
# Half this = double RAM (inversely proportional to RAM requirement)
@@ -135,7 +135,7 @@ def objective(trial: optuna.Trial) -> float:
135135
# embedding output dim must be an even number
136136
# Maximize EMBEDDING_N based on available RAM and CPU / GPU
137137

138-
EMBEDDING_N = 12
138+
EMBEDDING_N = 6 # 12
139139
EMBEDDING_DIM = int(EMBEDDING_N * 2)
140140

141141
PROJECTION_N = 1 # Punatuve increase of ram, leaving this as 1 until we are running on HPC

0 commit comments

Comments
 (0)