Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Commit 4554314

Browse files
authored
Also use default max_seq_length of 128 for ExecuTorch native runner (#1191)
1 parent c3b5965 commit 4554314

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

runner/run.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -835,7 +835,7 @@ int main(int argc, char* argv[]) {
835835
float topp = 0.9f; // top-p in nucleus sampling. 1.0 = off. 0.9 works well,
836836
// but slower
837837

838-
int steps = 256; // number of steps to run for
838+
int steps = 128; // number of steps to run for
839839
const char* prompt = NULL; // prompt string
840840
unsigned long long rng_seed = 0; // seed rng with time by default
841841
const char* mode = "generate"; // generate|chat

0 commit comments

Comments
 (0)