📝 Add max_new_tokens in example

coyotte508 · coyotte508 · commit 7188b5c4da8c · 2023-04-08T00:46:03.000+02:00
diff --git a/packages/inference/README.md b/packages/inference/README.md
@@ -78,7 +78,8 @@ await hf.textGeneration({
 
 for await (const output of hf.textGenerationStream({
   model: "google/flan-t5-xxl",
-  inputs: 'repeat "one two three four"'
+  inputs: 'repeat "one two three four"',
+  parameters: { max_new_tokens: 250 }
 })) {
   console.log(output.token.text, output.generated_text);
 }

Original file line number	Diff line number	Diff line change
`@@ -78,7 +78,8 @@ await hf.textGeneration({`
`78`	`78`
`79`	`79`	`for await (const output of hf.textGenerationStream({`
`80`	`80`	`model: "google/flan-t5-xxl",`
`81`		`- inputs: 'repeat "one two three four"'`
	`81`	`+ inputs: 'repeat "one two three four"',`
	`82`	`+ parameters: { max_new_tokens: 250 }`
`82`	`83`	`})) {`
`83`	`84`	`console.log(output.token.text, output.generated_text);`
`84`	`85`	`}`