You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The temperature parameter used to control randomness in the output.
449
467
Example: 0.7
450
468
"""
451
469
470
+
GEN_AI_REQUEST_TOP_K="gen_ai.request.top_k"
471
+
"""
472
+
Limits the model to only consider the K most likely next tokens, where K is an integer (e.g., top_k=20 means only the 20 highest probability tokens are considered).
473
+
Example: 35
474
+
"""
475
+
452
476
GEN_AI_REQUEST_TOP_P="gen_ai.request.top_p"
453
477
"""
454
478
The top_p parameter used to control diversity via nucleus sampling.
0 commit comments