File tree Expand file tree Collapse file tree 5 files changed +30
-45
lines changed Expand file tree Collapse file tree 5 files changed +30
-45
lines changed Original file line number Diff line number Diff line change @@ -24,10 +24,10 @@ sortOrder:
24
24
- /azimuth-llm/ui/appSettings/model_instruction
25
25
- /azimuth-llm/ui/appSettings/page_title
26
26
- /azimuth-llm/api/image/version
27
- - /azimuth-llm/ui/appSettings/llm_temperature
28
- - /azimuth-llm/ui/appSettings/llm_max_tokens
29
- - /azimuth-llm/ui/appSettings/llm_frequency_penalty
30
- - /azimuth-llm/ui/appSettings/llm_presence_penalty
31
- - /azimuth-llm/ui/appSettings/llm_top_p
32
- - /azimuth-llm/ui/appSettings/llm_top_k
27
+ - /azimuth-llm/ui/appSettings/llm_params/temperature
28
+ - /azimuth-llm/ui/appSettings/llm_params/max_tokens
29
+ - /azimuth-llm/ui/appSettings/llm_params/frequency_penalty
30
+ - /azimuth-llm/ui/appSettings/llm_params/presence_penalty
31
+ - /azimuth-llm/ui/appSettings/llm_params/top_p
32
+ - /azimuth-llm/ui/appSettings/llm_params/top_k
33
33
- /azimuth-llm/api/modelMaxContextLength
Original file line number Diff line number Diff line change @@ -5,3 +5,12 @@ azimuth-llm:
5
5
service :
6
6
zenith :
7
7
enabled : false
8
+ appSettings :
9
+ # Verify that we can set non-standard LLM params
10
+ llm_params :
11
+ max_tokens : 101
12
+ temperature : 0.1
13
+ top_p : 0.15
14
+ top_k : 1
15
+ presence_penalty : 0.9
16
+ frequency_penalty : 1
Original file line number Diff line number Diff line change @@ -15,9 +15,9 @@ sortOrder:
15
15
- /huggingface/model
16
16
- /huggingface/token
17
17
- /api/image/version
18
- - /ui/appSettings/llm_temperature
19
- - /ui/appSettings/llm_max_tokens
20
- - /ui/appSettings/llm_frequency_penalty
21
- - /ui/appSettings/llm_presence_penalty
22
- - /ui/appSettings/llm_top_p
23
- - /ui/appSettings/llm_top_k
18
+ - /ui/appSettings/llm_params/temperature
19
+ - /ui/appSettings/llm_params/max_tokens
20
+ - /ui/appSettings/llm_params/frequency_penalty
21
+ - /ui/appSettings/llm_params/presence_penalty
22
+ - /ui/appSettings/llm_params/top_p
23
+ - /ui/appSettings/llm_params/top_k
Original file line number Diff line number Diff line change @@ -5,3 +5,12 @@ azimuth-llm:
5
5
service :
6
6
zenith :
7
7
enabled : false
8
+ appSettings :
9
+ # Verify that we can set non-standard LLM params
10
+ llm_params :
11
+ max_tokens : 101
12
+ temperature : 0.1
13
+ top_p : 0.15
14
+ top_k : 1
15
+ presence_penalty : 0.9
16
+ frequency_penalty : 1
Load Diff This file was deleted.
You can’t perform that action at this time.
0 commit comments