Skip to content

Commit 6020434

Browse files
committed
Fix scheme for passing custom LLM params
1 parent 00972e2 commit 6020434

File tree

5 files changed

+30
-45
lines changed

5 files changed

+30
-45
lines changed

charts/azimuth-chat/azimuth-ui.schema.yaml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -24,10 +24,10 @@ sortOrder:
2424
- /azimuth-llm/ui/appSettings/model_instruction
2525
- /azimuth-llm/ui/appSettings/page_title
2626
- /azimuth-llm/api/image/version
27-
- /azimuth-llm/ui/appSettings/llm_temperature
28-
- /azimuth-llm/ui/appSettings/llm_max_tokens
29-
- /azimuth-llm/ui/appSettings/llm_frequency_penalty
30-
- /azimuth-llm/ui/appSettings/llm_presence_penalty
31-
- /azimuth-llm/ui/appSettings/llm_top_p
32-
- /azimuth-llm/ui/appSettings/llm_top_k
27+
- /azimuth-llm/ui/appSettings/llm_params/temperature
28+
- /azimuth-llm/ui/appSettings/llm_params/max_tokens
29+
- /azimuth-llm/ui/appSettings/llm_params/frequency_penalty
30+
- /azimuth-llm/ui/appSettings/llm_params/presence_penalty
31+
- /azimuth-llm/ui/appSettings/llm_params/top_p
32+
- /azimuth-llm/ui/appSettings/llm_params/top_k
3333
- /azimuth-llm/api/modelMaxContextLength

charts/azimuth-chat/ci/ui-only-values.yaml

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,3 +5,12 @@ azimuth-llm:
55
service:
66
zenith:
77
enabled: false
8+
appSettings:
9+
# Verify that we can set non-standard LLM params
10+
llm_params:
11+
max_tokens: 101
12+
temperature: 0.1
13+
top_p: 0.15
14+
top_k: 1
15+
presence_penalty: 0.9
16+
frequency_penalty: 1

charts/azimuth-image-analysis/azimuth-ui.schema.yaml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,9 @@ sortOrder:
1515
- /huggingface/model
1616
- /huggingface/token
1717
- /api/image/version
18-
- /ui/appSettings/llm_temperature
19-
- /ui/appSettings/llm_max_tokens
20-
- /ui/appSettings/llm_frequency_penalty
21-
- /ui/appSettings/llm_presence_penalty
22-
- /ui/appSettings/llm_top_p
23-
- /ui/appSettings/llm_top_k
18+
- /ui/appSettings/llm_params/temperature
19+
- /ui/appSettings/llm_params/max_tokens
20+
- /ui/appSettings/llm_params/frequency_penalty
21+
- /ui/appSettings/llm_params/presence_penalty
22+
- /ui/appSettings/llm_params/top_p
23+
- /ui/appSettings/llm_params/top_k

charts/azimuth-image-analysis/ci/ui-only-values.yaml

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,3 +5,12 @@ azimuth-llm:
55
service:
66
zenith:
77
enabled: false
8+
appSettings:
9+
# Verify that we can set non-standard LLM params
10+
llm_params:
11+
max_tokens: 101
12+
temperature: 0.1
13+
top_p: 0.15
14+
top_k: 1
15+
presence_penalty: 0.9
16+
frequency_penalty: 1

charts/azimuth-llm/azimuth-ui.schema.yaml

Lines changed: 0 additions & 33 deletions
This file was deleted.

0 commit comments

Comments
 (0)