Skip to content

Commit c05ca9d

Browse files
author
Maha Lakshmi Soumya Yalavarthi
committed
Optimize parameter handling and cost lookup logic
- Remove top_p parameter handling in Bedrock client to avoid conflicts with temperature - Simplify cost lookup logic in save_reporting_data.py for better performance and accuracy - Replace fuzzy unit matching with exact matching to prevent false positives
1 parent b600972 commit c05ca9d

File tree

7 files changed

+49
-59
lines changed

7 files changed

+49
-59
lines changed

‎config_library/pattern-1/lending-package-sample/config.yaml‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -198,23 +198,23 @@ pricing:
198198
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
199199
units:
200200
- name: inputTokens
201-
price: '3.3E-03'
201+
price: '3.3E-6'
202202
- name: outputTokens
203-
price: '1.65E-02'
203+
price: '1.65E-5'
204204
- name: cacheReadInputTokens
205-
price: '3.30E-04'
205+
price: '3.3E-7'
206206
- name: cacheWriteInputTokens
207-
price: '4.125E-03'
207+
price: '4.125E-6'
208208
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0:1m
209209
units:
210210
- name: inputTokens
211-
price: '6.60E-03'
211+
price: '6.6E-6'
212212
- name: outputTokens
213-
price: '2.475E-02'
213+
price: '2.475E-5'
214214
- name: cacheReadInputTokens
215-
price: '6.60E-04'
215+
price: '6.6E-7'
216216
- name: cacheWriteInputTokens
217-
price: '8.250E-03'
217+
price: '8.25E-6'
218218
- name: bedrock/us.anthropic.claude-opus-4-20250514-v1:0
219219
units:
220220
- name: inputTokens

‎config_library/pattern-2/bank-statement-sample/config.yaml‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -676,23 +676,23 @@ pricing:
676676
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
677677
units:
678678
- name: inputTokens
679-
price: '3.3E-03'
679+
price: '3.3E-6'
680680
- name: outputTokens
681-
price: '1.65E-02'
681+
price: '1.65E-5'
682682
- name: cacheReadInputTokens
683-
price: '3.30E-04'
683+
price: '3.3E-7'
684684
- name: cacheWriteInputTokens
685-
price: '4.125E-03'
685+
price: '4.125E-6'
686686
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0:1m
687687
units:
688688
- name: inputTokens
689-
price: '6.60E-03'
689+
price: '6.6E-6'
690690
- name: outputTokens
691-
price: '2.475E-02'
691+
price: '2.475E-5'
692692
- name: cacheReadInputTokens
693-
price: '6.60E-04'
693+
price: '6.6E-7'
694694
- name: cacheWriteInputTokens
695-
price: '8.250E-03'
695+
price: '8.25E-6'
696696
- name: bedrock/us.anthropic.claude-opus-4-20250514-v1:0
697697
units:
698698
- name: inputTokens

‎config_library/pattern-2/lending-package-sample/config.yaml‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1439,23 +1439,23 @@ pricing:
14391439
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
14401440
units:
14411441
- name: inputTokens
1442-
price: '3.3E-03'
1442+
price: '3.3E-6'
14431443
- name: outputTokens
1444-
price: '1.65E-02'
1444+
price: '1.65E-5'
14451445
- name: cacheReadInputTokens
1446-
price: '3.30E-04'
1446+
price: '3.3E-7'
14471447
- name: cacheWriteInputTokens
1448-
price: '4.125E-03'
1448+
price: '4.125E-6'
14491449
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0:1m
14501450
units:
14511451
- name: inputTokens
1452-
price: '6.60E-03'
1452+
price: '6.6E-6'
14531453
- name: outputTokens
1454-
price: '2.475E-02'
1454+
price: '2.475E-5'
14551455
- name: cacheReadInputTokens
1456-
price: '6.60E-04'
1456+
price: '6.6E-7'
14571457
- name: cacheWriteInputTokens
1458-
price: '8.250E-03'
1458+
price: '8.25E-6'
14591459
- name: bedrock/us.anthropic.claude-opus-4-20250514-v1:0
14601460
units:
14611461
- name: inputTokens

‎config_library/pattern-2/rvl-cdip-package-sample-with-few-shot-examples/config.yaml‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -909,23 +909,23 @@ pricing:
909909
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
910910
units:
911911
- name: inputTokens
912-
price: '3.3E-03'
912+
price: '3.3E-6'
913913
- name: outputTokens
914-
price: '1.65E-02'
914+
price: '1.65E-5'
915915
- name: cacheReadInputTokens
916-
price: '3.30E-04'
916+
price: '3.3E-7'
917917
- name: cacheWriteInputTokens
918-
price: '4.125E-03'
918+
price: '4.125E-6'
919919
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0:1m
920920
units:
921921
- name: inputTokens
922-
price: '6.60E-03'
922+
price: '6.6E-6'
923923
- name: outputTokens
924-
price: '2.475E-02'
924+
price: '2.475E-5'
925925
- name: cacheReadInputTokens
926-
price: '6.60E-04'
926+
price: '6.6E-7'
927927
- name: cacheWriteInputTokens
928-
price: '8.250E-03'
928+
price: '8.25E-6'
929929
- name: bedrock/us.anthropic.claude-opus-4-20250514-v1:0
930930
units:
931931
- name: inputTokens

‎config_library/pattern-2/rvl-cdip-package-sample/config.yaml‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -913,23 +913,23 @@ pricing:
913913
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
914914
units:
915915
- name: inputTokens
916-
price: '3.3E-03'
916+
price: '3.3E-6'
917917
- name: outputTokens
918-
price: '1.65E-02'
918+
price: '1.65E-5'
919919
- name: cacheReadInputTokens
920-
price: '3.30E-04'
920+
price: '3.3E-7'
921921
- name: cacheWriteInputTokens
922-
price: '4.125E-03'
922+
price: '4.125E-6'
923923
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0:1m
924924
units:
925925
- name: inputTokens
926-
price: '6.60E-03'
926+
price: '6.6E-6'
927927
- name: outputTokens
928-
price: '2.475E-02'
928+
price: '2.475E-5'
929929
- name: cacheReadInputTokens
930-
price: '6.60E-04'
930+
price: '6.6E-7'
931931
- name: cacheWriteInputTokens
932-
price: '8.250E-03'
932+
price: '8.25E-6'
933933
- name: bedrock/us.anthropic.claude-opus-4-20250514-v1:0
934934
units:
935935
- name: inputTokens

‎config_library/pattern-3/rvl-cdip-package-sample/config.yaml‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -772,23 +772,23 @@ pricing:
772772
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
773773
units:
774774
- name: inputTokens
775-
price: '3.3E-03'
775+
price: '3.3E-6'
776776
- name: outputTokens
777-
price: '1.65E-02'
777+
price: '1.65E-5'
778778
- name: cacheReadInputTokens
779-
price: '3.30E-04'
779+
price: '3.3E-7'
780780
- name: cacheWriteInputTokens
781-
price: '4.125E-03'
781+
price: '4.125E-6'
782782
- name: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0:1m
783783
units:
784784
- name: inputTokens
785-
price: '6.60E-03'
785+
price: '6.6E-6'
786786
- name: outputTokens
787-
price: '2.475E-02'
787+
price: '2.475E-5'
788788
- name: cacheReadInputTokens
789-
price: '6.60E-04'
789+
price: '6.6E-7'
790790
- name: cacheWriteInputTokens
791-
price: '8.250E-03'
791+
price: '8.25E-6'
792792
- name: bedrock/us.anthropic.claude-opus-4-20250514-v1:0
793793
units:
794794
- name: inputTokens

‎lib/idp_common_pkg/idp_common/bedrock/client.py‎

Lines changed: 1 addition & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -271,17 +271,7 @@ def invoke_model(
271271
# Initialize inference config with temperature
272272
inference_config = {"temperature": temperature}
273273

274-
# Handle top_p parameter
275-
if top_p is not None:
276-
# Convert top_p to float if it's a string
277-
if isinstance(top_p, str):
278-
try:
279-
top_p = float(top_p)
280-
except ValueError:
281-
logger.warning(f"Failed to convert top_p value '{top_p}' to float. Not using top_p.")
282-
top_p = None
283-
284-
inference_config["topP"] = top_p
274+
# Skip top_p entirely to avoid conflicts with temperature
285275

286276
# Handle max_tokens parameter
287277
if max_tokens is not None:

0 commit comments

Comments
 (0)