Skip to content

Commit f4f14f0

Browse files
Override truss version for Gemma (#532)
The default truss version is 0.9.119, with a corresponding truss-transfer CLI 0.0.17. This is too old, does not work with HF manifests correctly, likely due to [this](basetenlabs/truss#1904). Override to a newer truss version. Validated with a truss push.
1 parent 66527f8 commit f4f14f0

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

gemma/gemma-3-27b-it/config.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,4 +57,5 @@ runtime:
5757
restart_threshold_seconds: 300 # Triggers a restart if health checks fail for 5 minutes
5858
stop_traffic_threshold_seconds: 120 # Stops traffic if health checks fail for 2 minutes
5959
predict_concurrency : 8
60+
truss_server_version_override: "0.11.4"
6061
model_name: Gemma 27B Instruct

0 commit comments

Comments
 (0)