Skip to content

v3.3.1

Choose a tag to compare

@mollyheamazon mollyheamazon released this 30 Oct 20:47
· 64 commits to main since this release
7233490

Features

  • Describe cluster command
    • User can use hyp describe cluster to learn more info about hp clusters
  • Jinja template handling logic for inference and training
    • User can modify jinja template to add parameters supported by CRD through init experience of inference and training, for further CLI customization
  • Cluster creation template versioning
    • User can choose cloudformation template version through cluster creation expeirence
  • KVCache and intelligent routing for HyperPod Inference
    • InferenceEndpointConfig CRD supported is updated to v1
    • KVCache and Intelligent Routing support is added in template version 1.1