-
Couldn't load subscription status.
- Fork 45
for building the images #560
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
…y#530) * feat: Add subject to LMEval CRD's OCI outputs * chore: Add more test cases
|
Skipping CI for Draft Pull Request. |
Reviewer's GuideThis PR implements end-to-end OCI registry support for LMEvalJobs by extending the API, CRD schema, validation, controller, driver, CLI flags, and tests to handle OCI outputs. It introduces a new OCISpec type and helper methods, integrates OCI path/auth validation, augments command generation and pod creation with OCI environment variables, secrets, and certificate volumes, adds a post-run uploadToOCI step in the driver, and includes extensive unit tests covering all OCI scenarios. Sequence diagram for OCI output environment variable and volume setup in pod creationsequenceDiagram
participant Controller
participant PodSpec
participant Secret
participant ConfigMap
Controller->PodSpec: Check job.Spec.HasOCIOutput()
alt OCI output configured
Controller->PodSpec: Add OCI env vars (OCI_REGISTRY, OCI_REPOSITORY, OCI_PATH, ...)
Controller->Secret: Reference registry/repository/auth secrets
Controller->PodSpec: Add volume for certificates if CABundle specified
Controller->ConfigMap: Reference CABundle configmap
Controller->PodSpec: Mount certificate volume
end
Sequence diagram for driver uploading results to OCI after job completionsequenceDiagram
participant Driver
participant OCI Registry
Driver->Driver: Check Option.UploadToOCI
alt UploadToOCI is true
Driver->OCI Registry: Run oci.py with registry and results path
OCI Registry->Driver: Accept results artifact
end
Entity relationship diagram for new OCISpec in OutputserDiagram
Outputs {
PersistentVolumeClaimManaged
OCISpec
}
OCISpec {
Registry SecretKeySelector
Repository SecretKeySelector
Tag string
Path string
Subject string
UsernameRef SecretKeySelector
PasswordRef SecretKeySelector
TokenRef SecretKeySelector
VerifySSL bool
CABundle SecretKeySelector
}
Outputs ||--|{ OCISpec : contains
OCISpec }|--|| SecretKeySelector : "uses for registry/repository/auth/cert"
Class diagram for new and updated types supporting OCI outputclassDiagram
class Outputs {
+PersistentVolumeClaimManaged pvcManaged
+OCISpec oci
+HasExistingPVC() bool
+HasOCI() bool
}
class OCISpec {
+SecretKeySelector Registry
+SecretKeySelector Repository
+string Tag
+string Path
+string Subject
+SecretKeySelector UsernameRef
+SecretKeySelector PasswordRef
+SecretKeySelector TokenRef
+bool VerifySSL
+SecretKeySelector CABundle
+HasCertificates() bool
+HasUsernamePassword() bool
+HasToken() bool
}
class LMEvalJobSpec {
+Outputs Outputs
+HasOCIOutput() bool
+HasCustomOutput() bool
}
Outputs o-- OCISpec : "oci"
OCISpec o-- SecretKeySelector : "Registry/Repository/UsernameRef/PasswordRef/TokenRef/CABundle"
LMEvalJobSpec o-- Outputs : "outputs"
File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
/ok-to-test |
|
@tarilabs: you cannot LGTM your own PR. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
PR image build and manifest generation completed successfully! 📦 PR image: 📦 LMES driver image: 📦 LMES job image: 📦 Guardrails orchestrator image: 🗂️ CI manifests |
Signed-off-by: tarilabs <[email protected]>
Signed-off-by: tarilabs <[email protected]>
Signed-off-by: tarilabs <[email protected]>
…ig, when DSC config is missing
|
PR needs rebase. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
@ruivieira can you kindly add the labels for me please?
I can't
Summary by Sourcery
Add end-to-end support for uploading evaluation results to OCI registries, including API, CRD, controller, driver, validation, CLI flag, and extensive tests
New Features:
Enhancements:
Documentation:
Tests: