Skip to content

[RHOAIENG-22052] Updated test suites that were previously failing #333

Merged
openshift-merge-bot[bot] merged 6 commits intoopendatahub-io:mainfrom
mholder6:updating-tests
May 28, 2025
Merged

[RHOAIENG-22052] Updated test suites that were previously failing #333
openshift-merge-bot[bot] merged 6 commits intoopendatahub-io:mainfrom
mholder6:updating-tests

Conversation

@mholder6
Copy link

@mholder6 mholder6 commented Apr 25, 2025

Motivation

Get the e2e tests working for the modelmesh-serving component

Modifications

Updated and added logic to any tests that were failing

How to Test

  1. Ensure that you have a clean cluster with at least 16 CPUs, 61 G of memory, and 2 nodes
  2. Ensure that you are logged into the cluster from your terminal
  3. The tests will download all necessary operators/dependencies so there is nothing you need to install to the cluster directly
  4. After cloning the repo and checking out this branch, navigate to the modelemesh-serving directory and run this command:
    CONTROLLERNAMESPACE=opendatahub NAMESPACE=modelmesh-serving NAMESPACESCOPEMODE=true make e2e-test-for-odh

You should see the following output (or something similar since I previously had everything installed) for the first few lines:
./opendatahub/scripts/install_odh.sh --ctrl-namespace opendatahub .. Downloading binaries yq already installed. kustomize already installed with correct version... Delete the exising /tmp/modelmesh-e2e folder Creating a /tmp/modelmesh-e2e folder Now using project "opendatahub" on server "https://api.l5a1t7e9q9f7d2q.de90.p3.openshiftapps.com:443". subscription.operators.coreos.com/opendatahub-operator unchanged .. Opendatahub operator is ready .. Creating the DSC in opendatahub dscinitialization.dscinitialization.opendatahub.io/default-dsci unchanged datasciencecluster.datasciencecluster.opendatahub.io/default-dsc unchanged All -l control-plane=modelmesh-controller pods in 'opendatahub' namespace are running and ready. [SUCCESS] ModelMesh is Running

After the set up is complete the suite tests will run. It will take about 15~20 minutes total. The first time it is ran it may take longer due to having to install the required images for the tests.

Warning

Some of the tests will face timeout issues occasionally, and will fail. But the test suite will rerun and it should pass the next time. It maxes out at 4 reruns.

PR checklist

Checklist items below are applicable for development targeted to both fast and stable branches/tags

  • Unit tests pass locally
  • FVT tests pass locally

Checklist items below are applicable for development targeted to both fast and stable branches/tags

  • Tested modelmesh serving deployment with odh-manifests and ran odh-manifests-e2e tests locally

@mholder6 mholder6 changed the title Updated test suites that were previously failing [RHOAIENG-22052] Updated test suites that were previously failing Apr 25, 2025
@mholder6 mholder6 force-pushed the updating-tests branch 2 times, most recently from 6fa6d32 to 615108d Compare May 13, 2025 19:45
mholder6 and others added 4 commits May 13, 2025 16:11
Signed-off-by: Mariah Holder <marholde@redhat.com>
Signed-off-by: Mariah Holder <marholde@redhat.com>
Signed-off-by: Mariah Holder <marholde@redhat.com>

Tracking progress

Signed-off-by: Mariah Holder <marholde@redhat.com>
… hpa tests are ran

Signed-off-by: Mariah Holder <marholde@redhat.com>
@spolti
Copy link
Member

spolti commented May 15, 2025

/retest

Signed-off-by: Mariah Holder <marholde@redhat.com>
Signed-off-by: Mariah Holder <94134625+mholder6@users.noreply.github.com>
containers:
- name: "copy-pod"
image: quay.io/jooholee/modelmesh-minio-examples:latest
image: quay.io/rh-ee-allausas/modelmesh-minio-examples:latest
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we have an image under opendatahub org instead? wdyt?


# info "installing namespaced rbac"
kustomize build "${archive_folder}"/config/rbac/namespace-scope | oc apply -n "${ctrlnamespace}" -f -
kustomize build "${archive_folder}"/config/rbac/namespace-scope | oc apply -n modelmesh-serving f -
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should be the controller namespace, did you find issues using the env?

Copy link
Member

@spolti spolti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor comment

@openshift-ci
Copy link

openshift-ci bot commented May 16, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: mholder6, spolti

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

spolti added a commit to spolti/modelmesh-serving that referenced this pull request May 16, 2025
@spolti
Copy link
Member

spolti commented May 28, 2025

/lgtm

@openshift-ci openshift-ci bot added the lgtm label May 28, 2025
@openshift-merge-bot openshift-merge-bot bot merged commit 4654973 into opendatahub-io:main May 28, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants