Skip to content

OADP-5782: Add hypershift-oadp-plugin E2E tests #1684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 23, 2025

Conversation

jparrill
Copy link
Contributor

@jparrill jparrill commented Mar 27, 2025

Why the changes were made

This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

⚠️ IMPORTANT! This PR depends on #1676

How to test the changes made

Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

TEST_HCP=true make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Mar 27, 2025
Copy link

openshift-ci bot commented Mar 27, 2025

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@jparrill jparrill changed the title Oadp 5782 e2 e OADP-5782: Add hypershift-oadp-plugin E2E tests Mar 27, 2025
@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Mar 27, 2025
@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 27, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made


This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

  • Some new functions in the original libraries
  • Changed a bit how the the scheme is imported into the E2E
  • Added a test suite only for HCP with many helper functions

How to test the changes made


Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/jparrill/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 27, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made


This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

  • Some new functions in the original libraries
  • Changed a bit how the the scheme is imported into the E2E
  • Added a test suite only for HCP with many helper functions

How to test the changes made


Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 27, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made

This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

  • Some new functions in the original libraries
  • Changed a bit how the the scheme is imported into the E2E
  • Added a test suite only for HCP with many helper functions

How to test the changes made

Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 27, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made

This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

  • Some new functions in the original libraries
  • Changed a bit how the the scheme is imported into the E2E
  • Added a test suite only for HCP with many helper functions

⚠️ IMPORTANT! This PR depends on #1676

How to test the changes made

Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@kaovilai kaovilai requested a review from Copilot March 27, 2025 22:49
Copy link

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces end-to-end tests for the hypershift-oadp-plugin and extends functionality to support hypershift scenarios throughout the codebase. It also adds new functions, updates the CRDs, manifests, and configuration files to include hypershift plugin references.

  • Added YAML sample manifests for hypershift
  • Introduced hypershift support in the scheme, backup, credentials, and controller tests
  • Updated CRDs, CSVs, and config files for hypershift plugin support

Reviewed Changes

Copilot reviewed 30 out of 31 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
tests/e2e/sample-applications/hostedcontrolplanes/hypershift/hostedcluster-pull-secret.yaml Added YAML for pull secret with hypershift label
tests/e2e/sample-applications/hostedcontrolplanes/hypershift/hostedcluster-etcd-enc-key.yaml Added YAML for etcd encryption key with hypershift label
tests/e2e/sample-applications/hostedcontrolplanes/hypershift/hostedcluster-agent-capi-role.yaml Added YAML Role for agent with capi access
tests/e2e/lib/scheme.go Registered hypershift API scheme
tests/e2e/lib/backup.go Added function CreateCustomBackupForNamespaces
tests/e2e/lib/apps.go Logged deployment status for debugging
tests/e2e/hcp_backup_restore_suite_test.go Introduced the hypershift backup & restore test suite and helper functions
tests/e2e/e2e_suite_test.go Updated client scheme initialization for test runtime
pkg/credentials/* Added hypershift related test cases and plugin image logic
pkg/common/common.go Added hypershift plugin constants
internal/controller/* Updated unit tests to include hypershift plugin in deployment and nodeagent checks
docs/developer/testing/TESTING.md Added env variable for hypershift plugin image
config/* Updated configuration files with hypershift plugin references
api/v1alpha1/dataprotectionapplication_types.go Extended enum and constants to include hypershift plugin
Files not reviewed (1)
  • go.mod: Language not supported
Comments suppressed due to low confidence (1)

tests/e2e/hcp_backup_restore_suite_test.go:25

  • The variable 'dpaCR' is used without a visible declaration in this file. Please ensure that 'dpaCR' is defined or passed appropriately.
err := lib.AddHCPPluginToDPA(h, dpaCR.Namespace, dpaCR.Name, false)

@jparrill
Copy link
Contributor Author

Need to add coverage: #1676 (comment)

@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 27, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made

This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

⚠️ IMPORTANT! This PR depends on #1676

How to test the changes made

Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link

openshift-ci-robot commented Mar 27, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made

This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

⚠️ IMPORTANT! This PR depends on #1676

How to test the changes made

Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@jparrill jparrill force-pushed the OADP-5782-E2E branch 4 times, most recently from 56e0c6a to 3df12fd Compare April 2, 2025 09:54
@jparrill
Copy link
Contributor Author

jparrill commented Apr 2, 2025

The PR is ready to be reviewed 🚀

@jparrill jparrill marked this pull request as ready for review April 2, 2025 09:59
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Apr 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whats the why behind this change?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly order and reusability. I think that function could be reused from most of the places and have a dynamic client just calling a function.

@weshayutin
Copy link
Contributor

@jparrill the typical oadp e2e test expects that OADP will be installed and the dpa is configured. This should also follow that pattern imho if I'm understanding things correctly.

2025/04/02 09:15:16 Preparing backup and restore
  [FAILED] Unexpected error:
      <*meta.NoKindMatchError | 0xc0008fefc0>: 
      no matches for kind "DataProtectionApplication" in version "oadp.openshift.io/v1alpha1"
      {
          GroupKind: {
              Group: "oadp.openshift.io",
              Kind: "DataProtectionApplication",
          },
          SearchedVersions: ["v1alpha1"],
      }
  occurred
  In [It] at:

@weshayutin
Copy link
Contributor

Could PTAL to got this merge before the branching? 🙏 @kaovilai @weshayutin @mateusoliveira43

We'll start reviewing to merge, but sorry to say we've already branched oadp-1.5 :)

@openshift-ci-robot
Copy link

openshift-ci-robot commented Apr 21, 2025

@jparrill: This pull request references OADP-5782 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.19.0" version, but no target version was set.

In response to this:

Why the changes were made

This PR add the E2E tests for hypershift-oadp-plugin. It includes also:

⚠️ IMPORTANT! This PR depends on #1676

How to test the changes made

Execute the E2E with this command:

export HYPERSHIFT_PLUGIN_IMAGE=quay.io/hypershift/hypershift-oadp-plugin:latest
export OADP_CRED_FILE=<PATH_TO_CREDS>
export OADP_BUCKET=<BUCKET_NAME>
export CI_CRED_FILE=<PATH_TO_CREDS>
export VSL_REGION=<AWS_REGION>
export BSL_REGION=<AWS_REGION>
export OPENSHIFT_CI=false

TEST_HCP=true make test-e2e GINKGO_ARGS="--ginkgo.focus='HCP Backup and Restore tests'"

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@jparrill
Copy link
Contributor Author

Could PTAL to got this merge before the branching? 🙏 @kaovilai @weshayutin @mateusoliveira43

We'll start reviewing to merge, but sorry to say we've already branched oadp-1.5 :)

👍 I will backport to oadp-1.5 branch if needed (in the end it's E2E coverage)

@weshayutin
Copy link
Contributor

hrm.. I think the images we're pulling here are NOT multi-arch.

so I have an arm cluster w/ 3 cont, 3 workers.. I think this is the second time trying the hypershipft e2e on this cluster. Is there cleanup, or additional resources I need? Any gotchas?

it's stalling on 2025/04/21 13:02:46 Error getting etcd statefulset, retrying...: statefulsets.apps "etcd" not found
oh.. SOMETHING is not built for ARM64
cluster-api-56b7695c85-4ljdj - exec container process /bin/cluster-api-controller-manager: Exec format error

-1, we need this to work out of the box on ARM64 as that is the only arch we are allowed to devel on in OADP.

Copy link
Contributor

@weshayutin weshayutin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needs to work as written for ARM64

@jparrill
Copy link
Contributor Author

jparrill commented Apr 21, 2025

Hey @weshayutin looks like the CAPI image is not being using multi, to solve that is just changing a line: https://github.com/openshift/oadp-operator/pull/1684/files#diff-683c1f305231a8b35496874f630b287ea73c40ff73f633c4d27c9851b798c977R28

The question I have is, should I build the plugin in multiarch to make it work in the ARM cluster, or just change the OCP payload to use multiarch?

@kaovilai
Copy link
Member

either works if it works. ideally the upstream quay plugin for devs will also be multi arch so we don't have to override when on diff arches.

Signed-off-by: Juan Manuel Parrilla Madrid <[email protected]>
@weshayutin
Copy link
Contributor

weshayutin commented Apr 22, 2025

the deployments and b/r are working, but I do see 2 velero pods running and 1 in crash loop

 oc get all -n openshift-adp
Warning: apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+
NAME                                                                  READY   STATUS                  RESTARTS      AGE
pod/21c451aa53ee024e6269633beb465ea4e32b6303fbc892011ab1e77c65c68zt   0/1     Completed               0             29m
pod/node-agent-7pzxg                                                  1/1     Running                 0             2m59s
pod/node-agent-lx7gx                                                  1/1     Running                 0             2m59s
pod/node-agent-sjlj4                                                  1/1     Running                 0             2m59s
pod/openshift-adp-controller-manager-54b454dbc4-nxdtn                 1/1     Running                 0             29m
pod/ttl-sh-oadp-operator-bundle-300e7d1e-1h                           1/1     Running                 0             30m
pod/velero-57cfdf6bc5-8m9ts                                           0/1     Init:CrashLoopBackOff   4 (61s ago)   2m44s
pod/velero-84787d6799-rhtzx                                           1/1     Running                 0             2m59s

NAME                                                       TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)    AGE
service/openshift-adp-controller-manager-metrics-service   ClusterIP   172.30.177.205   <none>        8443/TCP   29m
service/openshift-adp-velero-metrics-svc                   ClusterIP   172.30.199.182   <none>        8085/TCP   2m59s

NAME                        DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR            AGE
daemonset.apps/node-agent   3         3         3       3            3           kubernetes.io/os=linux   2m59s

NAME                                               READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/openshift-adp-controller-manager   1/1     1            1           29m
deployment.apps/velero                             1/1     1            1           2m59s

NAME                                                          DESIRED   CURRENT   READY   AGE
replicaset.apps/openshift-adp-controller-manager-54b454dbc4   1         1         1       29m
replicaset.apps/velero-57cfdf6bc5                             1         1         0       2m44s
replicaset.apps/velero-84787d6799                             1         1         1       2m59s

NAME                                                                        STATUS     COMPLETIONS   DURATION   AGE
job.batch/21c451aa53ee024e6269633beb465ea4e32b6303fbc892011ab1e77c65bff52   Complete   1/1           8s         29m
whayutin@thinkdoe:~/OPENSHIFT/git/OADP/oadp-operator$ ^C
whayutin@thinkdoe:~/OPENSHIFT/git/OADP/oadp-operator$ oc logs -f pod/velero-57cfdf6bc5-8m9ts
Defaulted container "velero" out of: velero, openshift-velero-plugin (init), velero-plugin-for-aws (init), hypershift-oadp-plugin (init)
Error from server (BadRequest): container "velero" in pod "velero-57cfdf6bc5-8m9ts" is waiting to start: PodInitializing
whayutin@thinkdoe:~/OPENSHIFT/git/OADP/oadp-operator$ 

Perhaps just my deployment.. will retry..

First test: test-hc-none

Second test: test-hc-agent

Errors bringing up: test-hc-agent cluster

	-
ClusterVersionSucceeding
Multiple errors are preventing progress: * Cluster operators console, dns, image-registry, ingress, insights, kube-storage-version-migrator, monitoring, network, node-tuning, openshift-samples, service-ca are not available * Could not update imagestream "openshift/driver-toolkit" (440 of 613): resource may have been deleted * Could not update operatorgroup "openshift-monitoring/openshift-cluster-monitoring" (554 of 613): resource may have been deleted * Could not update role "openshift-authentication/prometheus-k8s" (541 of 613): resource may have been deleted * Could not update role "openshift-console-operator/prometheus-k8s" (571 of 613): resource may have been deleted * Could not update role "openshift-console/prometheus-k8s" (575 of 613): resource may have been deleted * Could not update role "openshift-ingress-operator/prometheus-k8s" (582 of 613): resource may have been deleted * Could not update role "openshift-kube-apiserver-operator/prometheus-k8s" (586 of 613): resource may have been deleted
ClusterVersionProgressing
Unable to apply 4.18.6: an unknown error has occurred: MultipleErrors
  • csi-snapshot-controller on test-hc-agent
I0422 14:31:55.567158 1 feature_gate.go:387] feature gates: {map[]}
I0422 14:31:55.567518 1 main.go:169] Version: v4.18.0-202503121135.p0.g838d248.assembly.stream.el9-0-g0b14479-dirty
I0422 14:31:55.569892 1 main.go:220] Start NewCSISnapshotController with kubeconfig [/etc/kubernetes/kubeconfig] resyncPeriod [15m0s]
E0422 14:31:55.573265 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:55.683419 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:55.837292 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:56.064346 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:56.407941 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:56.923326 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:57.695166 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:31:58.837434 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:32:00.548855 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:32:03.114404 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:32:06.960782 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:32:12.729498 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:32:21.382084 1 main.go:98] Failed to list v1 volumesnapshots with error=Get "https://kube-apiserver:6443/apis/snapshot.storage.k8s.io/v1/volumesnapshots?limit=1": dial tcp 172.30.42.230:6443: connect: connection refused
E0422 14:32:25.574252 1 main.go:246] Exiting due to failure to ensure CRDs exist during startup: context deadline exceeded

@jparrill this is pretty cool stuff, impressive and well done. Can you please check out these errors on the second test. It seems like not all the services came up on the test-hc-agent cluster, is that to be expected?

Ran 2 of 39 Specs in 2577.469 seconds
SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 37 Skipped
PASS

Ginkgo ran 1 suite in 43m2.896104328s
Test Suite Passed

@jparrill
Copy link
Contributor Author

/test 4.19-e2e-test-hcp-aws-periodic

@weshayutin weshayutin dismissed their stale review April 22, 2025 18:36

works now

@jparrill
Copy link
Contributor Author

I think this could be a flakiness on the restoration part. I think it's worth to:

  • Got this merged
  • Fix the release repo to have periodics and presubmit correctly set
  • Add a new PR to oadp-operator repo to pin a concrete version of the plugin instead of use latest
  • Enhance the E2E with more strict rules and put countermeasures to fix the flakiness

Regarding the Multiarch part:

  • We have already merged the multiarch binaries generation with goreleaser.
  • We are working on the Konflux pipelines to have the multiarch images properly generated and published in our repo namespace.

I think with these things we have all the fronts covered. WDYT @weshayutin @kaovilai ?

@kaovilai
Copy link
Member

Sound good to me

@kaovilai
Copy link
Member

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Apr 23, 2025
@weshayutin weshayutin added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 23, 2025
Copy link

openshift-ci bot commented Apr 23, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jparrill, kaovilai, weshayutin

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Copy link

openshift-ci bot commented Apr 23, 2025

@jparrill: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-bot openshift-merge-bot bot merged commit 4ab8b14 into openshift:master Apr 23, 2025
9 checks passed
@weshayutin
Copy link
Contributor

@jparrill @kaovilai so will this cherry pick to oadp-1.5?? Or is that a fresh PR?

@jparrill
Copy link
Contributor Author

/jira backport oadp-1.5

@openshift-ci-robot
Copy link

@jparrill: The following backport issues have been created:

Queuing cherrypicks to the requested branches to be created after this PR merges:
/cherrypick oadp-1.5

In response to this:

/jira backport oadp-1.5

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-cherrypick-robot
Copy link
Contributor

@openshift-ci-robot: #1684 failed to apply on top of branch "oadp-1.5":

Applying: OADP-5782: Add hypershift-oadp-plugin E2E tests
Using index info to reconstruct a base tree...
M	Makefile
M	bundle/manifests/oadp-operator.clusterserviceversion.yaml
M	go.mod
M	go.sum
M	tests/e2e/e2e_suite_test.go
M	tests/e2e/lib/apps.go
Falling back to patching base and 3-way merge...
Auto-merging tests/e2e/lib/apps.go
Auto-merging tests/e2e/e2e_suite_test.go
Auto-merging go.sum
CONFLICT (content): Merge conflict in go.sum
Auto-merging go.mod
Auto-merging bundle/manifests/oadp-operator.clusterserviceversion.yaml
Auto-merging Makefile
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
hint: When you have resolved this problem, run "git am --continue".
hint: If you prefer to skip this patch, run "git am --skip" instead.
hint: To restore the original branch and stop patching, run "git am --abort".
hint: Disable this message with "git config advice.mergeConflict false"
Patch failed at 0001 OADP-5782: Add hypershift-oadp-plugin E2E tests

In response to this:

@jparrill: The following backport issues have been created:

Queuing cherrypicks to the requested branches to be created after this PR merges:
/cherrypick oadp-1.5

In response to this:

/jira backport oadp-1.5

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add unsupportedOverrides unit test for hypershift.
8 participants