WIP CNTRLPLANE-353: Add test which verifes that only short duration tests are present

[vrutkovs]

This test would run only when ShortCertRotation is enabled

[openshift-ci-robot]

@vrutkovs: This pull request references CNTRLPLANE-353 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.19.0" version, but no target version was set.

In response to this:

This test would run only when ShortCertRotation is enabled

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: vrutkovs
Once this PR has been reviewed and has the lgtm label, please assign neisw for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci-robot]

@vrutkovs: This pull request references CNTRLPLANE-353 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.19.0" version, but no target version was set.

In response to this:

This test would run only when ShortCertRotation is enabled.
TODO: skip ingress certificates - these are not refreshed automatically and refreshing them will break tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-ci-robot]

@vrutkovs: This pull request references CNTRLPLANE-353 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the sub-task to target the "4.19.0" version, but no target version was set.

In response to this:

This test would run only when ShortCertRotation is enabled

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

[openshift-trt]

Job Failure Risk Analysis for sha: 2f2c637

Job Name	Failure Risk
pull-ci-openshift-origin-main-e2e-gcp-disruptive	Medium [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-vsphere-ovn	IncompleteTests Tests for this run (102) are below the historical average (2667): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: 2f2c637

• "[sig-trt] Skipped annotations present" [Total: 39, Pass: 39, Fail: 0, Flake: 40]

[openshift-ci]

@vrutkovs: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-vsphere-ovn-dualstack-primaryv6	add29d4	link	false	/test e2e-vsphere-ovn-dualstack-primaryv6
ci/prow/e2e-openstack-serial	add29d4	link	false	/test e2e-openstack-serial
ci/prow/e2e-metal-ipi-ovn-ipv6	add29d4	link	true	/test e2e-metal-ipi-ovn-ipv6
ci/prow/e2e-azure-ovn-upgrade	add29d4	link	false	/test e2e-azure-ovn-upgrade
ci/prow/e2e-aws-csi	add29d4	link	false	/test e2e-aws-csi
ci/prow/e2e-aws-ovn-single-node-upgrade	add29d4	link	false	/test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-openstack-ovn	add29d4	link	false	/test e2e-openstack-ovn
ci/prow/e2e-metal-ipi-ovn-dualstack-local-gateway	add29d4	link	false	/test e2e-metal-ipi-ovn-dualstack-local-gateway
ci/prow/e2e-metal-ipi-ovn-dualstack	add29d4	link	false	/test e2e-metal-ipi-ovn-dualstack
ci/prow/e2e-aws-ovn-etcd-scaling	add29d4	link	false	/test e2e-aws-ovn-etcd-scaling
ci/prow/e2e-gcp-ovn-etcd-scaling	add29d4	link	false	/test e2e-gcp-ovn-etcd-scaling
ci/prow/4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback	add29d4	link	false	/test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
ci/prow/e2e-gcp-disruptive	add29d4	link	false	/test e2e-gcp-disruptive
ci/prow/e2e-gcp-fips-serial	add29d4	link	false	/test e2e-gcp-fips-serial
ci/prow/e2e-agnostic-ovn-cmd	add29d4	link	false	/test e2e-agnostic-ovn-cmd
ci/prow/e2e-metal-ipi-serial	add29d4	link	false	/test e2e-metal-ipi-serial
ci/prow/okd-e2e-gcp	add29d4	link	false	/test okd-e2e-gcp
ci/prow/e2e-azure	add29d4	link	false	/test e2e-azure
ci/prow/e2e-metal-ipi-ovn	add29d4	link	false	/test e2e-metal-ipi-ovn
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout	add29d4	link	false	/test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-metal-ipi-virtualmedia	add29d4	link	false	/test e2e-metal-ipi-virtualmedia
ci/prow/e2e-metal-ipi-serial-ovn-ipv6	add29d4	link	false	/test e2e-metal-ipi-serial-ovn-ipv6
ci/prow/e2e-aws-disruptive	add29d4	link	false	/test e2e-aws-disruptive
ci/prow/e2e-vsphere-ovn	add29d4	link	true	/test e2e-vsphere-ovn
ci/prow/e2e-metal-ipi-ovn-dualstack-bgp-techpreview	add29d4	link	false	/test e2e-metal-ipi-ovn-dualstack-bgp-techpreview
ci/prow/e2e-vsphere-ovn-etcd-scaling	add29d4	link	false	/test e2e-vsphere-ovn-etcd-scaling
ci/prow/e2e-azure-ovn-etcd-scaling	add29d4	link	false	/test e2e-azure-ovn-etcd-scaling

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[openshift-trt]

Job Failure Risk Analysis for sha: add29d4

Job Name	Failure Risk
pull-ci-openshift-origin-main-4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback	IncompleteTests Tests for this run (93) are below the historical average (217): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-etcd-scaling	Low [bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded This test has passed 50.00% of 2 runs on release 4.19 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws SecurityMode:default Topology:ha Upgrade:none] in the last week.
pull-ci-openshift-origin-main-e2e-azure-ovn-etcd-scaling	Medium [bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-disruptive	Medium [bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available Potential external regression detected for High Risk Test analysis --- [sig-node] static pods should start after being created Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling	Medium [sig-architecture] platform pods in ns/openshift-multus should not exit an excessive amount of times Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-metal-ipi-ovn-dualstack-bgp-techpreview	IncompleteTests Tests for this run (21) are below the historical average (2564): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-openstack-serial	IncompleteTests Tests for this run (104) are below the historical average (1617): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-okd-e2e-gcp	IncompleteTests Tests for this run (15) are below the historical average (64): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)