Tests run faster and more reliable

[jlpadilla]

Changes

• Add a delay before retrying failed tests.
• In the query tests, replace the fixed wait after setup with better logic to wait until search index is updated.

[smcavey]

Only took +40 seconds running the api tests but that's before the additional api tests you added yesterday and everything passed, so /lgtm

[smcavey]

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jlpadilla, smcavey

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• OWNERS [jlpadilla,smcavey]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[jlpadilla]

/test deploy-and-run-e2e

[jlpadilla]

/test deploy-and-run-e2e

[jlpadilla]

/test deploy-and-run-e2e

[jlpadilla]

/test deploy-and-run-e2e

[openshift-ci]

New changes are detected. LGTM label has been removed.

[smcavey]

/test deploy-and-run-e2e

[jlpadilla]

/test deploy-and-run-e2e
Only 1 API test failed last time.

should match deployments where available < 3

[jlpadilla]

/test deploy-and-run-e2e
Last test failed deploying ACM.

[jlpadilla]

/test deploy-and-run-e2e-api

[jlpadilla]

/test deploy-and-run-e2e-api

[jlpadilla]

/test deploy-and-run-e2e-api

Last attempt failed deploying ACM.

[jlpadilla]

/retest

[openshift-ci]

@jlpadilla: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/deploy-and-run-e2e-api	b06768d	link	true	/test deploy-and-run-e2e-api
ci/prow/deploy-and-run-e2e	b06768d	link	true	/test deploy-and-run-e2e

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[openshift-ci]

PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.