argo-workflows: Intermittent failures in CI E2E tests
The CI end to end tests often fail, but then pass after an empty commit is added. We need to determine if for each failure the issue is the test or an actual race condition in the code that behaves differently each time.
We can add new occurrences over time here:
-
test-functional, minimal-
test:
TestSubmitWorkflowTemplateWithEnum -
what happened:
panic: test timed out after 15m0s -
link: https://github.com/argoproj/argo-workflows/runs/7011970939?check_suite_focus=true
-
test:
TestParametrizableAds -
what happened:
Error: "" does not contain "Pod was active on the node longer than the specified deadline" -
link: https://github.com/argoproj/argo-workflows/runs/7332294820?check_suite_focus=true
-
test:
AgentSuite/TestParallel -
what happened:
line 67: "Should be true" -
link: https://github.com/argoproj/argo-workflows/runs/7698020976?check_suite_focus=true
-
link: https://github.com/argoproj/argo-workflows/runs/7736452278?check_suite_focus=true
-
-
test-cli, mysql-
test:
TestCLISuite/TestNodeSuspendResume -
what happened:
timeout after 1m at WaitForWorkflow() -
link: https://github.com/argoproj/argo-workflows/runs/7365382562?check_suite_focus=true
-
test:
TestCLISuite/TestWorkflowRetry -
what happened:
failure at: assert.True(t, retryTime.Before(&innerStepsPodNode.FinishedAt)), line 866 -
link: https://github.com/argoproj/argo-workflows/runs/7434857876?check_suite_focus=true
-
-
test-executor, minimal-
test: N/A
-
what happened: no test ever got run; timed out after 24m in the “actions/cache@v3” step
-
link: https://github.com/argoproj/argo-workflows/runs/7435503575?check_suite_focus=true
-
official issue - https://github.com/actions/cache/issues/810
-
test:
SignalsSuite/TestStopBehavior -
what happened:
signals_test.go:34: timeout after 1m40s waiting for condition -
link: https://github.com/argoproj/argo-workflows/runs/7459797029?check_suite_focus=true
-
-
test-examples, minimal- test:
examples/arguments-parameters-from-configmap.yaml - what happened:
error: timed out waiting for the condition on workflows/conditional-artifacts-svhsv - link: https://github.com/argoproj/argo-workflows/runs/7643995231?check_suite_focus=true
- test:
-
test-api, example- step:
make wait - what happened:
the action has timed out - link: https://github.com/argoproj/argo-workflows/runs/7660935659?check_suite_focus=true
- step:
About this issue
- Original URL
- State: closed
- Created 4 years ago
- Reactions: 4
- Comments: 22 (15 by maintainers)
Yeah, this is not stale. What is? Also: https://drewdevault.com/2021/10/26/stalebot.html
still hoping to address this when I have time if nobody else does, so keeping it alive