Summary
The auth-react end-to-end spec test/end-to-end/multitenancy.tenant_interactions.test.js fails intermittently across most FDI versions (1.18, 1.19, 3.0, 4.1 observed failing; 1.17, 4.0, 4.2 observed passing) under the fastapi test server matrix. The action's built-in 3-attempt retry doesn't recover it consistently.
Failure shape
Two alternating failures across retries:
TimeoutError: waiting for selector \.logoutButton` failed: timeout 30000ms exceeded`
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: (no further detail in CI log)
Both look like classic UI-timing flake on the React side, not a Python server bug. The Python test server does not appear to be the proximate cause — the .logoutButton is rendered by the upstream auth-react test fixture.
Workaround
Filtered out of the auth-react matrix in .github/workflows/auth-react-test-1.yml via a `jq` post-processing step on the spec list. Search the workflow for `Filter known-flaky specs` to find the chokepoint.
Resolution path
- Investigate root cause in the upstream `supertokens-auth-react` test (likely a missing wait, race on tenant context switch, or selector that changed semantics).
- Patch the test there.
- Backport the fix across the affected FDI lines.
- Remove the workflow filter once landed.
Related
Summary
The auth-react end-to-end spec
test/end-to-end/multitenancy.tenant_interactions.test.jsfails intermittently across most FDI versions (1.18, 1.19, 3.0, 4.1 observed failing; 1.17, 4.0, 4.2 observed passing) under the fastapi test server matrix. The action's built-in 3-attempt retry doesn't recover it consistently.Failure shape
Two alternating failures across retries:
TimeoutError: waiting for selector \.logoutButton` failed: timeout 30000ms exceeded`AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:(no further detail in CI log)Both look like classic UI-timing flake on the React side, not a Python server bug. The Python test server does not appear to be the proximate cause — the
.logoutButtonis rendered by the upstream auth-react test fixture.Workaround
Filtered out of the auth-react matrix in
.github/workflows/auth-react-test-1.ymlvia a `jq` post-processing step on the spec list. Search the workflow for `Filter known-flaky specs` to find the chokepoint.Resolution path
Related