Skip to content

chore(weekly-232): demote @stable on 2 tests broken by upstream Langflow changes - #272

Merged
Victor-w-Madeira merged 1 commit into
mainfrom
chore/weekly-232-demote-stable
May 18, 2026
Merged

chore(weekly-232): demote @stable on 2 tests broken by upstream Langflow changes#272
Victor-w-Madeira merged 1 commit into
mainfrom
chore/weekly-232-demote-stable

Conversation

@Victor-w-Madeira

Copy link
Copy Markdown
Collaborator

Summary

  • Removes @stable from two tests that now fail against langflowai/langflow-nightly:latest due to intentional upstream Langflow changes.
  • Unblocks the weekly-stable workflow so it stops opening duplicate failure issues every Monday until the fixes land.
  • Fix work tracked in dedicated issues — @stable is re-added there.

Failing tests demoted

Test Upstream change Fix issue
webhook-component-regression.spec.ts:258 — POST to non-existent flow returns 404 Langflow #12845: WEBHOOK_AUTH_ENABLE defaults to True; unauth POST → 403 before flow lookup #269
provider-invalid-auth-error.spec.ts:84 — clicks icon-Brain in Settings sidebar Langflow #13111: icon renamed BrainBrainCircuit #270

The 6 flaky tests from the same weekly run remain @stable (single flake does not trigger demotion per the lifecycle rule). Investigation tracked in #271.

Test plan

  • npm run typecheck — no errors
  • npm run lint — 0 errors (pre-existing warnings unchanged)
  • Next weekly-stable run no longer reports these two tests as @stable failures

Closes #232

…w changes

Both tests fail against the current Langflow nightly due to intentional
upstream changes, not test bugs of our own logic:

- webhook 404 test: Langflow PR #12845 flipped WEBHOOK_AUTH_ENABLE default
  to True, so unauthenticated POSTs now return 403 before the flow lookup.
  Fix tracked in #269.
- provider-invalid-auth icon click: Langflow PR #13111 renamed the Model
  Providers icon from Brain to BrainCircuit. Fix tracked in #270.

Removing @stable so weekly-stable stops opening duplicate issues until the
fixes land. Tag re-added in the respective fix PRs.

Closes #232
@Victor-w-Madeira
Victor-w-Madeira merged commit d5122cc into main May 18, 2026
2 checks passed
@Victor-w-Madeira
Victor-w-Madeira deleted the chore/weekly-232-demote-stable branch May 18, 2026 21:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Weekly Failure] @stable tests failed on 2026-05-18 (langflow:latest)

1 participant