Skip to content

Playwright end-to-end test suite #2

Playwright end-to-end test suite

Playwright end-to-end test suite #2

Triggered via pull request April 28, 2026 17:26
Status Failure
Total duration 2m 47s
Artifacts 7

e2e.yml

on: pull_request
Matrix: e2e-mocked
E2E A11y + Visual
1m 8s
E2E A11y + Visual
E2E Integration (opt-in)
0s
E2E Integration (opt-in)
Merge E2E Reports
18s
Merge E2E Reports
Fit to window
Zoom out
Zoom in

Annotations

5 errors, 6 warnings, and 6 notices
E2E A11y + Visual
Process completed with exit code 1.
[visual] › e2e/tests/visual/pages.spec.ts:27:3 › Visual - landing pages › settings rag configuration: frontend/e2e/tests/visual/pages.spec.ts#L31
2) [visual] › e2e/tests/visual/pages.spec.ts:27:3 › Visual - landing pages › settings rag configuration Error: A snapshot doesn't exist at /home/runner/work/rag/rag/frontend/e2e/tests/__snapshots__/visual/pages.spec.ts/settings-rag.png, writing actual. 29 | await settings.goto(); 30 | > 31 | await expect(page).toHaveScreenshot('settings-rag.png', { | ^ 32 | fullPage: true, 33 | maxDiffPixelRatio: 0.02, 34 | animations: 'disabled', at /home/runner/work/rag/rag/frontend/e2e/tests/visual/pages.spec.ts:31:5
[visual] › e2e/tests/visual/pages.spec.ts:15:3 › Visual - landing pages › chat empty state: frontend/e2e/tests/visual/pages.spec.ts#L20
1) [visual] › e2e/tests/visual/pages.spec.ts:15:3 › Visual - landing pages › chat empty state ──── Error: A snapshot doesn't exist at /home/runner/work/rag/rag/frontend/e2e/tests/__snapshots__/visual/pages.spec.ts/chat-empty-state.png, writing actual. 18 | await chat.goto(); 19 | > 20 | await expect(page).toHaveScreenshot('chat-empty-state.png', { | ^ 21 | fullPage: true, 22 | maxDiffPixelRatio: 0.02, 23 | animations: 'disabled', at /home/runner/work/rag/rag/frontend/e2e/tests/visual/pages.spec.ts:20:5
E2E (mocked, shard 2/4)
Process completed with exit code 1.
[chromium] › e2e/tests/navigation/navigation.spec.ts:17:3 › Navigation - top-level routes › settings toggle switches between / and /settings: frontend/e2e/tests/navigation/navigation.spec.ts#L26
1) [chromium] › e2e/tests/navigation/navigation.spec.ts:17:3 › Navigation - top-level routes › settings toggle switches between / and /settings Error: expect(page).toHaveURL(expected) failed Expected pattern: /\/$/ Received string: "http://localhost:3000/settings" Timeout: 10000ms Call log: - Expect "toHaveURL" with timeout 10000ms 14 × unexpected value "http://localhost:3000/settings" 24 | 25 | await page.getByTestId('settings-toggle').click(); > 26 | await expect(page).toHaveURL(/\/$/); | ^ 27 | }); 28 | 29 | test('direct navigation to /collections/new renders the new-collection page', async ({ at /home/runner/work/rag/rag/frontend/e2e/tests/navigation/navigation.spec.ts:26:24
E2E A11y + Visual
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
E2E (mocked, shard 1/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
E2E (mocked, shard 4/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
E2E (mocked, shard 2/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
E2E (mocked, shard 3/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Merge E2E Reports
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
🎭 Playwright Run Summary
2 failed [visual] › e2e/tests/visual/pages.spec.ts:15:3 › Visual - landing pages › chat empty state ───── [visual] › e2e/tests/visual/pages.spec.ts:27:3 › Visual - landing pages › settings rag configuration
🎭 Playwright Run Summary
3 passed (10.3s)
🎭 Playwright Run Summary
30 passed (34.2s)
🎭 Playwright Run Summary
29 passed (47.6s)
🎭 Playwright Run Summary
1 failed [chromium] › e2e/tests/navigation/navigation.spec.ts:17:3 › Navigation - top-level routes › settings toggle switches between / and /settings 29 passed (39.5s)
🎭 Playwright Run Summary
29 passed (59.8s)

Artifacts

Produced during runtime
Name Size Digest
blob-report-1 Expired
202 KB
sha256:b9734d906c8989152b82692dfbfe5334857005f6a274d948e0c17d206c844077
blob-report-2 Expired
378 KB
sha256:8c5bec458403af2a975cc24468bb64253cfbb6651209c06836b8160d9e629263
blob-report-3 Expired
170 KB
sha256:afef66049808c2a42a6ef753da1be575449c1637c25e5094f9409f3249d90071
blob-report-4 Expired
80.4 KB
sha256:0c932098918c6000f0d22cc86ccd2a7cd5913c7cf4fdf7449b9524d514015e4b
html-report--attempt-1 Expired
658 KB
sha256:8f93b432b8ea7799dcfdb92c51ec4dbe3fa2a6f0c60a82681d577c9371d30ac3
playwright-report-2 Expired
493 KB
sha256:39ee422ef8b7626e102d866e81ca59042d13a9f6bd7a4cf301694e5493eca985
test-results-2 Expired
240 KB
sha256:c78fc242a51ec6a940feec0566acb1cd4f45addd431aba0520c44235e707b3a3