Playwright end-to-end test suite #2
e2e.yml
on: pull_request
Matrix: e2e-mocked
E2E A11y + Visual
1m 8s
E2E Integration (opt-in)
0s
Merge E2E Reports
18s
Annotations
5 errors, 6 warnings, and 6 notices
|
E2E A11y + Visual
Process completed with exit code 1.
|
|
[visual] › e2e/tests/visual/pages.spec.ts:27:3 › Visual - landing pages › settings rag configuration:
frontend/e2e/tests/visual/pages.spec.ts#L31
2) [visual] › e2e/tests/visual/pages.spec.ts:27:3 › Visual - landing pages › settings rag configuration
Error: A snapshot doesn't exist at /home/runner/work/rag/rag/frontend/e2e/tests/__snapshots__/visual/pages.spec.ts/settings-rag.png, writing actual.
29 | await settings.goto();
30 |
> 31 | await expect(page).toHaveScreenshot('settings-rag.png', {
| ^
32 | fullPage: true,
33 | maxDiffPixelRatio: 0.02,
34 | animations: 'disabled',
at /home/runner/work/rag/rag/frontend/e2e/tests/visual/pages.spec.ts:31:5
|
|
[visual] › e2e/tests/visual/pages.spec.ts:15:3 › Visual - landing pages › chat empty state:
frontend/e2e/tests/visual/pages.spec.ts#L20
1) [visual] › e2e/tests/visual/pages.spec.ts:15:3 › Visual - landing pages › chat empty state ────
Error: A snapshot doesn't exist at /home/runner/work/rag/rag/frontend/e2e/tests/__snapshots__/visual/pages.spec.ts/chat-empty-state.png, writing actual.
18 | await chat.goto();
19 |
> 20 | await expect(page).toHaveScreenshot('chat-empty-state.png', {
| ^
21 | fullPage: true,
22 | maxDiffPixelRatio: 0.02,
23 | animations: 'disabled',
at /home/runner/work/rag/rag/frontend/e2e/tests/visual/pages.spec.ts:20:5
|
|
E2E (mocked, shard 2/4)
Process completed with exit code 1.
|
|
[chromium] › e2e/tests/navigation/navigation.spec.ts:17:3 › Navigation - top-level routes › settings toggle switches between / and /settings:
frontend/e2e/tests/navigation/navigation.spec.ts#L26
1) [chromium] › e2e/tests/navigation/navigation.spec.ts:17:3 › Navigation - top-level routes › settings toggle switches between / and /settings
Error: expect(page).toHaveURL(expected) failed
Expected pattern: /\/$/
Received string: "http://localhost:3000/settings"
Timeout: 10000ms
Call log:
- Expect "toHaveURL" with timeout 10000ms
14 × unexpected value "http://localhost:3000/settings"
24 |
25 | await page.getByTestId('settings-toggle').click();
> 26 | await expect(page).toHaveURL(/\/$/);
| ^
27 | });
28 |
29 | test('direct navigation to /collections/new renders the new-collection page', async ({
at /home/runner/work/rag/rag/frontend/e2e/tests/navigation/navigation.spec.ts:26:24
|
|
E2E A11y + Visual
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
E2E (mocked, shard 1/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
E2E (mocked, shard 4/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
E2E (mocked, shard 2/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
E2E (mocked, shard 3/4)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4, actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Merge E2E Reports
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, pnpm/action-setup@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
🎭 Playwright Run Summary
2 failed
[visual] › e2e/tests/visual/pages.spec.ts:15:3 › Visual - landing pages › chat empty state ─────
[visual] › e2e/tests/visual/pages.spec.ts:27:3 › Visual - landing pages › settings rag configuration
|
|
🎭 Playwright Run Summary
3 passed (10.3s)
|
|
🎭 Playwright Run Summary
30 passed (34.2s)
|
|
🎭 Playwright Run Summary
29 passed (47.6s)
|
|
🎭 Playwright Run Summary
1 failed
[chromium] › e2e/tests/navigation/navigation.spec.ts:17:3 › Navigation - top-level routes › settings toggle switches between / and /settings
29 passed (39.5s)
|
|
🎭 Playwright Run Summary
29 passed (59.8s)
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
blob-report-1
Expired
|
202 KB |
sha256:b9734d906c8989152b82692dfbfe5334857005f6a274d948e0c17d206c844077
|
|
|
blob-report-2
Expired
|
378 KB |
sha256:8c5bec458403af2a975cc24468bb64253cfbb6651209c06836b8160d9e629263
|
|
|
blob-report-3
Expired
|
170 KB |
sha256:afef66049808c2a42a6ef753da1be575449c1637c25e5094f9409f3249d90071
|
|
|
blob-report-4
Expired
|
80.4 KB |
sha256:0c932098918c6000f0d22cc86ccd2a7cd5913c7cf4fdf7449b9524d514015e4b
|
|
|
html-report--attempt-1
Expired
|
658 KB |
sha256:8f93b432b8ea7799dcfdb92c51ec4dbe3fa2a6f0c60a82681d577c9371d30ac3
|
|
|
playwright-report-2
Expired
|
493 KB |
sha256:39ee422ef8b7626e102d866e81ca59042d13a9f6bd7a4cf301694e5493eca985
|
|
|
test-results-2
Expired
|
240 KB |
sha256:c78fc242a51ec6a940feec0566acb1cd4f45addd431aba0520c44235e707b3a3
|
|