[pull] main from czlonkowski:main - #96
Merged
Merged
Conversation
* feat: add evaluation test-run methods to n8n API client Three read methods for n8n's evaluation Public API (n8n >= 2.30): listTestRuns, getTestRun, listTestCases, with types transcribed from the sanitized public DTOs. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * feat: add evaluation test-run handlers with error mapping handleListTestRuns / handleGetTestRun / handleListTestCases. 403 maps to API-key scope guidance (keys created before n8n 2.30 lack testRun scopes); 404 disambiguates pre-2.30 instances from wrong ids via the cached instance version. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * feat: add n8n_evaluations MCP tool (read evaluation test runs) Consolidated action tool: list_runs / get_run / list_cases, wired into dispatch, per-operation gating (TOOL_OPERATION_PARAM), and tool docs. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * docs: document n8n_evaluations tool; bump to 2.65.0 Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * fix: drop unrelated peer-dependency churn from package-lock.json npm install in the feature worktree added peer entries (playwright, browserbase, watsonx and friends) unrelated to this change. Restore the lockfile from main and re-apply only the version bump. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * refactor: consolidate evaluation error handling; address review findings - Consolidate the three duplicated catch blocks into handleTestRunError (follows the file's handleCrudError idiom); single computed _note - Fetch the instance version on 404 when the cache is cold, so a pre-2.30 instance gets version guidance on a session's first call - Filter-aware empty-list note (status filter no longer implies evaluations are unconfigured); 403 hint also names licensing and workflow access as causes - Validate workflowId at the first validation layer (Copilot) - Tests: empty-string coercion, cursor passthrough, filter-aware note, cold-cache version fetch incl. fetch failure, 403 on get_run Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * fix: restore package-lock.json from origin/main, not stale local main The previous restore (899c467) used the local main ref, which predated the n8n 2.30.x dependency update - npm ci failed with missing @smithy/* entries. origin/main's lockfile is what CI validated on #933; re-apply only the 2.65.0 version fields on top of it. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * fix: don't force a default limit on list_runs Live testing against a pre-2.30 instance showed the test-runs path is swallowed by the 2.29-era workflow-versions route, whose spec rejects unknown query params - so the forced limit=100 produced 'Unknown query parameter' instead of the 404 our error mapping explains. n8n's server default is the same 100; send limit only when the caller sets one. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * docs: sync n8n_evaluations skill-pack updates from n8n-skills v1.25.0 Mirrors czlonkowski/n8n-skills@05eea48 so the shipped data/skills copy matches the source: WORKFLOW_GUIDE.md section for n8n_evaluations and the router's Test & run bullet. Conceived by Romuald Członkowski - www.aiadvisors.pl/en Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> --------- Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot] (v2.0.0-alpha.4)
Can you help keep this open source service alive? 💖 Please sponsor : )