Skip to content

Add black-box e2e test for start_agent EventHandler action - #1548

Draft
kowser-orkes wants to merge 8 commits into
mainfrom
test/start-agent-blackbox-e2e
Draft

Add black-box e2e test for start_agent EventHandler action#1548
kowser-orkes wants to merge 8 commits into
mainfrom
test/start-agent-blackbox-e2e

Conversation

@kowser-orkes

@kowser-orkes kowser-orkes commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Pull Request type

  • Feature
  • Bugfix
  • Refactoring (no functional changes, no api changes)
  • Build related changes
  • WHOSUSING.md
  • Other (please describe):

NOTE: Please remember to run ./gradlew spotlessApply to fix any format violations.

Changes in this PR

  • black-box e2e test suite for the start_agent EventHandler action, against a real running server
  • drives the real trigger → queue → EventHandler → agent-config pipeline, no mocks, no in-process shortcuts
  • covers 3 outcomes off one shared trigger: bogus-model failure, blocked/terminated tool approval, live-LLM completion
                    REST startWorkflow
                            |
                            v
                 +----------------------+
                 | trigger WorkflowDef  |
                 | EVENT task           |
                 | sink: conductor      |
                 +----------------------+
                            |
                            v
                 +----------------------+
                 | conductor queue      |
                 | (QueueDAO, no infra) |
                 +----------------------+
                            |
                            v
                 +----------------------+
                 | shared EventHandler  |
                 | action: start_agent  |
                 +----------------------+
                            |
                            v
                 +-----------------------------+
                 | agent (real agent-config     |
                 | pipeline via AgentClient)    |
                 +-----------------------------+
                    /          |           \
                   v           v            v
              bogus model  prefillTools   live LLM
              -> FAILED    blocked ->     -> COMPLETED
                            TERMINATED
                    \          |           /
                     v         v          v
                 idempotencyKey -> correlationId
                            |
                            v
                 WorkflowClient.getWorkflows(...)

Issue #CCOR-13315

Depends on

  • a conductor-client release containing start_agente2e/build.gradle still pins 6.0.0.rc3, does not compile without it or a local workaround

Alternatives considered

  • hand-rolled WorkflowDef-based agent, in-process, no real queue — already covered by a separate existing in-process test
  • LocalStack SQS-backed trigger queue — unnecessary, EVENT task's sink: conductor already routes through the server's own built-in QueueDAO queue
  • unregistered-agent failure path — not black-box-observable, already covered by the existing in-process test

Ports basicAgentConfig/deployAgent/workerTool from AgentTaskTests.
e2e now depends on the local :conductor-common module, since no
published conductor-client release includes start_agent yet.
Single EventHandler + EVENT-task workflow reused across all tests to
avoid paying the 60s queue-refresh delay once per test.
Warm-up repeatedly fires a throwaway agent until the shared
EventHandler's queue is confirmed live, replacing a blind 60s sleep.
Folds stage 5's helpers in early since warm-up depends on fireStartAgent.
Bogus-model agent deployed via the real pipeline, fired through the
shared EventHandler, found via correlationId, asserted FAILED.
Blocking agent (prefillTools + unpolled worker) started through the
shared EventHandler, terminated directly via REST once RUNNING.
Real hello-world agent, live LLM, gated on OPENAI_API_KEY. Reads the
compiled agent's own output.result field for the final answer.
@kowser-orkes kowser-orkes changed the title Test/start agent blackbox e2e Add start_agent EventHandler action support Aug 19, 2026
@kowser-orkes kowser-orkes changed the title Add start_agent EventHandler action support Add black-box e2e test for start_agent EventHandler action Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant