Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

TypeAgent SDK Interfaces and Utilities

This package contains interface definitions and utilities for implementing a Dispatcher Agent.

  • List agent is a good example and initial template for building a dispatcher agent.
  • The Dispatcher README contains instructions on how to register a dispatcher agent with the TypeAgent Dispatcher.
  • You can also create agents as NPM packages that can be installed/register to the Shell or CLI

TypeAgent SDK

To build a dispatcher agent, you provide a manifest and an instantiation entry point for your agent.
These are declared in the package.json as export paths:

  • ./agent/manifest - The location of the JSON file for the manifest.
  • ./agent/handlers - an ESM module with an instantiation entry point.

Manifest

When loading dispatcher agent in a NPM package, the dispatcher first loads the manifest from the agent. It contains definition of the emoji representing the agent and the translator configuration for the agent. See the type AppAgentManifest and ActionManifest for the detail.

Instantiation Entry point

AppAgent is the main interface that your agent implements.

The instantiation entry point is the code entry point for an app agent. After loading the ./agent/handlers ESM module, the instantiate function will be called to get an instance of the AppAgent. The AppAgent provides these optional APIs:

Lifecycle APIs:

  • initializeAgentContext - Dispatcher will call after the agent is loaded. It is expected to create a context that will be passed back on all subsequent call to other APIs.
  • updateAgentContext - A signal indicating whether the action is enabled or disabled for the agent, allowing it to manage resources such as login. The dispatcher calls this function during initialization or when the user enables or disables actions for the dispatcher agent. Each sub-schema can be enabled or disabled independently and the dispatcher will call this API once for each sub-translator. The schemaName parameter can be used to distinguish the sub-schema.
  • closeAgentContext - Called when the AppAgent is not longer needed to release resources.

Command APIs:

  • getCommands - If the AppAgent want to provide @ commands, this function should return CommandDescriptors.
  • executeCommand - Dispatcher will call this function after parsing the command based ont he CommandDescriptors and provide the agent ParsedCommandParams to execute the command.

Action API:

  • executeAction - After the dispatcher translates a user request using the provided translator schema in the manifest, it will route to the agent and call this function to perform the action. All sub-translator actions route to the same API, and the agent will need to handle further routing to handlers.
  • streamPartialAction - For cases action can be handled while the translation result is being streamed from the LLM. Look at chat.generateResponse as an example.

Readiness / Setup APIs:

  • checkReadiness — Cheap probe (file-existence / env-var read level) that reports whether the agent can actually run. Returns a ReadinessReport with state "ready" / "setup-required" / "unsupported". The dispatcher caches the result and pre-flights it before every action and command, blocking execution with a friendly error when the agent isn't ready. Agents that don't implement it default to "ready".
  • setup — Optional in-chat configuration flow that brings the agent from "setup-required" to "ready". Returns an ActionResult, so it can use the yes/no choice card pattern (createYesNoChoiceResult) to confirm before doing real work. The dispatcher refreshes readiness automatically after setup returns AND after the user's choice click resolves, so deferred work behind a choice card still ends with a fresh readiness state.
  • handleChoice — Routes the user's yes/no (or multi-choice) response back to the agent's ChoiceManager so the registered callback can run. Required if setup (or any other action) emits a pendingChoice.

player (packages/agents/player) and osNotifications (packages/agents/osNotifications) are the canonical examples — player shows the manual-config shape (env vars, no setup hook — point the user at @config agent refresh after editing .env), and osNotifications shows the in-chat-setup shape (yes/no card → defer work into handleChoice, mutex-protected).

Onboarding rollout

Agents we plan to onboard, ordered by impact (silent-failure cases first). Mark off as we land each.

  • player — Spotify env vars (SPOTIFY_APP_CLI, SPOTIFY_APP_CLISEC, SPOTIFY_APP_PORT). Manual config; no setup hook.
  • osNotifications — Windows helper exe (WinAppSDK sparse package). setup runs dotnet publish + sign + register.
  • screencapture — ffmpeg + platform CLIs (wmctrl/xdotool on Linux). setup runs winget on Windows / sudo -n apt-get on Linux. Wayland and macOS report "unsupported".
  • github-cligh auth status probe distinguishes ENOENT (not installed) from non-zero exit (not authenticated). setup handles the not-installed case via winget on Windows / apt-get on Linux (yes/no card → install with progress streaming + mutex). The not-authenticated case stays manual — gh auth login is an interactive browser flow that doesn't drive cleanly from chat.
  • desktopautoShell.exe (.NET, Windows-only). "unsupported" on macOS/Linux; "setup-required" when the binary hasn't been built; setup runs dotnet build on dotnet/autoShell/autoShell.csproj.
  • calendar + email — Microsoft Graph or Google OAuth. Shared evaluator in graph-utils/readiness.ts (evaluateGraphReadiness + probeGraphConfig) reports setup-required for missing env vars (manual config) and unauthenticated providers (in-chat sign-in via yes/no card → provider.login() device-code flow).
  • code — VS Code extension WebSocket. The agent IS the WebSocket server; "ready" means the Coda extension client has an open connection. setup spawns code --new-window and polls the server for client connection up to 30s (yes/no card → poll w/ progress).
  • browser — TypeAgent browser extension WebSocket OR in-process BrowserControl (Electron-shell mode). Either path means ready. No setup hook (browser extensions can't be launched programmatically). The not-ready message branches on browser-seen.json in instanceStorage: first-time user (file absent) gets install-the-extension instructions; returning user (file present) gets a transient "open your browser" message — file gets stamped on every successful client connect via onClientConnected.
  • playerLocal — needs one of afplay / mpv / ffplay / VLC depending on platform. Falls back gracefully today; upfront guidance would help.
  • markdown / montage — local-view subprocess + port. Low priority; subprocess lifecycle makes this trickier.
  • image — relies on the dispatcher's OpenAI key. No agent-local readiness probe today.

Cache extensions:

  • validateWildcardMatch - For parameters is can be wildcards, this function provide the agent to validate the wildcard match from the cache to avoid over generalization.

Output:

  • getDynamicDisplay - For command/action result that needs to be updated periodically, the host will call this function to get the updated display.

SessionContext/ActionContext

Display provide context objects to for display and storage functionality. It also tracks a "agent context" object the agent provided during initializeAgentContext for the agent to store runtime data between these calls.

Display (ActionContext.actionIO)

During execution of action or command, an ActionContext is provided with an actionIO object to display information to the user.

setDisplay - replace the display with the message appendDisplay - append to the display message

Display message is of type DisplayContent and can be simple MessageContent of text of any string, multi-line string[], or a table of string[][]. DisplayContext can also be an object to specify addition information about the message:

  • DisplayMessageKind - automatic formatting of message based on kind (info, status, warning, error, success).
  • DisplayType - text, html or iframe (html content will be sanitize for security, iframe will be rendered in an iframe, and both only work in hosts that supports it (e.g. Shell))

Helper functions is available to help craft the DisplayContent object imported from @typeagent/agent-sdk/helpers/display. See displayHelpers.ts.

Storage (ActionContext.instanceStorage and ActionContext.sessionStorage)

During execution of action or command, an ActionContext is provided with instanceStorage and optionally sessionStorage to persist data. Agent may be running in a isolated environment that doesn't have permanent storage or access to storage.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.