Support reference-to-video generation through WanGP - #14
Merged
Merged
Conversation
This was referenced Sep 10, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The combined WanGP provider now accepts reference images and video clips without assigning them a start-frame role. Discovery advertises
reference_to_videoonly when the model metadata supplies usable reference modes. The adapter preserves image and video order, validates supported kinds and counts, maps images toimage_refs, and maps one or two videos tovideo_guide/video_guide2.Mappings were checked against the Docker-pinned WanGP revision
362c3467a70e1136ceb52eec95907205a8f88543. Its reference-video modes areV-UandV+-U, correcting the design draft's assumed mode names. Generic control modeGVis excluded. Mixed references retain the image mode, and soundtrack conditioning uses the advertisedKaudio mode only when requested. Start-frame generation retainsimage_startandS.The Docker image advertises the new capability and pins nodetool-core commit
e730deb52b4f4bb9c90fb8db714a597d87c58ee9from nodetool-ai/nodetool-core#1057. Merge that worker prerequisite first. WanGP itself remains unmodified and isolated in its existing interpreter.Validation: 134 Python tests passed, Ruff and Ty passed, and the public-package import boundary check returned no forbidden imports. Tests consume a metadata fixture extracted and normalized from the pinned upstream source. A real TypeScript bridge → Python worker → combined adapter integration passed image-only, video-only, two-video, mixed, soundtrack on/off, chunked output, and temporary-file cleanup. The upstream session was simulated, so this does not claim a Docker build or live GPU generation.
Companion TypeScript bridge: nodetool-ai/nodetool#5698.