A real-time AI video processing plugin for Unity. Apply live generative AI effects to your camera using diffusion models powered by Daydream.
- Real-time AI image-to-image transformation via WebRTC
- Multiple prompt scheduling with weighted interpolation
- ControlNet support (depth, canny, tile, and more)
- IP-Adapter for image-guided generation
- Low-latency streaming (WHIP/WHEP)
- Works with URP, HDRP, and Built-in render pipelines
- Unity 6 (6000.x)
- com.unity.webrtc 3.0.0
- A Daydream account
Open Window > Package Manager, click + > Add package from git URL..., and enter:
https://github.com/daydreamlive/daydream-unity.git
Also install the WebRTC package if not already present.
- Add the Daydream component to any Camera
- Press Play — a browser window opens for login
- Sign in with your Daydream account
Credentials are saved to ~/.daydream/credentials and shared across Daydream plugins (Unity, OBS, TouchDesigner). Subsequent launches skip the login step.
To use an API key directly, paste it into the API Key field in the Inspector.
The camera output is sent to the Daydream API for AI transformation, and the result is displayed as a fullscreen overlay. A picture-in-picture view shows the original camera feed.
All parameters are exposed in the Inspector on the Daydream component:
| Section | Parameters |
|---|---|
| Model | Model ID, Resolution |
| Prompt | Prompt, Negative Prompt |
| Generation | Guidance Scale, Delta, Seed, Inference Steps, Step Schedule, Noise |
| Prompt Schedule | Weighted prompt entries, Interpolation method |
| Seed Schedule | Weighted seed entries, Interpolation method |
| ControlNet | Model, Conditioning Scale, Preprocessor per ControlNet |
| IP Adapter | Scale, Type, Weight Type, Style Image URL |
| Display | Overlay toggle, PIP toggle, PIP size |
var effect = GetComponent<Daydream>();
Texture aiOutput = effect.OutputTexture;Set showOverlay = false to disable the built-in overlay and render the AI output on any surface.
Import the Demo Scene sample from the Package Manager to get WASD + mouse camera controls and sample geometry for testing. Requires the Input System package.
See LICENSE for details.