Skip to content

Latest commit

 

History

History
54 lines (27 loc) · 1.08 KB

File metadata and controls

54 lines (27 loc) · 1.08 KB
title Relay Streaming
slug /reference/api/python-library-reference/streaming
description Consume raw NVIDIA NeMo Relay ATOF records and terminal invocation results.

module nemo_fabric.streaming

NeMo Relay streaming support for the NVIDIA NeMo Fabric Python SDK.


class InvokeStream

Async iterator of raw ATOF records for one runtime invocation.

Consume the final normalized result separately with :meth:result. If iteration stops early, call :meth:aclose before starting another turn.


method aclose

async def aclose() -> None

Stop iteration and drain this turn without cancelling the invocation.


method result

async def result() -> RunResult

Return the terminal normalized result without adding it to the stream.


This file was automatically generated via lazydocs.