Skip to content

Commit 69636b4

Browse files
committed
Add new flags to Experiment entity
Signed-off-by: shanaiabuggy <59746633+shanaiabuggy@users.noreply.github.com>
1 parent d050f3f commit 69636b4

32 files changed

Lines changed: 1378 additions & 133 deletions

File tree

docs/cli/reference.mdx

Lines changed: 10 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6045,7 +6045,9 @@ nemo experiments create [OPTIONS] [NAME]
60456045
* `--workspace`
60466046
* `--default-sort`: Default sort for this experiment's evaluations list, as a `sort`-param string: a comma-separated, ordered list of fields where the first is the primary sort and the rest break ties (leading '-' on a field = descending), e.g. '-evaluators.reward.mean,cost_usd.mean'. Defaults to '-created_at'. Accepts any field the evaluations list `sort` param does; clients apply it as the list `sort` param.
60476047
* `--description`: Human-readable purpose of the experiment.
6048+
* `--evaluate-over-time`: Whether this Experiment should display Evaluation results over time.
60486049
* `--insight-id`: Reference to an external insight that seeded this experiment, if any.
6050+
* `--is-favorite`: Whether this Experiment is marked as a favorite.
60496051
* `--metadata`: Free-form producer metadata for the experiment. (JSON string)
60506052
* `--pareto`: Default X/Y metrics for a group's cost-vs-accuracy Pareto view. Metric ids use the same vocabulary as the evaluations list sort/filter fields — `cost_usd`, `latency_ms`, or `evaluators.<name>`. Defaults to cost (x) vs latency (y): both exist for every group, so the chart always has something to render before anyone customizes it. (JSON string)
60516053
* `--summary`: Human- or agent-authored summary of the experiment's findings.
@@ -6110,9 +6112,12 @@ nemo experiments list [OPTIONS]
61106112
JSON-only fields:
61116113
metadata: dict[str, str]
61126114

6113-
Filter experiments by name, insight_id, is_deleted, or a metadata key/value (filter[metadata.\<key>]=\<value>). Pass is_deleted=true to return only soft-deleted experiments; omit to see only live ones.
6115+
Filter experiments by name, insight_id, is_favorite, evaluate_over_time, baseline_evaluation_name, is_deleted, or a metadata key/value (filter[metadata.\<key>]=\<value>). Pass is_deleted=true to return only soft-deleted experiments; omit to see only live ones.
6116+
* `--filter.baseline-evaluation-name`
6117+
* `--filter.evaluate-over-time`
61146118
* `--filter.insight-id`
61156119
* `--filter.is-deleted`
6120+
* `--filter.is-favorite`
61166121
* `--filter.name`
61176122

61186123
**Help:**
@@ -6181,9 +6186,12 @@ nemo experiments update [OPTIONS] PATH_NAME
61816186

61826187
* `--workspace`
61836188
* `--body-name`: Workspace-unique experiment name.
6189+
* `--baseline-evaluation-name`: Name of this Experiment's baseline Evaluation. The Evaluation must already be a live member of the Experiment. Set null to clear the selected baseline.
61846190
* `--default-sort`: Default sort for this experiment's evaluations list, as a `sort`-param string: a comma-separated, ordered list of fields where the first is the primary sort and the rest break ties (leading '-' on a field = descending), e.g. '-evaluators.reward.mean,cost_usd.mean'. Defaults to '-created_at'. Accepts any field the evaluations list `sort` param does; clients apply it as the list `sort` param.
61856191
* `--description`: Human-readable purpose of the experiment.
6192+
* `--evaluate-over-time`: Whether this Experiment should display Evaluation results over time.
61866193
* `--insight-id`: Reference to an external insight that seeded this experiment, if any.
6194+
* `--is-favorite`: Whether this Experiment is marked as a favorite.
61876195
* `--metadata`: Free-form producer metadata for the experiment. (JSON string)
61886196
* `--pareto`: Default X/Y metrics for a group's cost-vs-accuracy Pareto view. Metric ids use the same vocabulary as the evaluations list sort/filter fields — `cost_usd`, `latency_ms`, or `evaluators.<name>`. Defaults to cost (x) vs latency (y): both exist for every group, so the chart always has something to render before anyone customizes it. (JSON string)
61896197
* `--summary`: Human- or agent-authored summary of the experiment's findings.
@@ -6811,7 +6819,7 @@ nemo intake ingest spans create [OPTIONS]
68116819
**Options:**
68126820

68136821
* `--workspace`
6814-
* `--source`: (required)
6822+
* `--source`: Stable name for the source trace store, such as `langsmith` or `mlflow`.
68156823
* `--spans`: JSON string
68166824

68176825
**Help:**

openapi/ga/individual/platform.openapi.yaml

Lines changed: 118 additions & 5 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)