Skip to content

Commit a10e4c9

Browse files
committed
use show_evaluations_over_time
Signed-off-by: shanaiabuggy <59746633+shanaiabuggy@users.noreply.github.com>
1 parent 69636b4 commit a10e4c9

18 files changed

Lines changed: 275 additions & 195 deletions

File tree

docs/cli/reference.mdx

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -6045,11 +6045,11 @@ nemo experiments create [OPTIONS] [NAME]
60456045
* `--workspace`
60466046
* `--default-sort`: Default sort for this experiment's evaluations list, as a `sort`-param string: a comma-separated, ordered list of fields where the first is the primary sort and the rest break ties (leading '-' on a field = descending), e.g. '-evaluators.reward.mean,cost_usd.mean'. Defaults to '-created_at'. Accepts any field the evaluations list `sort` param does; clients apply it as the list `sort` param.
60476047
* `--description`: Human-readable purpose of the experiment.
6048-
* `--evaluate-over-time`: Whether this Experiment should display Evaluation results over time.
60496048
* `--insight-id`: Reference to an external insight that seeded this experiment, if any.
6050-
* `--is-favorite`: Whether this Experiment is marked as a favorite.
6049+
* `--is-favorite`: Whether this Experiment is marked as a favorite. Defaults to false on create; omit on update to preserve the existing value.
60516050
* `--metadata`: Free-form producer metadata for the experiment. (JSON string)
60526051
* `--pareto`: Default X/Y metrics for a group's cost-vs-accuracy Pareto view. Metric ids use the same vocabulary as the evaluations list sort/filter fields — `cost_usd`, `latency_ms`, or `evaluators.<name>`. Defaults to cost (x) vs latency (y): both exist for every group, so the chart always has something to render before anyone customizes it. (JSON string)
6052+
* `--show-evaluations-over-time`: Whether Studio should display this Experiment's Evaluation results over time. Defaults to false on create; omit on update to preserve the existing value.
60536053
* `--summary`: Human- or agent-authored summary of the experiment's findings.
60546054
* `--exist-ok`: Do not raise an error if the resource already exists. Returns the existing resource.
60556055

@@ -6112,13 +6112,13 @@ nemo experiments list [OPTIONS]
61126112
JSON-only fields:
61136113
metadata: dict[str, str]
61146114

6115-
Filter experiments by name, insight_id, is_favorite, evaluate_over_time, baseline_evaluation_name, is_deleted, or a metadata key/value (filter[metadata.\<key>]=\<value>). Pass is_deleted=true to return only soft-deleted experiments; omit to see only live ones.
6115+
Filter experiments by name, insight_id, is_favorite, show_evaluations_over_time, baseline_evaluation_name, is_deleted, or a metadata key/value (filter[metadata.\<key>]=\<value>). Pass is_deleted=true to return only soft-deleted experiments; omit to see only live ones.
61166116
* `--filter.baseline-evaluation-name`
6117-
* `--filter.evaluate-over-time`
61186117
* `--filter.insight-id`
61196118
* `--filter.is-deleted`
61206119
* `--filter.is-favorite`
61216120
* `--filter.name`
6121+
* `--filter.show-evaluations-over-time`
61226122

61236123
**Help:**
61246124

@@ -6189,11 +6189,11 @@ nemo experiments update [OPTIONS] PATH_NAME
61896189
* `--baseline-evaluation-name`: Name of this Experiment's baseline Evaluation. The Evaluation must already be a live member of the Experiment. Set null to clear the selected baseline.
61906190
* `--default-sort`: Default sort for this experiment's evaluations list, as a `sort`-param string: a comma-separated, ordered list of fields where the first is the primary sort and the rest break ties (leading '-' on a field = descending), e.g. '-evaluators.reward.mean,cost_usd.mean'. Defaults to '-created_at'. Accepts any field the evaluations list `sort` param does; clients apply it as the list `sort` param.
61916191
* `--description`: Human-readable purpose of the experiment.
6192-
* `--evaluate-over-time`: Whether this Experiment should display Evaluation results over time.
61936192
* `--insight-id`: Reference to an external insight that seeded this experiment, if any.
6194-
* `--is-favorite`: Whether this Experiment is marked as a favorite.
6193+
* `--is-favorite`: Whether this Experiment is marked as a favorite. Defaults to false on create; omit on update to preserve the existing value.
61956194
* `--metadata`: Free-form producer metadata for the experiment. (JSON string)
61966195
* `--pareto`: Default X/Y metrics for a group's cost-vs-accuracy Pareto view. Metric ids use the same vocabulary as the evaluations list sort/filter fields — `cost_usd`, `latency_ms`, or `evaluators.<name>`. Defaults to cost (x) vs latency (y): both exist for every group, so the chart always has something to render before anyone customizes it. (JSON string)
6196+
* `--show-evaluations-over-time`: Whether Studio should display this Experiment's Evaluation results over time. Defaults to false on create; omit on update to preserve the existing value.
61976197
* `--summary`: Human- or agent-authored summary of the experiment's findings.
61986198

61996199
**Help:**

openapi/ga/individual/platform.openapi.yaml

Lines changed: 23 additions & 19 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

openapi/ga/openapi.yaml

Lines changed: 23 additions & 19 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

openapi/openapi.yaml

Lines changed: 23 additions & 19 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)