Skip to content

Document unreleased MTP telemetry items from main #54342

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
nohwnd wants to merge 3 commits into
base: main
Choose a base branch
from
+38 −1
Draft

Document unreleased MTP telemetry items from main #54342

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
f9dfccd
Document unreleased MTP telemetry rows from main
nohwnd Jun 10, 2026
a996501
Apply suggestions from code review
nohwnd Jun 10, 2026
829c6ab
Address telemetry table feedback: style consistency, missing rows, ba…
nohwnd Jun 10, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions docs/core/testing/microsoft-testing-platform-telemetry.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,39 @@ The telemetry feature collects the following data points:
| All | Version of your test adapter. |
| All | Guid to correlate events from a single runner. |
| 1.0.3 | Guid to correlate events from a single test run. |
| (main) | Timestamp when test adapter loading started. |
| (main) | Timestamp when test adapter loading completed. |
| (main) | Usage statistics for MSTest attributes, as JSON. |
| (main) | Timestamp when test host builder execution started. |
| (main) | Timestamp when test host builder execution completed. |
| (main) | Count of assertion methods used, as JSON. |
| (main) | Timeout in milliseconds for assembly cleanup. |
| (main) | Timeout in milliseconds for assembly initialization. |
| (main) | Boolean for capturing debug traces. |
| (main) | Timeout in milliseconds for class cleanup. |
| (main) | Timeout in milliseconds for class initialization. |
| (main) | Boolean for treating empty data sources as inconclusive. |
| (main) | Boolean for enabling cooperative cancellation. |

@nohwnd nohwnd Jun 10, 2026

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

main is on purpose, this is ready for next release. Then it should be replaced with the actual version.

@Evangelink Evangelink Jun 10, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor — mstest.setting.cooperative_cancellation is AsTelemetryBool(settings.CooperativeCancellationTimeout). It reports whether a cooperative-cancellation timeout was configured, not whether the feature is "enabled" per se. Consider tweaking to e.g. "Boolean indicating if a cooperative cancellation timeout was configured." Not blocking.

| (main) | Source of MSTest configuration (runsettings or testconfig). |
Comment thread
nohwnd marked this conversation as resolved.
Outdated

@Evangelink Evangelink Jun 10, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The source code comment for mstest.config_source lists three possible values, not two: "runsettings, testconfig.json, or none". Suggest tightening to enumerate all three and wrap literals in inline code to match prevailing table style:

Suggested change
| (main) | Source of MSTest configuration (runsettings or testconfig). |
| (main) | Source of MSTest configuration (`runsettings`, `testconfig.json`, or `none`). |

| (main) | Timestamp when test host creation started. |
| (main) | Timestamp when test host creation completed. |
| (main) | Count of custom test method types used. |
Comment thread
nohwnd marked this conversation as resolved.
Outdated
| (main) | Boolean indicating if application exited gracefully. |
| (main) | Timestamp when test execution load phase started. |
| (main) | Timestamp when test execution load phase completed. |
Comment thread
nohwnd marked this conversation as resolved.
Outdated
| (main) | Boolean for mapping inconclusive tests to failed. |
| (main) | Boolean for mapping non-runnable tests to failed. |
Comment thread
nohwnd marked this conversation as resolved.
Outdated
| (main) | Boolean for ordering tests alphabetically by name. |
| (main) | Boolean indicating if test parallelization is enabled. |

@Evangelink Evangelink Jun 10, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MSTestTelemetryDataCollector.AddSettingsMetrics also emits two parallelization items that aren''t documented in this PR — should be added alongside this row if the intent is parity with production telemetry CSV:

  • mstest.setting.parallelization_scope — string (MethodLevel / ClassLevel).
  • mstest.setting.parallelization_workers — number of parallel workers (only emitted when configured).

| (main) | Boolean indicating if random test order seed was provided. |
| (main) | Boolean for randomizing test execution order. |
| (main) | Unique identifier for the test reporter. |
Comment thread
nohwnd marked this conversation as resolved.
Outdated
| (main) | Timestamp when test request started. |
| (main) | Timestamp when test request completed. |
| (main) | Timeout in milliseconds for test cleanup. |
| (main) | Timeout in milliseconds for test initialization. |
| (main) | Timeout in milliseconds for test execution. |
| (main) | Boolean for treating discovery warnings as errors. |

Comment thread
nohwnd marked this conversation as resolved.
Outdated
## Continuous integration detection

Expand Down
Loading