Skip to content

Deduplicate CIEnvironmentDetector across TestFramework and Platform #9008

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Evangelink wants to merge 1 commit into
base: main
Choose a base branch
from
+43 −133

Deduplicate CIEnvironmentDetector across TestFramework and Platform

4f9f6f4
Select commit
Loading
Failed to load commit list.
Open

Deduplicate CIEnvironmentDetector across TestFramework and Platform #9008

Deduplicate CIEnvironmentDetector across TestFramework and Platform
4f9f6f4
Select commit
Loading
Failed to load commit list.
Azure Pipelines / microsoft.testfx failed Jun 10, 2026 in 46m 48s

Build #20260610.30 had test failures

37 errors / 1 warnings

Details

Tests

  • Failed: 34 (0.07%)
  • Passed: 51,337 (99.44%)
  • Other: 255 (0.49%)
  • Total: 51,626
Code coverage

  • 106204 of 156619 blocks covered (67.81%)
  • 74255 of 113213 lines covered (65.59%)

Annotations

Check failure on line 87 in test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs#L87 

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs(87,1): error : Telemetry_WhenEnableTelemetryIsFalse_WithTestApplicationOptions_TelemetryIsDisabled ("net10.0") [net11.0]
Assertion failed. Expected condition to be true.
Expression 'AssertOutputMatchesRegex' failed for member 'AssertDiagnosticReportAsync' at line 42 of file '/_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/TelemetryDisabledTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\fS7kE\WithoutTelemetry\bin\Release\net10.0\TelemetryTest.exe --diagnostic
====================
ExitCode: 8
====================
StandardOutput:
Microsoft.Testing.Platform v2.3.0-ci (UTC 06/10/2026) [win-x64 - net10.0]
Diagnostic file (level 'Trace' with async flush): D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\fS7kE\WithoutTelemetry\bin\Release\net10.0\TestResults\TelemetryTest_net10.0_x64_260610145815063.diag
Test run summary: Zero tests ran - D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\fS7kE\WithoutTelemetry\bin\Release\net10.0\TelemetryTest.dll (net10.0|x64)
  total: 0
  failed: 0
  succeeded: 0
  skipped: 0
  duration: 91ms
====================
StandardError:


actual: false

Assert.IsTrue(Regex.IsMatch(testHostResult.StandardOutput, pattern))

Check failure on line 87 in test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs#L87 

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs(87,1): error : Telemetry_WhenEnableTelemetryIsFalse_WithTestApplicationOptions_TelemetryIsDisabled ("net462") [net11.0]
Assertion failed. Expected condition to be true.
Expression 'AssertOutputMatchesRegex' failed for member 'AssertDiagnosticReportAsync' at line 42 of file '/_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/TelemetryDisabledTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\fS7kE\WithoutTelemetry\bin\Release\net462\TelemetryTest.exe --diagnostic
====================
ExitCode: 8
====================
StandardOutput:
Microsoft.Testing.Platform v2.3.0-ci (UTC 6/10/2026) [x64 - net48]
Diagnostic file (level 'Trace' with async flush): D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\fS7kE\WithoutTelemetry\bin\Release\net462\TestResults\TelemetryTest_net462_x64_260610145815909.diag
Test run summary: Zero tests ran - D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\fS7kE\WithoutTelemetry\bin\Release\net462\TelemetryTest.exe (net462|x64)
  total: 0
  failed: 0
  succeeded: 0
  skipped: 0
  duration: 123ms
====================
StandardError:


actual: false

Assert.IsTrue(Regex.IsMatch(testHostResult.StandardOutput, pattern))

Check failure on line 87 in test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs#L87 

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs(87,1): error : Telemetry_WhenOptingOutTelemetry_WithEnvironmentVariable_TelemetryIsDisabled ("net462") [net11.0]
Assertion failed. Expected condition to be true.
Expression 'AssertOutputMatchesRegex' failed for member 'AssertDiagnosticReportAsync' at line 100 of file '/_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/TelemetryTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\xUTJW\WithTelemetry\bin\Release\net462\TelemetryTest.exe --diagnostic
====================
ExitCode: 8
====================
StandardOutput:
Microsoft.Testing.Platform v2.3.0-ci (UTC 6/10/2026) [x64 - net48]
Diagnostic file (level 'Trace' with async flush): D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\xUTJW\WithTelemetry\bin\Release\net462\TestResults\TelemetryTest_net462_x64_260610145825402.diag
Test run summary: Zero tests ran - D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\xUTJW\WithTelemetry\bin\Release\net462\TelemetryTest.exe (net462|x64)
  total: 0
  failed: 0
  succeeded: 0
  skipped: 0
  duration: 77ms
====================
StandardError:


actual: false

Assert.IsTrue(Regex.IsMatch(testHostResult.StandardOutput, pattern))

Check failure on line 87 in test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs#L87 

test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs(87,1): error : Telemetry_WhenOptingOutTelemetry_WithEnvironmentVariable_TelemetryIsDisabled ("net10.0") [net11.0]
Assertion failed. Expected condition to be true.
Expression 'AssertOutputMatchesRegex' failed for member 'AssertDiagnosticReportAsync' at line 100 of file '/_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/TelemetryTests.cs'. Output of the test host is:
Command: D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\xUTJW\WithTelemetry\bin\Release\net10.0\TelemetryTest.exe --diagnostic
====================
ExitCode: 8
====================
StandardOutput:
Microsoft.Testing.Platform v2.3.0-ci (UTC 06/10/2026) [win-x64 - net10.0]
Diagnostic file (level 'Trace' with async flush): D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\xUTJW\WithTelemetry\bin\Release\net10.0\TestResults\TelemetryTest_net10.0_x64_260610145825481.diag
Test run summary: Zero tests ran - D:\a\_work\1\s\artifacts\tmp\Debug\testsuite\xUTJW\WithTelemetry\bin\Release\net10.0\TelemetryTest.dll (net10.0|x64)
  total: 0
  failed: 0
  succeeded: 0
  skipped: 0
  duration: 76ms
====================
StandardError:


actual: false

Assert.IsTrue(Regex.IsMatch(testHostResult.StandardOutput, pattern))

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.JUnitReportRetryAttributeTests.JUnitReport_WithMSTestRetryAttribute_EmitsFinalOutcomePerTest

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.JUnitReportRetryAttributeTests.JUnitReport_WithMSTestRetryAttribute_EmitsFinalOutcomePerTest 

Class Initialization method MSTest.Acceptance.IntegrationTests.JUnitReportRetryAttributeTests.ClassInitialize threw exception. System.InvalidOperationException: Command 'dotnet build /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry -c Release -p:MSBuildTreatWarningsAsErrors=true -p:TreatWarningsAsErrors=true -p:SuppressNETCoreSdkPreviewMessage=true -bl:"/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/MSTestJUnitReportRetry-142.binlog"' failed.

StandardOutput:
Telemetry is: Disabled
  Determining projects to restore...
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102: Unable to find package Microsoft.Testing.Platform with version (>= 2.3.0-preview.26308.7)
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 55 version(s) in dotnet-public [ Nearest version: 2.2.3 ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 1 version(s) in local-shipping [ Nearest version: 2.3.0-ci ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in local-nonshipping
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in local-tmp-packages
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet10
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet11
  Failed to restore /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj (in 521 ms).
Build FAILED.
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102: Unable to find package Microsoft.Testing.Platform with version (>= 2.3.0-preview.26308.7)
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 55 version(s) in dotnet-public [ Nearest version: 2.2.3 ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 1 version(s) in local-shipping [ Nearest version: 2.3.0-ci ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in local-nonshipping
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in local-tmp-packages
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet10
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/dWayp/MSTestJUnitReportRetry/MSTestJUnitReportRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet11
    0 Warning(s)
    1 Error(s)
Time Elapsed 00:00:01.47
StandardError:
.
Raw output 
   at Microsoft.Testing.TestInfrastructure.DotnetCli.CallTheMuxerCoreAsync(String args, Dictionary`2 environmentVariables, String workingDirectory, Boolean failIfReturnValueIsNotZero, String binlogBaseFileName, CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 170
   at Microsoft.Testing.TestInfrastructure.DotnetCli.<>c__DisplayClass9_0.<<CallTheMuxerAsync>b__2>d.MoveNext() in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 120
--- End of stack trace from previous location ---
   at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext)
   at Polly.AsyncPolicy.ExecuteInternalAsync[TResult](Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken)
   at Microsoft.Testing.TestInfrastructure.DotnetCli.CallTheMuxerAsync(String args, Dictionary`2 environmentVariables, String workingDirectory, Boolean failIfReturnValueIsNotZero, String binlogBaseFileName, CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 117
   at Microsoft.Testing.TestInfrastructure.DotnetCli.RunAsync(String args, String workingDirectory, Dictionary`2 environmentVariables, Boolean failIfReturnValueIsNotZero, Boolean disableTelemetry, Boolean disableCodeCoverage, Boolean warnAsError, Boolean suppressPreviewDotNetMessage, String callerMemberName, CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 104
   at Microsoft.Testing.TestInfrastructure.TestAssetFixtureBase.InitializeAsync(CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/TestAssetFixtureBase.cs:line 35
   at Microsoft.Testing.Platform.Acceptance.IntegrationTests.AcceptanceTestBase`1.ClassInitialize(TestContext testContext) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceTestBase.cs:line 211
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.<>c__DisplayClass93_0.<<InvokeInitializeMethodAsync>b__0>d.MoveNext() in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestClassInfo.Initializer.cs:line 308
--- End of stack trace from previous location ---
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Helpers.ExecutionContextHelpers.RunOnContextAsync(ExecutionContext executionContext, Func`1 action) in /_/src/Adapter/MSTestAdapter.PlatformServices/Helpers/ExecutionContextHelpers.cs:line 46
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Helpers.FixtureMethodRunner.RunWithTimeoutAndCancellationAsync(Func`1 action, CancellationTokenSource cancellationTokenSource, Nullable`1 timeoutInfo, MethodInfo methodInfo, ExecutionContext executionContext, String methodCanceledMessageFormat, String methodTimedOutMessageFormat, Nullable`1 testTimeoutInfo) in /_/src/Adapter/MSTestAdapter.PlatformServices/Helpers/FixtureMethodRunner.cs:line 34
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.InvokeInitializeMethodAsync(MethodInfo methodInfo, TestContext testContext) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestClassInfo.Initializer.cs:line 298
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.RunClassInitializeAsync(TestContext testContext) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestClassInfo.Initializer.cs:line 47

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.JUnitReportMTPRetryExtensionTests.JUnitReport_WithMTPRetryFailedTestsExtension_EmitsOneReportPerAttempt

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.JUnitReportMTPRetryExtensionTests.JUnitReport_WithMTPRetryFailedTestsExtension_EmitsOneReportPerAttempt 

Class Initialization method MSTest.Acceptance.IntegrationTests.JUnitReportMTPRetryExtensionTests.ClassInitialize threw exception. System.InvalidOperationException: Command 'dotnet build /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry -c Release -p:MSBuildTreatWarningsAsErrors=true -p:TreatWarningsAsErrors=true -p:SuppressNETCoreSdkPreviewMessage=true -bl:"/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/MSTestJUnitReportMTPRetry-143.binlog"' failed.

StandardOutput:
Telemetry is: Disabled
  Determining projects to restore...
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102: Unable to find package Microsoft.Testing.Platform with version (>= 2.3.0-preview.26308.7)
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 55 version(s) in dotnet-public [ Nearest version: 2.2.3 ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 1 version(s) in local-shipping [ Nearest version: 2.3.0-ci ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in local-nonshipping
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in local-tmp-packages
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet10
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet11
  Failed to restore /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj (in 530 ms).
Build FAILED.
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102: Unable to find package Microsoft.Testing.Platform with version (>= 2.3.0-preview.26308.7)
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 55 version(s) in dotnet-public [ Nearest version: 2.2.3 ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 1 version(s) in local-shipping [ Nearest version: 2.3.0-ci ]
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in local-nonshipping
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in local-tmp-packages
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet10
/mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/lXNAX/MSTestJUnitReportMTPRetry/MSTestJUnitReportMTPRetry.csproj : error NU1102:   - Found 0 version(s) in dotnet11
    0 Warning(s)
    1 Error(s)
Time Elapsed 00:00:01.37
StandardError:
.
Raw output 
   at Microsoft.Testing.TestInfrastructure.DotnetCli.CallTheMuxerCoreAsync(String args, Dictionary`2 environmentVariables, String workingDirectory, Boolean failIfReturnValueIsNotZero, String binlogBaseFileName, CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 170
   at Microsoft.Testing.TestInfrastructure.DotnetCli.<>c__DisplayClass9_0.<<CallTheMuxerAsync>b__2>d.MoveNext() in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 120
--- End of stack trace from previous location ---
   at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, CancellationToken cancellationToken, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext)
   at Polly.AsyncPolicy.ExecuteInternalAsync[TResult](Func`3 action, Context context, Boolean continueOnCapturedContext, CancellationToken cancellationToken)
   at Microsoft.Testing.TestInfrastructure.DotnetCli.CallTheMuxerAsync(String args, Dictionary`2 environmentVariables, String workingDirectory, Boolean failIfReturnValueIsNotZero, String binlogBaseFileName, CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 117
   at Microsoft.Testing.TestInfrastructure.DotnetCli.RunAsync(String args, String workingDirectory, Dictionary`2 environmentVariables, Boolean failIfReturnValueIsNotZero, Boolean disableTelemetry, Boolean disableCodeCoverage, Boolean warnAsError, Boolean suppressPreviewDotNetMessage, String callerMemberName, CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/DotnetCli.cs:line 104
   at Microsoft.Testing.TestInfrastructure.TestAssetFixtureBase.InitializeAsync(CancellationToken cancellationToken) in /_/test/Utilities/Microsoft.Testing.TestInfrastructure/TestAssetFixtureBase.cs:line 35
   at Microsoft.Testing.Platform.Acceptance.IntegrationTests.AcceptanceTestBase`1.ClassInitialize(TestContext testContext) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceTestBase.cs:line 211
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.<>c__DisplayClass93_0.<<InvokeInitializeMethodAsync>b__0>d.MoveNext() in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestClassInfo.Initializer.cs:line 308
--- End of stack trace from previous location ---
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Helpers.ExecutionContextHelpers.RunOnContextAsync(ExecutionContext executionContext, Func`1 action) in /_/src/Adapter/MSTestAdapter.PlatformServices/Helpers/ExecutionContextHelpers.cs:line 46
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Helpers.FixtureMethodRunner.RunWithTimeoutAndCancellationAsync(Func`1 action, CancellationTokenSource cancellationTokenSource, Nullable`1 timeoutInfo, MethodInfo methodInfo, ExecutionContext executionContext, String methodCanceledMessageFormat, String methodTimedOutMessageFormat, Nullable`1 testTimeoutInfo) in /_/src/Adapter/MSTestAdapter.PlatformServices/Helpers/FixtureMethodRunner.cs:line 34
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.InvokeInitializeMethodAsync(MethodInfo methodInfo, TestContext testContext) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestClassInfo.Initializer.cs:line 298
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestClassInfo.RunClassInitializeAsync(TestContext testContext) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestClassInfo.Initializer.cs:line 47

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.TelemetryTests.MTP_RunTests_SendsTelemetryWithSettingsAndAttributes ("net10.0")

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.TelemetryTests.MTP_RunTests_SendsTelemetryWithSettingsAndAttributes ("net10.0") 

Assertion failed. Expected condition to be true.
Expression 'AssertOutputMatchesRegex' failed for member 'AssertDiagnosticReportAsync' at line 180 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TelemetryTests.cs'. Output of the test host is:
Command: /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/9jYCk/TelemetryTests/bin/Release/net10.0/TelemetryMTPProject --diagnostic
====================
ExitCode: 0
====================
StandardOutput:
MSTest v4.3.0-ci (UTC 06/10/2026) [linux-x64 - .NET 10.0.9]
Diagnostic file (level 'Trace' with async flush): /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/9jYCk/TelemetryTests/bin/Release/net10.0/TestResults/TelemetryMTPProject_net10.0_x64_260610143633685.diag
Telemetry
---------
Microsoft Testing Platform collects usage data in order to help us improve your experience. The data is collected by Microsoft and are not shared with anyone.
You can opt-out of telemetry by setting the TESTINGPLATFORM_TELEMETRY_OPTOUT or DOTNET_CLI_TELEMETRY_OPTOUT environment variable to '1' or 'true' using your favorite shell.
Read more about Microsoft Testing Platform telemetry: https://aka.ms/testingplatform/telemetry
Test run summary: Passed! - /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/9jYCk/TelemetryTests/bin/Release/net10.0/TelemetryMTPProject.dll (net10.0|x64)
  total: 4
  failed: 0
  succeeded: 4
  skipped: 0
  duration: 331ms
====================
StandardError:


actual: false

Assert.IsTrue(Regex.IsMatch(testHostResult.StandardOutput, pattern))
Raw output 
   at Microsoft.Testing.Platform.Acceptance.IntegrationTests.Helpers.AcceptanceAssert.AssertOutputMatchesRegex(TestHostResult testHostResult, String pattern, String callerMemberName, String callerFilePath, Int32 callerLineNumber) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs:line 87
   at MSTest.Acceptance.IntegrationTests.TelemetryTests.AssertDiagnosticReportAsync(TestHostResult testHostResult, String diagPathPattern, String diagContentsPattern, String level, String flushType) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TelemetryTests.cs:line 180
   at MSTest.Acceptance.IntegrationTests.TelemetryTests.MTP_RunTests_SendsTelemetryWithSettingsAndAttributes(String tfm) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TelemetryTests.cs:line 47
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestMethodInfo.ExecuteInternalAsync(Object[] arguments, CancellationTokenSource timeoutTokenSource) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestMethodInfo.Execution.cs:line 149

Check failure on line 1 in MSTest.Acceptance.IntegrationTests.TelemetryTests.MTP_DiscoverTests_SendsTelemetryEvent ("net10.0")

See this annotation in the file changed.

@azure-pipelines azure-pipelines / microsoft.testfx

MSTest.Acceptance.IntegrationTests.TelemetryTests.MTP_DiscoverTests_SendsTelemetryEvent ("net10.0") 

Assertion failed. Expected condition to be true.
Expression 'AssertOutputMatchesRegex' failed for member 'AssertDiagnosticReportAsync' at line 180 of file '/_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TelemetryTests.cs'. Output of the test host is:
Command: /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/9jYCk/TelemetryTests/bin/Release/net10.0/TelemetryMTPProject --list-tests --diagnostic
====================
ExitCode: 0
====================
StandardOutput:
MSTest v4.3.0-ci (UTC 06/10/2026) [linux-x64 - .NET 10.0.9]
Diagnostic file (level 'Trace' with async flush): /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/9jYCk/TelemetryTests/bin/Release/net10.0/TestResults/TelemetryMTPProject_net10.0_x64_260610143635212.diag
  PassingTest
  DataDrivenTest (1)
  DataDrivenTest (2)
  TestWithTimeout
Test discovery summary: found 4 test(s) - /mnt/vss/_work/1/s/artifacts/tmp/Debug/testsuite/9jYCk/TelemetryTests/bin/Release/net10.0/TelemetryMTPProject.dll (net10.0|x64)
  duration: 251ms
====================
StandardError:


actual: false

Assert.IsTrue(Regex.IsMatch(testHostResult.StandardOutput, pattern))
Raw output 
   at Microsoft.Testing.Platform.Acceptance.IntegrationTests.Helpers.AcceptanceAssert.AssertOutputMatchesRegex(TestHostResult testHostResult, String pattern, String callerMemberName, String callerFilePath, Int32 callerLineNumber) in /_/test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/Helpers/AcceptanceAssert.cs:line 87
   at MSTest.Acceptance.IntegrationTests.TelemetryTests.AssertDiagnosticReportAsync(TestHostResult testHostResult, String diagPathPattern, String diagContentsPattern, String level, String flushType) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TelemetryTests.cs:line 180
   at MSTest.Acceptance.IntegrationTests.TelemetryTests.MTP_DiscoverTests_SendsTelemetryEvent(String tfm) in /_/test/IntegrationTests/MSTest.Acceptance.IntegrationTests/TelemetryTests.cs:line 83
   at Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.Execution.TestMethodInfo.ExecuteInternalAsync(Object[] arguments, CancellationTokenSource timeoutTokenSource) in /_/src/Adapter/MSTestAdapter.PlatformServices/Execution/TestMethodInfo.Execution.cs:line 149
View more details on Azure Pipelines