Skip to content

Latest commit

 

History

History
389 lines (370 loc) · 203 KB

File metadata and controls

389 lines (370 loc) · 203 KB

Regression Report - linux-wasmaot-viper

>50% Regression (45 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
Exceptions.Handling.ThrowAndCatchFinally(kind: Hardware) Link Link +154.40% 2096.589279 5333.676502
Exceptions.Handling.ThrowAndCatchFinally(kind: Software) Link Link +176.62% 1890.614505 5229.802223
Struct.GSeq.FilterSkipMapSum Link Link +100.00% 57678.882131 115357.286187
Struct.SpanWrapper.WrapperSum Link Link +514.22% 5039.894561 30956.027886
System.Collections.ContainsFalse.Array(Size: 512) Link Link +103.70% 1143652.879741 2329619.945099
System.Collections.ContainsTrue.Array(Size: 512) Link Link +111.15% 555637.374684 1173207.412951
System.Collections.CreateAddAndClear.ICollection(Size: 512) Link Link +52.46% 4846.989891 7389.562848
System.Collections.CtorFromCollection.FrozenDictionaryOptimized(Size: 512) Link Link +88.14% 22180.668733 41730.893053
System.Collections.Perf_Frozen.ToFrozenDictionary(Count: 4) Link Link +129.75% 494.951427 1137.136587
System.Collections.Perf_Frozen.ToFrozenDictionary(Count: 512) Link Link +73.35% 32125.370019 55690.521592
System.Collections.Perf_Frozen.ToFrozenDictionary(Count: 64) Link Link +111.85% 3312.886194 7018.325524
System.Collections.Perf_Frozen.ToFrozenDictionary(Count: 4) Link Link +65.63% 341.594337 565.794724
System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 4) Link Link +187.20% 20.840182 59.853660
System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 4) Link Link +71.21% 49.287445 84.385427
System.Collections.Tests.Perf_BitArray.BitArraySetLengthShrink(Size: 4) Link Link +152.87% 28.829764 72.900925
System.MathBenchmarks.MathTests.DivRemInt64 Link Link +58.86% 1.478915 2.349463
System.Memory.ReadOnlySpan.Trim(input: " abcdefg ") Link Link +75.85% 13.223792 23.254172
System.Numerics.Tests.Perf_Plane.CreateFromVerticesBenchmark Link Link +134.61% 3.733827 8.759801
System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark Link Link +88.11% 3.646453 6.859237
System.Numerics.Tests.Perf_Vector2.LengthBenchmark Link Link +110.21% 1.247739 2.622888
System.Numerics.Tests.Perf_Vector3.CrossBenchmark Link Link +51.49% 4.667207 7.070531
System.Numerics.Tests.Perf_Vector3.NegateBenchmark Link Link +65.55% 4.281110 7.087357
System.Numerics.Tests.Perf_Vector3.NegateOperatorBenchmark Link Link +61.44% 4.960549 8.008070
System.Numerics.Tests.Perf_Vector3.NormalizeBenchmark Link Link +83.19% 5.232706 9.585756
System.Numerics.Tests.Perf_VectorOf.DotBenchmark Link Link +56.22% 2.038664 3.184885
System.Numerics.Tests.Perf_VectorOf.ExclusiveOrOperatorBenchmark Link Link +53.79% 1.433177 2.204089
System.Numerics.Tests.Perf_VectorOf.ZeroBenchmark Link Link +51.10% 0.523611 0.791198
System.Numerics.Tests.Perf_VectorOf.OneBenchmark Link Link +53.18% 1.047511 1.604595
System.Numerics.Tests.Perf_VectorOf.CountBenchmark Link Link +1502.38% 0.042657 0.683520
System.Numerics.Tests.Perf_VectorOf.CountBenchmark Link Link +61.80% 0.078112 0.126385
System.Numerics.Tests.Perf_VectorOf.UnaryNegateOperatorBenchmark Link Link +61.57% 1.105948 1.786852
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanBenchmark Link Link +101.00% 1.432786 2.879871
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.DotBenchmark Link Link +233.14% 0.868534 2.893453
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanOrEqualBenchmark Link Link +76.26% 1.013602 1.786533
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AbsBenchmark Link Link +73.57% 1.370067 2.378027
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.BitwiseAndBenchmark Link Link +71.09% 1.628373 2.786033
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.OnesComplementBenchmark Link Link +75.21% 1.353018 2.370652
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanOrEqualBenchmark Link Link +55.05% 2.344492 3.635043
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.UnaryNegateOperatorBenchmark Link Link +58.83% 1.515217 2.406663
System.Tests.Perf_Guid.EqualsOperator Link Link +259.47% 0.125367 0.450663
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Collections.Generic.Dictionary<String, Boolean>)) Link Link +133.85% 6406.164166 14981.002010
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Collections.Generic.Dictionary`2[])) Link Link +128.15% 6713.998054 15318.017136
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Tests.Nested)) Link Link +60.55% 1574.755281 2528.208425
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Tests.NestedGeneric<String, Boolean>)) Link Link +158.28% 6167.993534 15930.910550
System.Threading.Tests.Perf_Interlocked.Exchange_int Link Link +130.57% 0.204770 0.472142

40-50% Regression (15 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
MicroBenchmarks.Serializers.Json_FromStream.SystemTextJson_SourceGen_ Link Link +44.91% 1318.629342 1910.782503
System.Collections.ContainsKeyFalse<Int32, Int32>.IDictionary(Size: 512) Link Link +45.85% 8216.225608 11983.098009
System.Collections.TryGetValueFalse<Int32, Int32>.Dictionary(Size: 512) Link Link +42.48% 6512.142920 9278.488694
System.Linq.Tests.Perf_Enumerable.WhereSelect(input: Array) Link Link +47.49% 14634.346148 21583.502721
System.Memory.Span.LastIndexOfValue(Size: 33) Link Link +49.97% 8.135590 12.200591
System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 0, hostPortCount: 0) Link Link +40.17% 236.551505 331.582647
System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_HostPort(host: "notfound", hostPortCount: 10) Link Link +41.26% 288.853650 408.030285
System.Numerics.Tests.Perf_Matrix4x4.MultiplyByMatrixBenchmark Link Link +49.76% 26.371240 39.494018
System.Numerics.Tests.Perf_Vector4.AbsBenchmark Link Link +43.51% 9.158540 13.143000
System.Numerics.Tests.Perf_Vector4.LengthBenchmark Link Link +45.32% 1.043734 1.516806
System.Numerics.Tests.Perf_VectorOf.NegateBenchmark Link Link +42.02% 1.473909 2.093241
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AddOperatorBenchmark Link Link +41.76% 1.896040 2.687791
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanOrEqualAllBenchmark Link Link +43.55% 0.593404 0.851807
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.CountBenchmark Link Link +44.88% 0.098755 0.143079
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.OnesComplementBenchmark Link Link +40.18% 1.256399 1.761212

30-40% Regression (32 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
MicroBenchmarks.Serializers.Json_FromStream.SystemTextJson_Reflection_ Link Link +36.66% 1738.234714 2375.493342
System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512) Link Link +39.98% 6422.183941 8989.456654
System.Collections.ContainsKeyTrue<Int32, Int32>.Dictionary(Size: 512) Link Link +30.52% 9481.237906 12374.669761
System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue Link Link +34.09% 17.508694 23.476839
System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteValue Link Link +32.28% 18.024673 23.843635
System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteValue Link Link +33.39% 17.828858 23.781178
System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int Link Link +30.68% 18.308509 23.925155
System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int Link Link +32.45% 17.329822 22.953767
System.Collections.TryGetValueFalse<Int32, Int32>.IDictionary(Size: 512) Link Link +34.96% 8583.585156 11584.522962
System.Collections.TryGetValueTrue<Int32, Int32>.Dictionary(Size: 512) Link Link +33.71% 9686.331453 12951.511955
System.IO.Tests.Perf_FileStream.WriteByte(fileSize: 1024, options: None) Link Link +31.21% 11542.512099 15145.352292
System.Linq.Tests.Perf_Enumerable.WhereSelect(input: List) Link Link +37.01% 18718.172897 25646.058241
System.Memory.Span.LastIndexOfValue(Size: 33) Link Link +36.64% 9.094312 12.426305
System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_HostPort(host: "name5", hostPortCount: 10) Link Link +34.64% 308.394425 415.208992
System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_HostPort(host: "notfound", hostPortCount: 0) Link Link +38.59% 232.284323 321.929049
System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives.SumOfMagnitudes(BufferLength: 3079) Link Link +30.37% 593.932983 774.311361
System.Numerics.Tests.Perf_Vector2.DistanceBenchmark Link Link +31.82% 1.351764 1.781917
System.Numerics.Tests.Perf_Vector2.DistanceSquaredBenchmark Link Link +37.56% 1.689666 2.324283
System.Numerics.Tests.Perf_Vector2.TransformByQuaternionBenchmark Link Link +30.10% 6.806050 8.854839
System.Numerics.Tests.Perf_Vector3.DivideByScalarBenchmark Link Link +31.45% 8.191551 10.767390
System.Numerics.Tests.Perf_Vector3.TransformByQuaternionBenchmark Link Link +31.51% 6.265493 8.239817
System.Numerics.Tests.Perf_Vector4.DivideOperatorBenchmark Link Link +33.11% 13.190641 17.557648
System.Numerics.Tests.Perf_VectorOf.BitwiseAndBenchmark Link Link +36.87% 1.893208 2.591187
System.Numerics.Tests.Perf_VectorOf.GreaterThanOrEqualBenchmark Link Link +30.86% 1.673597 2.190102
System.Numerics.Tests.Perf_VectorOf.AddOperatorBenchmark Link Link +35.40% 1.967526 2.664120
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.AbsBenchmark Link Link +33.06% 1.421054 1.890800
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AndNotBenchmark Link Link +32.56% 1.590158 2.107919
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AllBitsSetBenchmark Link Link +32.07% 0.595586 0.786606
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanOrEqualBenchmark Link Link +38.00% 1.563341 2.157477
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32&)) Link Link +32.41% 1927.884280 2552.776766
System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32&") Link Link +31.94% 1802.303327 2377.938212
System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32*") Link Link +32.71% 1832.955828 2432.542346

25-30% Regression (16 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
MicroBenchmarks.Serializers.Json_FromStream.SystemTextJson_SourceGen_ Link Link +25.16% 2672.038926 3344.207521
System.Collections.ContainsKeyTrue<Int32, Int32>.IDictionary(Size: 512) Link Link +25.96% 11867.989825 14949.106944
System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000, ItemsPerBucket: 5) Link Link +27.52% 136768.402349 174405.150430
System.Collections.Tests.DictionarySequentialKeys.ContainsKey_3k_Int_32ByteRefsValue Link Link +27.58% 18.075667 23.060978
System.Collections.Tests.DictionarySequentialKeys.ContainsValue_17_Int_Int Link Link +27.46% 18.319505 23.350942
System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int Link Link +28.99% 17.947220 23.150543
System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteValue Link Link +27.50% 22.225069 28.337610
System.Collections.TryGetValueTrue<Int32, Int32>.IDictionary(Size: 512) Link Link +27.63% 11859.913669 15136.999495
System.IO.Tests.Perf_FileStream.WriteByte(fileSize: 1024, options: Asynchronous) Link Link +29.25% 11701.145724 15124.288136
System.Linq.Tests.Perf_Enumerable.WhereSelect(input: IEnumerable) Link Link +29.39% 23352.794155 30215.498684
System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_Uri(uriString: "http://notfound", uriCount: 0) Link Link +25.24% 402.669288 504.289648
System.Numerics.Tests.Perf_Matrix3x2.IdentityBenchmark Link Link +28.74% 9.498231 12.227875
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AbsBenchmark Link Link +29.72% 0.998812 1.295674
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanOrEqualAllBenchmark Link Link +28.98% 0.704459 0.908609
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32*)) Link Link +29.82% 2033.143297 2639.496197
System.Threading.Channels.Tests.BoundedChannelPerfTests.TryWriteThenTryRead Link Link +28.00% 421.463051 539.476142

20-25% Regression (30 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Indexer_FirstElement_Array Link Link +22.89% 3.031756 3.725840
Microsoft.Extensions.Primitives.StringSegmentBenchmark.LastIndexOf Link Link +24.16% 11.954287 14.842156
System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue Link Link +21.62% 22.280741 27.096953
System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue Link Link +23.67% 23.221401 28.717362
System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue Link Link +22.95% 21.805793 26.810856
System.Collections.TryGetValueFalse<BigStruct, BigStruct>.Dictionary(Size: 512) Link Link +20.69% 238852.169006 288277.574397
System.IO.Tests.Perf_FileStream.Read(fileSize: 104857600, userBufferSize: 4096, options: Asynchronous) Link Link +22.03% 7153220.802334 8729429.750119
System.IO.Tests.Perf_Path.GetFileNameWithoutExtension Link Link +21.04% 72.430224 87.669089
System.Memory.Span.Clear(Size: 512) Link Link +22.16% 11.135862 13.603666
System.Memory.Span.LastIndexOfValue(Size: 512) Link Link +21.11% 22.617797 27.393407
System.Memory.Span.Fill(Size: 512) Link Link +23.82% 33.110736 40.996281
System.Memory.Span.LastIndexOfValue(Size: 33) Link Link +23.67% 8.549231 10.572829
System.Memory.Span.Reverse(Size: 512) Link Link +22.57% 54.620572 66.948160
System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark Link Link +24.79% 9.628786 12.015988
System.Numerics.Tests.Perf_Vector3.LerpBenchmark Link Link +21.21% 4.641809 5.626111
System.Numerics.Tests.Perf_Vector4.DivideByScalarBenchmark Link Link +24.45% 15.249746 18.978053
System.Numerics.Tests.Perf_Vector4.NormalizeBenchmark Link Link +23.75% 5.915462 7.320397
System.Numerics.Tests.Perf_VectorOf.SubtractionOperatorBenchmark Link Link +20.54% 1.876500 2.261967
System.Numerics.Tests.Perf_VectorOf.NegateBenchmark Link Link +24.44% 1.298717 1.616176
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.BitwiseAndOperatorBenchmark Link Link +22.88% 1.912994 2.350686
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.SubtractBenchmark Link Link +21.49% 1.808002 2.196455
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.BitwiseOrOperatorBenchmark Link Link +20.29% 1.764778 2.122895
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanAllBenchmark Link Link +21.03% 0.737578 0.892701
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.MultiplyBenchmark Link Link +24.30% 1.803296 2.241438
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.BitwiseOrBenchmark Link Link +22.90% 2.046533 2.515186
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.MinBenchmark Link Link +20.42% 2.106259 2.536291
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.SubtractBenchmark Link Link +22.79% 1.734993 2.130367
System.Tests.Perf_DateTime.Year Link Link +24.13% 3.564658 4.424816
System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32[,]") Link Link +20.01% 1875.975809 2251.293715
System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead Link Link +23.46% 255.385956 315.306609

15-20% Regression (37 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
MicroBenchmarks.Serializers.Json_FromStream.SystemTextJson_Reflection_ Link Link +16.98% 3817.358152 4465.670009
System.Collections.CreateAddAndClear.ImmutableQueue(Size: 512) Link Link +15.31% 17788.828476 20511.843703
System.Collections.CreateAddAndRemove.Stack(Size: 512) Link Link +19.70% 4646.109165 5561.266113
System.Collections.Perf_LengthBucketsFrozenDictionary.ToFrozenDictionary(Count: 10000, ItemsPerBucket: 5) Link Link +18.25% 238862.704840 282448.539480
System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 4) Link Link +19.39% 21.298629 25.428609
System.Memory.Constructors_ValueTypesOnly.SpanFromPointerLength Link Link +17.27% 2.344558 2.749437
System.Memory.Span.SequenceEqual(Size: 4) Link Link +16.96% 6.250368 7.310191
System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 10, hostPortCount: 0) Link Link +17.25% 552.463327 647.763817
System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives.FusedMultiplyAdd_ScalarAddend(BufferLength: 128) Link Link +18.61% 616.213989 730.882522
System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: -2147483648) Link Link +15.27% 19.057347 21.967993
System.Numerics.Tests.Perf_Matrix4x4.CreateFromScalars Link Link +18.58% 11.359693 13.470543
System.Numerics.Tests.Perf_Matrix4x4.NegationOperatorBenchmark Link Link +19.99% 11.466225 13.758195
System.Numerics.Tests.Perf_Vector2.UnitYBenchmark Link Link +19.02% 12.466678 14.838219
System.Numerics.Tests.Perf_Vector2.ZeroBenchmark Link Link +17.37% 13.075187 15.345768
System.Numerics.Tests.Perf_VectorOf.ZeroBenchmark Link Link +17.15% 0.584384 0.684584
System.Numerics.Tests.Perf_VectorOf.GreaterThanBenchmark Link Link +17.01% 1.680980 1.966986
System.Numerics.Tests.Perf_VectorOf.XorBenchmark Link Link +16.13% 1.887223 2.191600
System.Numerics.Tests.Perf_VectorOf.ConditionalSelectBenchmark Link Link +15.64% 2.123209 2.455259
System.Numerics.Tests.Perf_VectorOf.AddBenchmark Link Link +16.69% 1.915699 2.235341
System.Numerics.Tests.Perf_VectorOf.OneBenchmark Link Link +15.47% 0.979367 1.130901
System.Numerics.Tests.Perf_VectorOf.AndNotBenchmark Link Link +17.63% 1.779014 2.092599
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanBenchmark Link Link +16.98% 1.823162 2.132816
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.MultiplyOperatorBenchmark Link Link +16.65% 1.814979 2.117111
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.BitwiseAndOperatorBenchmark Link Link +19.57% 1.935622 2.314355
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.MultiplyOperatorBenchmark Link Link +15.17% 1.890988 2.177862
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.EqualsAnyBenchmark Link Link +19.91% 0.838448 1.005351
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GetHashCodeBenchmark Link Link +15.03% 19.816442 22.794435
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanOrEqualAnyBenchmark Link Link +15.40% 1.039466 1.199550
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.BitwiseOrOperatorBenchmark Link Link +18.76% 1.780736 2.114737
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.NegateBenchmark Link Link +18.89% 1.403247 1.668285
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AndNotBenchmark Link Link +16.48% 1.840736 2.144062
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanOrEqualAllBenchmark Link Link +18.52% 1.347639 1.597261
System.Tests.Perf_String.ToUpper(s: "test") Link Link +17.84% 61.325594 72.267405
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32[,])) Link Link +18.29% 2075.509484 2455.155732
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32[])) Link Link +17.15% 2000.051692 2343.013594
System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32[]") Link Link +17.94% 1841.010070 2171.345061
System.Text.Perf_Ascii.IsValid_Chars(Size: 128) Link Link +16.88% 8.247111 9.638883

10-15% Regression (63 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.00) Link Link +10.33% 2.003431 2.210357
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.33) Link Link +13.20% 2.070802 2.344139
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=1.00) Link Link +11.12% 1.998049 2.220206
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.67 pD=0.33) Link Link +10.48% 2.085436 2.304010
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=1.00 pD=0.00) Link Link +11.13% 2.011292 2.235052
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.00) Link Link +10.36% 2.001616 2.209013
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 1.00) Link Link +10.00% 2.009489 2.210441
PerfLabTests.CastingPerf.CheckArrayIsVariantGenericInterfaceNo Link Link +12.44% 5.250246 5.903224
System.Collections.CtorGivenSize.SortedList(Size: 512) Link Link +12.85% 215.886213 243.629984
System.Collections.CtorGivenSize.List(Size: 512) Link Link +12.36% 109.973045 123.569928
System.Collections.CtorGivenSizeNonGeneric.ArrayList(Size: 512) Link Link +10.05% 108.564386 119.470122
System.Collections.IterateForEach.ImmutableStack(Size: 512) Link Link +12.12% 12198.661764 13677.557977
System.Collections.IterateForEach.ImmutableStack(Size: 512) Link Link +13.34% 13892.257324 15744.883095
System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: ) Link Link +10.51% 199.832785 220.831524
System.IO.Tests.Perf_Path.GetFileName Link Link +14.37% 63.162069 72.240544
System.Linq.Tests.Perf_Enumerable.Contains_ElementNotFound(input: ICollection) Link Link +10.87% 36.690800 40.677568
System.Memory.MemoryMarshal.CastToInt Link Link +11.73% 2.468848 2.758484
System.Memory.ReadOnlyMemory.ToArray(Size: 512) Link Link +13.77% 92.852077 105.636513
System.Memory.Span.LastIndexOfValue(Size: 4) Link Link +10.85% 7.687110 8.521003
System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 0, hostPortCount: 10) Link Link +13.10% 591.812196 669.326417
System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 10, hostPortCount: 10) Link Link +11.37% 859.452065 957.133556
System.Numerics.Tests.Constructor.SpanCastBenchmark_Int64 Link Link +11.93% 2.193319 2.454967
System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 123) Link Link +14.33% 16.982847 19.417336
System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark Link Link +13.73% 14.248629 16.205567
System.Numerics.Tests.Perf_Vector4.ClampBenchmark Link Link +12.01% 8.582271 9.612660
System.Numerics.Tests.Perf_VectorOf.GetHashCodeBenchmark Link Link +13.03% 19.839022 22.423326
System.Numerics.Tests.Perf_VectorOf.AbsBenchmark Link Link +14.75% 1.417934 1.627077
System.Numerics.Tests.Perf_VectorOf.BitwiseAndOperatorBenchmark Link Link +10.02% 1.933945 2.127741
System.Numerics.Tests.Perf_VectorOf.MultiplyBenchmark Link Link +11.62% 1.901727 2.122762
System.Numerics.Tests.Perf_VectorOf.EqualsStaticBenchmark Link Link +12.30% 1.950452 2.190400
System.Numerics.Tests.Perf_VectorOf.MaxBenchmark Link Link +12.99% 1.943823 2.196368
System.Numerics.Tests.Perf_VectorOf.LessThanAnyBenchmark Link Link +13.16% 0.686746 0.777145
System.Numerics.Tests.Perf_VectorOf.GetHashCodeBenchmark Link Link +10.98% 20.093072 22.298375
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanOrEqualAnyBenchmark Link Link +10.43% 0.838339 0.925754
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.OnesComplementBenchmark Link Link +13.41% 1.445368 1.639188
System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanBenchmark Link Link +13.04% 1.805187 2.040623
System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MaxBenchmark Link Link +11.34% 1.891279 2.105801
System.Runtime.Intrinsics.Tests.Perf_Vector128Int.UnaryNegateOperatorBenchmark Link Link +13.02% 1.568935 1.773181
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanBenchmark Link Link +10.19% 1.930167 2.126893
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanBenchmark Link Link +10.34% 1.824863 2.013626
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanOrEqualBenchmark Link Link +10.49% 1.747998 1.931365
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.ExclusiveOrOperatorBenchmark Link Link +14.14% 2.018190 2.303621
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanOrEqualBenchmark Link Link +12.50% 1.762827 1.983133
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.DivisionOperatorBenchmark Link Link +14.11% 5.350459 6.105488
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GetHashCodeBenchmark Link Link +10.60% 20.012062 22.132726
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanOrEqualBenchmark Link Link +14.26% 2.370503 2.708557
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.InequalityOperatorBenchmark Link Link +11.39% 1.362171 1.517351
System.Tests.Perf_Double.ToString(value: 12345) Link Link +12.88% 173.342731 195.661924
System.Tests.Perf_Int64.Parse(value: "12345") Link Link +14.56% 28.650586 32.820938
System.Tests.Perf_Int64.TryFormat(value: 12345) Link Link +12.18% 19.189556 21.526439
System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "E") Link Link +10.55% 192.563907 212.872223
System.Tests.Perf_String.ToLower(s: "TEST") Link Link +10.68% 60.675984 67.155323
System.Tests.Perf_String.ToLower(s: "This is a much longer piece of text that might benefit more from vectorization.") Link Link +10.35% 119.590807 131.974103
System.Tests.Perf_String.ToLowerInvariant(s: "TEST") Link Link +10.11% 54.464563 59.971093
System.Tests.Perf_String.ToLowerInvariant(s: "TeSt") Link Link +11.00% 53.247268 59.104945
System.Tests.Perf_String.ToUpper(s: "TeSt") Link Link +12.53% 60.854672 68.479301
System.Tests.Perf_String.Trim(s: " Te st ") Link Link +11.56% 49.761979 55.516298
System.Tests.Perf_TimeSpan.FromSeconds Link Link +10.11% 1.985756 2.186600
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(System.Int32[*])) Link Link +14.40% 2103.643123 2406.604278
System.Tests.Perf_Type.GetType_FullyQualifiedNames(input: typeof(int)) Link Link +13.72% 1809.803697 2058.178236
System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32") Link Link +13.85% 1716.720130 1954.478851
System.Tests.Perf_Type.GetType_NonFullyQualifiedNames(input: "System.Int32[*]") Link Link +14.00% 1947.968416 2220.693109
System.Tests.Perf_UInt64.Parse(value: "12345") Link Link +10.24% 29.389628 32.399109

7.5-10% Regression (41 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.67) Link Link +8.85% 2.080112 2.264171
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.67 pD=0.00) Link Link +7.51% 2.064649 2.219694
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.10) Link Link +8.37% 2.043108 2.214153
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.20) Link Link +7.88% 2.045440 2.206581
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.60) Link Link +8.71% 2.072562 2.253013
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.70) Link Link +8.26% 2.061489 2.231731
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.80) Link Link +8.05% 2.042798 2.207162
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.90) Link Link +8.72% 2.021268 2.197510
System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0) Link Link +9.59% 7.358237 8.064251
System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: fr) Link Link +8.83% 200.936932 218.669986
System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 1]) Link Link +8.01% 482152.917327 520756.814294
System.Memory.Memory.ToArray(Size: 512) Link Link +8.26% 90.617648 98.106177
System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_Uri(uriString: "http://name5", uriCount: 10) Link Link +7.94% 1534.110338 1655.971013
System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_Uri(uriString: "http://notfound", uriCount: 10) Link Link +7.63% 1765.804866 1900.593162
System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives.SumOfMagnitudes(BufferLength: 128) Link Link +8.26% 35.350062 38.271554
System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveFieldOfViewBenchmark Link Link +9.33% 34.909751 38.165806
System.Numerics.Tests.Perf_Plane.CreateFromVector3WithScalarDBenchmark Link Link +8.17% 13.486707 14.588199
System.Numerics.Tests.Perf_Vector4.AddFunctionBenchmark Link Link +8.62% 16.751156 18.195532
System.Numerics.Tests.Perf_Vector4.MultiplyFunctionBenchmark Link Link +9.73% 16.512836 18.119011
System.Numerics.Tests.Perf_VectorOf.ExclusiveOrOperatorBenchmark Link Link +9.49% 1.914031 2.095739
System.Numerics.Tests.Perf_VectorOf.LessThanBenchmark Link Link +9.35% 1.882313 2.058347
System.Numerics.Tests.Perf_VectorOf.BitwiseAndBenchmark Link Link +9.13% 1.889971 2.062495
System.Numerics.Tests.Perf_VectorOf.SubtractBenchmark Link Link +9.94% 1.828845 2.010544
System.Numerics.Tests.Perf_VectorOf.MinBenchmark Link Link +8.51% 1.912956 2.075779
System.Numerics.Tests.Perf_VectorOf.SubtractionOperatorBenchmark Link Link +9.04% 1.894928 2.066249
System.Numerics.Tests.Perf_VectorOf.BitwiseAndBenchmark Link Link +7.77% 1.872694 2.018133
System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanAnyBenchmark Link Link +8.75% 0.922084 1.002773
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.DotBenchmark Link Link +8.20% 9.523534 10.304123
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.ExclusiveOrOperatorBenchmark Link Link +9.41% 1.854486 2.029042
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.LessThanOrEqualBenchmark Link Link +9.27% 1.733480 1.894121
System.Tests.Perf_Array.ArrayResize Link Link +9.13% 55.385678 60.441767
System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "E") Link Link +10.00% 198.249162 218.065669
System.Tests.Perf_Enum.GetValuesAsUnderlyingType_NonGeneric Link Link +7.94% 44.976716 48.549192
System.Tests.Perf_Guid.ParseExactD Link Link +7.60% 40.150876 43.202298
System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "R") Link Link +7.83% 186.523494 201.128204
System.Tests.Perf_String.ToUpperInvariant(s: "TeSt") Link Link +9.62% 53.930820 59.119876
System.Tests.Perf_String.ToUpperInvariant(s: "test") Link Link +8.61% 53.752438 58.379476
System.Tests.Perf_Uri.Ctor(input: "http://dot.net") Link Link +7.59% 147.243001 158.425207
System.Tests.Perf_Uri.Ctor(input: "https://contoso.com") Link Link +8.55% 139.134614 151.037309
System.Tests.Perf_Uri.UnescapeDataString(input: "%E4%BD%A0%E5%A5%BD") Link Link +9.12% 112.060393 122.284554
System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: False, SkipValidation: False) Link Link +8.10% 42.985925 46.467691

5-7.5% Regression (62 tests)

Test Name Link (Viper) Link (Tiger) Change % .NET 9 .NET 10
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.00 pD=0.67) Link Link +7.39% 2.065995 2.218587
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.00) Link Link +7.28% 2.075486 2.226600
GuardedDevirtualization.ThreeClassVirtual.Call(testInput: pB=0.33 pD=0.33) Link Link +7.01% 2.152472 2.303315
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.30) Link Link +7.18% 2.073780 2.222655
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.40) Link Link +6.69% 2.092907 2.233013
GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.50) Link Link +5.71% 2.119477 2.240435
MicroBenchmarks.Serializers.Json_FromString.SystemTextJson_SourceGen_ Link Link +5.61% 2597.890043 2743.583497
Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_SlidingExpiration Link Link +5.92% 41400.090953 43850.350216
Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimEnd Link Link +5.96% 28.908549 30.631452
PerfLabTests.CastingPerf.AssignArrayElementByVariance Link Link +6.35% 72.658660 77.271009
PerfLabTests.GetMember.GetField Link Link +6.96% 3104937.588941 3321033.148704
System.Buffers.Tests.ReadOnlySequenceTests.IterateTryGetTenSegments Link Link +5.74% 265.007553 280.227413
System.Collections.ContainsTrueComparer.HashSet(Size: 512) Link Link +5.59% 26338.025757 27810.650632
System.Collections.CtorFromCollectionNonGeneric.Stack(Size: 512) Link Link +6.03% 36061.930740 38237.672200
System.Collections.CtorGivenSize.Stack(Size: 512) Link Link +6.17% 111.251008 118.115081
System.Collections.CtorGivenSize.Queue(Size: 512) Link Link +7.30% 113.518644 121.807945
System.Collections.CtorGivenSize.SortedList(Size: 512) Link Link +6.81% 231.382223 247.144778
System.Collections.CtorGivenSize.Stack(Size: 512) Link Link +5.95% 114.031280 120.816921
System.Collections.CtorGivenSizeNonGeneric.Queue(Size: 512) Link Link +6.59% 120.379548 128.313723
System.Collections.Tests.Add_Remove_SteadyState.ImmutableQueue(Count: 512) Link Link +7.16% 111.893558 119.900396
System.Collections.TryGetValueTrue<BigStruct, BigStruct>.Dictionary(Size: 512) Link Link +7.36% 379401.309197 407326.043165
System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: da) Link Link +5.79% 204.986449 216.858085
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False)) Link Link +6.15% 927.680035 984.727593
System.IO.Tests.Perf_File.CopyTo(size: 1048576) Link Link +7.15% 1433677.989096 1536246.525447
System.Memory.ReadOnlySpan.IndexOfString(input: "ABCDE", value: "c", comparisonType: InvariantCultureIgnoreCase) Link Link +6.19% 35.708710 37.918966
System.Memory.Span.LastIndexOfValue(Size: 512) Link Link +6.86% 17.536328 18.739278
System.Memory.Span.LastIndexOfValue(Size: 512) Link Link +6.89% 39.606097 42.336849
System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives.AddMultiply_ScalarAddend(BufferLength: 128) Link Link +5.72% 43.166850 45.633997
System.Numerics.Tests.Perf_Matrix4x4.CreateWorldBenchmark Link Link +5.36% 28.450328 29.975881
System.Numerics.Tests.Perf_Vector2.NegateOperatorBenchmark Link Link +5.59% 13.612173 14.373629
System.Numerics.Tests.Perf_VectorOf.MultiplyOperatorBenchmark Link Link +5.85% 1.940401 2.053822
System.Numerics.Tests.Perf_VectorOf.OnesComplementOperatorBenchmark Link Link +6.07% 1.533930 1.627007
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.AddOperatorBenchmark Link Link +6.24% 1.998037 2.122670
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.GreaterThanOrEqualBenchmark Link Link +5.92% 1.728775 1.831203
System.Runtime.Intrinsics.Tests.Perf_Vector128Of.UnaryNegateOperatorBenchmark Link Link +7.07% 1.558941 1.669224
System.Tests.Perf_Boolean.Parse(value: " True ") Link Link +5.64% 59.504512 62.858248
System.Tests.Perf_Boolean.Parse(value: "true") Link Link +6.11% 21.570227 22.889199
System.Tests.Perf_Double.ToStringWithCultureInfo(value: 12345, culture: zh) Link Link +5.37% 199.169782 209.857534
System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "G") Link Link +5.80% 265.204228 280.573473
System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "R") Link Link +6.09% 187.289717 198.704543
System.Tests.Perf_Int32.ToStringHex(value: 4) Link Link +7.40% 46.473298 49.912137
System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G17") Link Link +5.78% 239.697228 253.550465
System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "R") Link Link +6.93% 222.347084 237.752125
System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "E") Link Link +6.41% 206.073617 219.275048
System.Tests.Perf_String.Join_Enumerable Link Link +5.38% 830.041483 874.722289
System.Tests.Perf_String.Substring_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 10) Link Link +5.14% 37.749798 39.688914
System.Tests.Perf_String.ToUpper(s: "This is a much longer piece of text that might benefit more from vectorization.") Link Link +6.83% 123.038012 131.446279
System.Tests.Perf_String.ToUpperInvariant(s: "This is a much longer piece of text that might benefit more from vectorization.") Link Link +7.31% 113.087424 121.350200
System.Tests.Perf_String.Trim(s: "Test ") Link Link +6.33% 51.043172 54.274884
System.Tests.Perf_UInt64.ParseSpan(value: "12345") Link Link +6.80% 27.206154 29.056347
System.Tests.Perf_Uri.Ctor(input: "https://CONTOSO.com") Link Link +6.25% 139.722490 148.453741
System.Tests.Perf_Uri.UnescapeDataString(input: "abc%20def%20ghi%20") Link Link +6.95% 100.954956 107.974377
System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: False, SkipValidation: True) Link Link +5.39% 42.923907 45.237043
System.Text.Json.Tests.Perf_Ctor.Ctor(Formatted: True, SkipValidation: True) Link Link +5.31% 43.317847 45.618887
System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled) Link Link +5.59% 470.583275 496.866886
System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled) Link Link +7.13% 470.360115 503.877277
System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: None) Link Link +6.36% 469.016729 498.865564
System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: Compiled) Link Link +6.22% 134244.400971 142588.517592
System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled) Link Link +6.91% 134033.001812 143292.058045
System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: None) Link Link +7.17% 133732.532005 143320.732953
System.Threading.Tests.Perf_Timer.ScheduleManyThenDisposeMany Link Link +7.40% 557736266.560000 599031138.855556
System.Threading.Tests.Perf_Timer.ShortScheduleAndDisposeWithFiringTimers Link Link +7.03% 339.354430 363.215806