Skip to content

Commit

Permalink
Update README.md (#1427)
Browse files Browse the repository at this point in the history 
Co-authored-by: thomhurst <[email protected]>
  • Loading branch information
@github-actions
github-actions[bot] and thomhurst authored Dec 18, 2024
1 parent f50a3f8 commit 1b27150
Showing 1 changed file with 48 additions and 48 deletions.
96 changes: 48 additions & 48 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -258,12 +258,12 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev | Median |
|------------- |-----------:|---------:|---------:|-----------:|
| Build_TUnit | 1,044.1 ms | 19.84 ms | 48.29 ms | 1,026.9 ms |
| Build_NUnit | 901.6 ms | 15.85 ms | 32.37 ms | 893.4 ms |
| Build_xUnit | 894.3 ms | 17.66 ms | 33.17 ms | 882.4 ms |
| Build_MSTest | 911.6 ms | 9.35 ms | 7.81 ms | 911.9 ms |
| Method | Mean | Error | StdDev |
|------------- |-----------:|---------:|----------:|
| Build_TUnit | 1,001.3 ms | 27.04 ms | 77.57 ms |
| Build_NUnit | 805.0 ms | 16.03 ms | 13.39 ms |
| Build_xUnit | 805.2 ms | 13.79 ms | 16.93 ms |
| Build_MSTest | 1,135.2 ms | 56.35 ms | 165.25 ms |



Expand All @@ -282,10 +282,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|------------- |--------:|---------:|---------:|
| Build_TUnit | 1.837 s | 0.0348 s | 0.0427 s |
| Build_NUnit | 1.508 s | 0.0195 s | 0.0173 s |
| Build_xUnit | 1.516 s | 0.0239 s | 0.0223 s |
| Build_MSTest | 1.585 s | 0.0130 s | 0.0102 s |
| Build_TUnit | 1.805 s | 0.0327 s | 0.0306 s |
| Build_NUnit | 1.479 s | 0.0257 s | 0.0241 s |
| Build_xUnit | 1.487 s | 0.0297 s | 0.0278 s |
| Build_MSTest | 1.550 s | 0.0191 s | 0.0170 s |



Expand All @@ -304,10 +304,10 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|------------- |--------:|---------:|---------:|
| Build_TUnit | 1.725 s | 0.0289 s | 0.0271 s |
| Build_NUnit | 1.425 s | 0.0247 s | 0.0231 s |
| Build_xUnit | 1.429 s | 0.0160 s | 0.0142 s |
| Build_MSTest | 1.486 s | 0.0221 s | 0.0207 s |
| Build_TUnit | 1.770 s | 0.0230 s | 0.0192 s |
| Build_NUnit | 1.458 s | 0.0171 s | 0.0151 s |
| Build_xUnit | 1.467 s | 0.0099 s | 0.0088 s |
| Build_MSTest | 1.505 s | 0.0151 s | 0.0141 s |


### Scenario: A single test that completes instantly (including spawning a new process and initialising the test framework)
Expand All @@ -325,13 +325,13 @@ Apple M1 (Virtual), 1 CPU, 3 logical and 3 physical cores
Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |----------:|----------:|----------:|
| TUnit_AOT | 83.25 ms | 1.611 ms | 2.556 ms |
| TUnit | 465.80 ms | 9.046 ms | 13.259 ms |
| NUnit | 698.33 ms | 10.211 ms | 8.527 ms |
| xUnit | 691.54 ms | 13.698 ms | 20.919 ms |
| MSTest | 630.91 ms | 11.253 ms | 17.184 ms |
| Method | Mean | Error | StdDev |
|---------- |----------:|---------:|---------:|
| TUnit_AOT | 77.80 ms | 0.679 ms | 0.567 ms |
| TUnit | 459.08 ms | 4.789 ms | 3.999 ms |
| NUnit | 691.10 ms | 7.421 ms | 6.197 ms |
| xUnit | 710.36 ms | 7.498 ms | 7.013 ms |
| MSTest | 627.26 ms | 8.538 ms | 7.987 ms |



Expand All @@ -350,11 +350,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 32.82 ms | 0.651 ms | 1.534 ms |
| TUnit | 858.68 ms | 16.666 ms | 21.670 ms |
| NUnit | 1,366.59 ms | 14.105 ms | 12.504 ms |
| xUnit | 1,326.53 ms | 17.841 ms | 16.689 ms |
| MSTest | 1,207.56 ms | 21.855 ms | 21.464 ms |
| TUnit_AOT | 31.73 ms | 0.709 ms | 2.079 ms |
| TUnit | 824.11 ms | 16.385 ms | 24.017 ms |
| NUnit | 1,315.56 ms | 26.235 ms | 24.540 ms |
| xUnit | 1,364.27 ms | 26.683 ms | 29.658 ms |
| MSTest | 1,152.90 ms | 16.603 ms | 14.718 ms |



Expand All @@ -373,11 +373,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 74.71 ms | 1.479 ms | 2.345 ms |
| TUnit | 823.84 ms | 16.221 ms | 23.264 ms |
| NUnit | 1,315.91 ms | 16.164 ms | 15.120 ms |
| xUnit | 1,282.67 ms | 16.723 ms | 14.824 ms |
| MSTest | 1,163.72 ms | 15.754 ms | 14.736 ms |
| TUnit_AOT | 74.96 ms | 1.482 ms | 2.264 ms |
| TUnit | 825.14 ms | 16.307 ms | 24.903 ms |
| NUnit | 1,286.43 ms | 16.184 ms | 14.346 ms |
| xUnit | 1,326.83 ms | 14.832 ms | 13.148 ms |
| MSTest | 1,140.77 ms | 12.300 ms | 10.903 ms |


### Scenario: A test that takes 50ms to execute, repeated 100 times (including spawning a new process and initialising the test framework)
Expand All @@ -397,11 +397,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 242.5 ms | 16.47 ms | 48.55 ms |
| TUnit | 693.4 ms | 21.80 ms | 64.27 ms |
| NUnit | 13,953.4 ms | 277.19 ms | 478.14 ms |
| xUnit | 14,264.2 ms | 281.95 ms | 707.35 ms |
| MSTest | 14,193.7 ms | 283.46 ms | 579.04 ms |
| TUnit_AOT | 252.4 ms | 12.38 ms | 36.50 ms |
| TUnit | 720.5 ms | 34.93 ms | 101.88 ms |
| NUnit | 14,311.0 ms | 274.25 ms | 418.81 ms |
| xUnit | 14,383.9 ms | 285.38 ms | 427.14 ms |
| MSTest | 14,630.4 ms | 287.63 ms | 430.51 ms |



Expand All @@ -418,13 +418,13 @@ AMD EPYC 7763, 1 CPU, 4 logical and 2 physical cores
Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev | Median |
|---------- |-----------:|---------:|---------:|-----------:|
| TUnit_AOT | 102.0 ms | 2.03 ms | 5.65 ms | 103.6 ms |
| TUnit | 892.6 ms | 17.63 ms | 29.46 ms | 889.0 ms |
| NUnit | 6,497.4 ms | 30.91 ms | 28.92 ms | 6,493.4 ms |
| xUnit | 6,476.5 ms | 27.72 ms | 25.93 ms | 6,481.2 ms |
| MSTest | 6,415.2 ms | 16.64 ms | 14.75 ms | 6,409.1 ms |
| Method | Mean | Error | StdDev |
|---------- |------------:|----------:|----------:|
| TUnit_AOT | 85.76 ms | 1.651 ms | 3.297 ms |
| TUnit | 874.81 ms | 17.015 ms | 22.714 ms |
| NUnit | 6,474.28 ms | 35.644 ms | 33.342 ms |
| xUnit | 6,530.59 ms | 39.797 ms | 37.226 ms |
| MSTest | 6,399.07 ms | 20.039 ms | 18.744 ms |



Expand All @@ -443,11 +443,11 @@ Job=.NET 9.0 Runtime=.NET 9.0
```
| Method | Mean | Error | StdDev |
|---------- |-----------:|---------:|---------:|
| TUnit_AOT | 126.1 ms | 2.60 ms | 7.65 ms |
| TUnit | 966.2 ms | 19.00 ms | 26.01 ms |
| NUnit | 7,628.4 ms | 31.40 ms | 29.37 ms |
| xUnit | 7,589.9 ms | 28.88 ms | 27.02 ms |
| MSTest | 7,530.5 ms | 29.25 ms | 27.36 ms |
| TUnit_AOT | 125.9 ms | 2.50 ms | 7.28 ms |
| TUnit | 911.8 ms | 18.18 ms | 23.64 ms |
| NUnit | 7,513.8 ms | 23.57 ms | 22.05 ms |
| xUnit | 7,572.2 ms | 17.80 ms | 16.65 ms |
| MSTest | 7,465.6 ms | 33.06 ms | 30.92 ms |



0 comments on commit 1b27150

Please sign in to comment.