Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Avoid extra noise in log for CI builds #58

Open
Tasteful opened this issue Dec 2, 2024 · 0 comments · May be fixed by #59
Open

Avoid extra noise in log for CI builds #58

Tasteful opened this issue Dec 2, 2024 · 0 comments · May be fixed by #59
Labels
bug Something isn't working

Comments

@Tasteful
Copy link

Tasteful commented Dec 2, 2024 •
edited by devlooped-bot
Loading

Describe the Bug

The log contains many rows with Running tests: 0% when running inside CI. The below examples are running in Azure DevOps pipeline.

Steps to Reproduce

Run a large test suite and the log will have multiple rows see Running tests: 0% in the below example

2024-12-02T12:40:53.7207327Z   Running tests: 0%
2024-12-02T12:40:54.2566868Z   Test run for C:\SysData\vsts-agent1\_work\1\s\test\company.Application.FunctionalTest\bin\Release\net8.0\company.Application.FunctionalTest.dll (.NETCoreApp,Version=v8.0)
2024-12-02T12:40:54.3654094Z   VSTest version 17.12.0 (x64)
2024-12-02T12:40:54.3765417Z   
2024-12-02T12:40:54.6078033Z   Starting test execution, please wait...
2024-12-02T12:40:54.6784033Z   A total of 1 test files matched the specified pattern.
2024-12-02T12:41:23.9736448Z   Running tests: 0%
2024-12-02T12:41:54.2555315Z   Running tests: 0%
2024-12-02T12:42:24.5091097Z   Running tests: 0%
2024-12-02T12:42:54.7434686Z   Running tests: 0%
2024-12-02T12:43:24.9961153Z   Running tests: 0%
2024-12-02T12:43:55.2438927Z   Running tests: 0%
2024-12-02T12:44:25.5122528Z   Running tests: 0%
2024-12-02T12:44:55.7770807Z   Running tests: 0%
2024-12-02T12:45:06.6002079Z   [xUnit.net 00:04:10.97]     company.Application.Sales.DiscountScenariosTest_performance_productlists.Performance [SKIP]
2024-12-02T12:45:07.9335906Z     Skipped company.Application.Sales.DiscountScenariosTest_performance_productlists.Performance [1 ms]
2024-12-02T12:45:26.0562787Z   Running tests: 0%
2024-12-02T12:45:28.4220239Z   [xUnit.net 00:04:32.80]     company.Application.FieldFramework.SystemObjectFieldTypeTest.ListSystemFields_NotHidden_And_Have_No_Translation [SKIP]
2024-12-02T12:45:28.8184575Z     Skipped company.Application.FieldFramework.SystemObjectFieldTypeTest.ListSystemFields_NotHidden_And_Have_No_Translation [1 ms]
2024-12-02T12:45:56.3438379Z   Running tests: 0%
2024-12-02T12:46:20.1952961Z   [xUnit.net 00:05:24.51]     company.Application.Sales.CartContextTest.Confirm_Order_With_Discount [FAIL]
2024-12-02T12:46:20.3442111Z     Failed company.Application.Sales.CartContextTest.Confirm_Order_With_Discount [789 ms]
2024-12-02T12:46:20.3476711Z ##[error]EXEC(0,0): Error Message: 
2024-12-02T12:46:20.3480502Z EXEC : error Message:  [C:\SysData\vsts-agent1\_work\1\s\company.Build.TestFunctional.target]
2024-12-02T12:46:20.3481472Z      System.NullReferenceException : Object reference not set to an instance of an object.
2024-12-02T12:46:20.3482152Z     Stack Trace:
2024-12-02T12:46:20.3482777Z   --- End of stack trace from previous location ---
2024-12-02T12:46:20.3483788Z        at company.Application.Sales.CartContextTest.Confirm_Order_With_Discount() in /_/Test/company.Application.FunctionalTest/Sales/CartContextTest.cs:line 486
2024-12-02T12:46:26.5785112Z   Running tests: 0%
2024-12-02T12:46:56.7782305Z   Running tests: 0%
2024-12-02T12:47:27.0432181Z   Running tests: 0%
2024-12-02T12:47:57.3380289Z   Running tests: 0%
2024-12-02T12:48:18.4290223Z   [xUnit.net 00:07:22.80]     company.Application.Products.PriceListItemTest.BatchCreate [SKIP]
2024-12-02T12:48:19.0115100Z     Skipped company.Application.Products.PriceListItemTest.BatchCreate [1 ms]
2024-12-02T12:48:27.5578756Z   Running tests: 0%
2024-12-02T12:48:57.8561192Z   Running tests: 0%
2024-12-02T12:49:19.4309411Z   [xUnit.net 00:08:23.80]     company.Application.Customers.OrganizationLargeDataTest.Create_and_query_one_by_one [SKIP]
2024-12-02T12:49:19.4312032Z   [xUnit.net 00:08:23.81]     company.Application.Customers.OrganizationLargeDataTest.Create_and_query [SKIP]
2024-12-02T12:49:19.8339408Z     Skipped company.Application.Customers.OrganizationLargeDataTest.Create_and_query [1 ms]
2024-12-02T12:49:19.8342823Z     Skipped company.Application.Customers.OrganizationLargeDataTest.Create_and_query_one_by_one [1 ms]
2024-12-02T12:49:28.0812795Z   Running tests: 0%
2024-12-02T12:49:58.3583202Z   Running tests: 0%
2024-12-02T12:50:28.6461864Z   Running tests: 0%
2024-12-02T12:50:58.8824052Z   Running tests: 0%
2024-12-02T12:51:29.0880513Z   Running tests: 0%
2024-12-02T12:51:29.4982802Z   [xUnit.net 00:10:33.87]     company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock [SKIP]
2024-12-02T12:51:30.3101589Z     Skipped company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock [1 ms]
2024-12-02T12:51:31.7634704Z   [xUnit.net 00:10:36.14]     company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock_async [SKIP]
2024-12-02T12:51:31.7686782Z     Skipped company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock_async [1 ms]
2024-12-02T12:51:49.9169877Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_13_44_24.trx
2024-12-02T12:51:49.9175241Z   
2024-12-02T12:51:49.9457167Z   Failed!  - Failed:     1, Passed:  4096, Skipped:     7, Total:  4104, Duration: 7 m 24 s - company.Application.FunctionalTest.dll (net8.0)
2024-12-02T12:51:59.2905407Z   Running tests: 1%
2024-12-02T12:52:27.5741269Z   Retrying 1 failed test: 0%
2024-12-02T12:52:28.5668787Z   Test run for C:\SysData\vsts-agent1\_work\1\s\test\company.Application.FunctionalTest\bin\Release\net8.0\company.Application.FunctionalTest.dll (.NETCoreApp,Version=v8.0)
2024-12-02T12:52:28.7469900Z   VSTest version 17.12.0 (x64)
2024-12-02T12:52:28.7695311Z   
2024-12-02T12:52:29.0461102Z   Starting test execution, please wait...
2024-12-02T12:52:29.1227452Z   A total of 1 test files matched the specified pattern.
2024-12-02T12:52:57.8723679Z   Running tests: 1%
2024-12-02T12:52:57.8724983Z   Retrying 1 failed test: 0%
2024-12-02T12:53:05.1956453Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_13_53_03.trx
2024-12-02T12:53:05.1956994Z   
2024-12-02T12:53:05.2039329Z   Passed!  - Failed:     0, Passed:     1, Skipped:     0, Total:     1, Duration: 2 s - company.Application.FunctionalTest.dll (net8.0)

Expected Behavior

Avoid extra update of information in the output, see the removed extra Running tests: 0% in the below exanple

2024-12-02T15:08:38.6391738Z   Running tests: 0%
2024-12-02T15:08:40.2676061Z   Test run for C:\SysData\vsts-agent1\_work\1\s\test\company.Application.FunctionalTest\bin\Release\net8.0\company.Application.FunctionalTest.dll (.NETCoreApp,Version=v8.0)
2024-12-02T15:08:40.3824430Z   VSTest version 17.12.0 (x64)
2024-12-02T15:08:40.3910283Z   
2024-12-02T15:08:40.5944169Z   Starting test execution, please wait...
2024-12-02T15:08:40.6600090Z   A total of 1 test files matched the specified pattern.
2024-12-02T15:12:58.7315465Z   [xUnit.net 00:04:17.09]     company.Application.Customers.OrganizationLargeDataTest.Create_and_query_one_by_one [SKIP]
2024-12-02T15:12:58.7316134Z   [xUnit.net 00:04:17.09]     company.Application.Customers.OrganizationLargeDataTest.Create_and_query [SKIP]
2024-12-02T15:12:59.1790973Z     Skipped company.Application.Customers.OrganizationLargeDataTest.Create_and_query_one_by_one [1 ms]
2024-12-02T15:12:59.1792899Z     Skipped company.Application.Customers.OrganizationLargeDataTest.Create_and_query [1 ms]
2024-12-02T15:13:09.8089740Z   [xUnit.net 00:04:28.17]     company.Application.Products.PriceListItemTest.BatchCreate [SKIP]
2024-12-02T15:13:11.3336013Z     Skipped company.Application.Products.PriceListItemTest.BatchCreate [1 ms]
2024-12-02T15:15:15.4916023Z   [xUnit.net 00:06:33.84]     company.Application.Sales.CartContextTest.Confirm_Order_With_Discount [FAIL]
2024-12-02T15:15:15.9840219Z     Failed company.Application.Sales.CartContextTest.Confirm_Order_With_Discount [605 ms]
2024-12-02T15:15:15.9841233Z     Error Message:
2024-12-02T15:15:15.9841787Z     Stack Trace:
2024-12-02T15:15:15.9843196Z   --- End of stack trace from previous location ---
2024-12-02T15:15:15.9844177Z        at company.Application.Sales.CartContextTest.Confirm_Order_With_Discount() in /_/Test/company.Application.FunctionalTest/Sales/CartContextTest.cs:line 486
2024-12-02T15:15:15.9850596Z      System.NullReferenceException : Object reference not set to an instance of an object.
2024-12-02T15:16:18.6204395Z   [xUnit.net 00:07:36.96]     company.Application.Sales.DiscountScenariosTest_performance_productlists.Performance [SKIP]
2024-12-02T15:16:19.1643628Z     Skipped company.Application.Sales.DiscountScenariosTest_performance_productlists.Performance [1 ms]
2024-12-02T15:17:29.6635489Z   [xUnit.net 00:08:48.02]     company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock [SKIP]
2024-12-02T15:17:30.6716507Z     Skipped company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock [1 ms]
2024-12-02T15:17:31.9295027Z   [xUnit.net 00:08:50.28]     company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock_async [SKIP]
2024-12-02T15:17:32.1706928Z     Skipped company.Application.Runtime.DistributedLockTests.Acquire_long_running_lock_async [1 ms]
2024-12-02T15:17:45.0244041Z   [xUnit.net 00:09:03.38]     company.Application.FieldFramework.SystemObjectFieldTypeTest.ListSystemFields_NotHidden_And_Have_No_Translation [SKIP]
2024-12-02T15:17:46.1755561Z     Skipped company.Application.FieldFramework.SystemObjectFieldTypeTest.ListSystemFields_NotHidden_And_Have_No_Translation [1 ms]
2024-12-02T15:19:31.7509344Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_16_12_18.trx
2024-12-02T15:19:31.7510158Z   
2024-12-02T15:19:31.7661208Z   Failed!  - Failed:     1, Passed:  4096, Skipped:     7, Total:  4104, Duration: 7 m 12 s - company.Application.FunctionalTest.dll (net8.0)
2024-12-02T15:20:09.0821744Z   Retrying 1 failed test: 0%
2024-12-02T15:20:10.8927423Z   Test run for C:\SysData\vsts-agent1\_work\1\s\test\company.Application.FunctionalTest\bin\Release\net8.0\company.Application.FunctionalTest.dll (.NETCoreApp,Version=v8.0)
2024-12-02T15:20:11.0242550Z   VSTest version 17.12.0 (x64)
2024-12-02T15:20:11.0353804Z   
2024-12-02T15:20:11.2539890Z   Starting test execution, please wait...
2024-12-02T15:20:11.3443911Z   A total of 1 test files matched the specified pattern.
2024-12-02T15:20:48.1218906Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_16_20_46.trx
2024-12-02T15:20:48.1219455Z   
2024-12-02T15:20:48.1289526Z   Passed!  - Failed:     0, Passed:     1, Skipped:     0, Total:     1, Duration: 2 s - company.Application.FunctionalTest.dll (net8.0)
2024-12-02T15:20:48.7530569Z   Running tests: 0%
2024-12-02T15:20:50.1987553Z   Test run for C:\SysData\vsts-agent1\_work\1\s\test\company.Web.Application.FunctionalTest\bin\Release\net8.0\company.Web.Application.FunctionalTest.dll (.NETCoreApp,Version=v8.0)
2024-12-02T15:20:50.3351944Z   VSTest version 17.12.0 (x64)
2024-12-02T15:20:50.3445276Z   
2024-12-02T15:20:50.5777989Z   Starting test execution, please wait...
2024-12-02T15:20:50.6952815Z   A total of 1 test files matched the specified pattern.
2024-12-02T15:24:24.6552078Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_16_21_19.trx
2024-12-02T15:24:24.6553644Z   
2024-12-02T15:24:24.6646322Z   Passed!  - Failed:     0, Passed:  1267, Skipped:     0, Total:  1267, Duration: 3 m 5 s - company.Web.Application.FunctionalTest.dll (net8.0)
2024-12-02T15:24:25.2797258Z   Running tests: 0%
2024-12-02T15:24:26.6723509Z   Test run for C:\SysData\vsts-agent1\_work\1\s\test\company.Accelerator.Test\bin\Release\net8.0\company.Accelerator.Test.dll (.NETCoreApp,Version=v8.0)
2024-12-02T15:24:26.7825142Z   VSTest version 17.12.0 (x64)
2024-12-02T15:24:26.7909657Z   
2024-12-02T15:24:26.9934758Z   Starting test execution, please wait...
2024-12-02T15:24:27.0607072Z   A total of 1 test files matched the specified pattern.
2024-12-02T15:24:28.4561761Z   No test is available in C:\SysData\vsts-agent1\_work\1\s\test\company.Accelerator.Test\bin\Release\net8.0\company.Accelerator.Test.dll. Make sure that test discoverer & executors are registered and platform & framework version settings are appropriate and try again.
2024-12-02T15:24:28.6183963Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_16_24_28.trx
2024-12-02T15:24:28.6186196Z   
2024-12-02T15:24:28.6293924Z   Additionally, path to test adapters can be specified using /TestAdapterPath command. Example  /TestAdapterPath:<pathToCustomAdapters>.
2024-12-02T15:24:29.4361704Z   Running tests: 0%
2024-12-02T15:24:30.9862613Z   Test run for C:\SysData\vsts-agent1\_work\1\s\Test\company.Web.Test\bin\Release\net8.0\company.Web.Test.dll (.NETCoreApp,Version=v8.0)
2024-12-02T15:24:31.1389004Z   VSTest version 17.12.0 (x64)
2024-12-02T15:24:31.1485352Z   
2024-12-02T15:24:31.4729408Z   Starting test execution, please wait...
2024-12-02T15:24:31.5640094Z   A total of 1 test files matched the specified pattern.
2024-12-02T15:24:35.4119825Z   Results File: C:\SysData\vsts-agent1\_work\1\TestResults\vsts-build-agent1_RND-BUILD01_2024-12-02_16_24_33.trx
2024-12-02T15:24:35.4122244Z   
2024-12-02T15:24:35.4205164Z   Passed!  - Failed:     0, Passed:   184, Skipped:     0, Total:   184, Duration: 1 s - company.Web.Test.dll (net8.0)

Version Info

0.6.3

Back this issue
Back this issue
@Tasteful Tasteful added the bug Something isn't working label Dec 2, 2024
@Tasteful Tasteful linked a pull request Dec 2, 2024 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Avoid noise in auto-update of progress Tasteful/dotnet-retest
1 participant
@Tasteful