The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
954189	dotnet/aspnetcore	Run E2E tests	Log	dotnet/aspnetcore#60445
954151	dotnet/xharness	Run tests in Helix	Log	dotnet/xharness#1363
2644358	dotnet-arcade	Publish packages, blobs and symbols	Log
954055	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112612
954060	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112569
2644261	dotnet-runtime	Send job to Helix (Windows)	Log
954036	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112595
2644271	dotnet-performance	Send job to Helix (Unix)	Log
954023	dotnet/runtime	Send to Helix	Log	dotnet/runtime#107836
954019	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112617
954009	dotnet/runtime	Send tests to Helix (Unix)	Log
953985	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112616
2644172	dotnet-runtime	Send job to Helix (Windows)	Log
2644168	dotnet-runtime	Send to Helix	Log
953926	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112611
953915	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112610
953912	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112606
953909	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112609
2644082	dotnet-performance	Send job to Helix (Unix)	Log
953871	dotnet/runtime	Send to Helix	Log
953880	dotnet/runtime	Send to Helix	Log
2644023	dotnet-runtime	Send job to Helix (Unix)	Log
953809	dotnet/runtime	Send tests to Helix (Unix)	Log	dotnet/runtime#112514
2643919	dotnet-runtime	Send job to Helix (Windows)	Log
2643700	dotnet-runtime	Send job to Helix (Windows)	Log
2643687	dotnet-performance	Send job to Helix (Unix)	Log
953450	dotnet/aspnetcore	Run E2E tests	Log	dotnet/aspnetcore#60410
2643511	dotnet-runtime	Send job to Helix (Windows)	Log
2643452	dotnet-runtime	🔒 Publish intermediate artifacts	Log
953179	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#46868
953249	dotnet/aspnetcore	Build shared fx	Log
953246	dotnet/aspnetcore	Build shared fx	Log	dotnet/aspnetcore#60399
2643420	dotnet-performance	Send job to Helix (Unix)	Log
2643338	dotnet-arcade	Publish packages, blobs and symbols	Log
2642485	dotnet-runtime	Send job to Helix (Windows)	Log
2643310	dotnet-runtime	Send job to Helix (Unix)	Log
939756	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112057
953045	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#112353
953031	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#111775
953028	dotnet/runtime	Send tests to Helix (Windows)	Log
953018	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#112542
2643127	dotnet-efcore	🛡 Generate SBoM Manifest	Log
2643143	dotnet-runtime	⏬ Pipeline Artifact Download	Log
2643181	dotnet-runtime	Run performance job script	Log
2643199	dotnet-arcade	Validate Hosted Pool Information (1ES PT)	Log
952307	dotnet/aspnetcore	Run project template tests	Log	dotnet/aspnetcore#60326
952132	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#112550
952127	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#112549
952116	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#112543
952081	dotnet/aspire	Gather code coverage results	Log
952108	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#112548
2642705	dotnet-runtime	Run performance job script	Log
2642701	dotnet-installer	Build	Log	#47673
2642695	dotnet-extensions	Secure Supply Chain Analysis (auto-injected by policy)	Log
2642037	dotnet-runtime	Run performance job script	Log
2642422	dotnet-dotnet	🔒 Publish Artifacts (On Success)	Log
2642402	dotnet-sdk	Run Tests in Helix	Log	#47645
2642401	dotnet-sdk	Run dotnet new Integration Tests	Log	#47644
951714	dotnet/aspnetcore	Run project template tests	Log	dotnet/aspnetcore#60326
2642451	dotnet-runtime	Send job to Helix (Unix)	Log
949786	dotnet/runtime	Send tests to Helix (Unix)	Log
2642437	dotnet-performance	Send job to Helix (Unix)	Log
2642423	dotnet-performance	Send job to Helix (Unix)	Log
2642409	dotnet-arcade-validation	PowerShell@2	Log
951341	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112513
2642271	dotnet-runtime	Send job to Helix (Windows)	Log
2642207	dotnet-performance	Send job to Helix (Unix)	Log
951204	dotnet/performance	Send job to Helix (Windows)	Log
951118	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112480
2642074	dotnet-runtime	⏬ Pipeline Artifact Download	Log
951064	dotnet/runtime	Send to Helix	Log
950719	dotnet/runtime	Send to Helix	Log	dotnet/runtime#111910
2642036	dotnet-sdk	Secure Supply Chain Analysis (auto-injected by policy)	Log
950896	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112513
950897	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112393
950902	dotnet/runtime	Download unified artifacts	Log	dotnet/runtime#112514
950678	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112295
2641829	dotnet-runtime	Send job to Helix (Windows)	Log
950783	dotnet/aspire	Run helix tests	Log
2641807	dotnet-sdk	Publish Using Darc	Log
2641763	dotnet-winforms	Publish Using Darc	Log
949854	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112050
2641761	dotnet-winforms	Publish Using Darc	Log
2641803	dotnet-emsdk	Build and Publish	Log
2641718	dotnet-aspnetcore	Publish Using Darc	Log
2641748	dotnet-arcade-validation	Publish Using Darc	Log
950749	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112509
2641792	dotnet-sdk	Publish Using Darc	Log
2641722	dotnet-windowsdesktop	Publish Using Darc	Log
2641794	dotnet-winforms	Publish Using Darc	Log
2641698	dotnet-aspnetcore	Publish Using Darc	Log
2641741	dotnet-symreader-converter	Publish Using Darc	Log
2641644	dotnet-node	Publish Using Darc	Log
950328	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112500
950690	dotnet/runtime	Send to Helix	Log	dotnet/runtime#110818
950725	dotnet/aspire	Run helix tests	Log
950584	dotnet/runtime	Send to Helix	Log	dotnet/runtime#112352
2641738	dotnet-performance	Send job to Helix (Windows)	Log
950593	dotnet/aspnetcore	Build x64	Log
2641686	dotnet-sdk	Setup Private Feeds Credentials	Log	#47596
Displaying 100 of 1925 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
22	400	1925

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing