The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
2866553	dotnet-runtime	Send ZipArchiveFuzzer to OneFuzz	Log
1238762	dotnet/maui	Controls ListView	Log	dotnet/maui#33284
1238719	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33159
1238681	dotnet/runtime	Send tests to Helix (Unix)	Log
1238631	dotnet/maui	Controls CollectionView	Log	dotnet/maui#30009
1238622	dotnet/maui	Controls CollectionView	Log	dotnet/maui#29028
1238645	dotnet/maui	Controls CollectionView	Log	dotnet/maui#32734
1238648	dotnet/maui	Controls Navigation	Log	dotnet/maui#33134
1238642	dotnet/maui	Controls Layout	Log	dotnet/maui#32349
1238618	dotnet/maui	Provision Android SDK - Environment variables	Log	dotnet/maui#28474
1238628	dotnet/maui	Controls Layout	Log	dotnet/maui#29550
1238616	dotnet/maui	Controls CollectionView	Log	dotnet/maui#26053
1238604	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33251
1238562	dotnet/sdk	🟣 Run FullFramework Tests	Log	dotnet/sdk#52157
2866470	dotnet-docker-tools	🟪 Generate EOL Data for all images in msdotnetcontainersstaging.azurecr.io	Log
1238540	dotnet/maui	Controls Shell	Log	dotnet/maui#29755
1238581	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33251
2866377	dotnet-performance	Send job to Helix (Unix)	Log
1238469	dotnet/runtime	Send tests to Helix (Unix)	Log
1238411	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33278
1238455	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33263
2866265	dotnet-roslyn-analyzers	Build and Test	Log
1238338	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33275
1238363	dotnet/maui	Controls Layout	Log
1238321	dotnet/maui	Run Integration Tests - Build macOS	Log	dotnet/maui#33251
1238308	dotnet/maui	Run Controls.Xaml.UnitTests - Windows	Log	dotnet/maui#33271
1238299	dotnet/maui	Controls (API 30) Page,Performance,Picker,ProgressBar	Log	dotnet/maui#29606
1238291	dotnet/maui	Controls Layout	Log	dotnet/maui#30242
1238228	dotnet/maui	Controls Layout	Log	dotnet/maui#33228
1238213	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33074
1238184	dotnet/runtime	Send tests to Helix (Unix)	Log
1238171	dotnet/maui	Run Controls.Xaml.UnitTests - macOS	Log	dotnet/maui#33185
1238169	dotnet/maui	Run Controls.Xaml.UnitTests - macOS	Log
1238157	dotnet/maui	Controls RadioButton,RefreshView	Log	dotnet/maui#33086
1238129	dotnet/maui	Run Controls.Xaml.UnitTests - Windows	Log	dotnet/maui#33257
2866009	dotnet-docker-tools	🟪 Generate EOL Data for all images in msdotnetcontainersstaging.azurecr.io	Log
1238101	dotnet/maui	Controls Layout	Log	dotnet/maui#33251
2865878	dotnet-dotnet-docker	🟪 Generate EOL Annotation Data	Log
1237809	dotnet/maui	Controls Layout	Log	dotnet/maui#33252
1237889	dotnet/runtime	Send tests to Helix (Unix)	Log
1237899	dotnet/maui	DeviceTestsAndroid_CoreCLR (Windows)	Log	dotnet/maui#33263
1237868	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#122706
1237865	dotnet/maui	Run Integration Tests - RunOniOS macOS	Log	dotnet/maui#33251
2863803	dotnet-dotnet-docker	🟪 Generate EOL Annotation Data	Log
1237819	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log
1237798	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log	dotnet/maui#29755
1237793	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log	dotnet/maui#32939
1237795	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log
1237771	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log
1237783	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log	dotnet/maui#27580
1237769	dotnet/maui	DeviceTestsMacCatalyst (Windows)	Log	dotnet/maui#31840
1237768	dotnet/maui	Provision JDK	Log	dotnet/maui#31840
1237734	dotnet/maui	Provision Android SDK - Common Packages	Log
1237709	dotnet/maui	Controls Layout	Log
1237697	dotnet/maui	Run Controls.Xaml.UnitTests - Windows	Log	dotnet/maui#33257
1237653	dotnet/maui	Run Controls.Xaml.UnitTests - Windows	Log	dotnet/maui#33257
2865598	dotnet-aspire	Windows Build	Log
1237543	dotnet/runtime	Send tests to Helix (Unix)	Log
2865554	dotnet-xharness	Run APIScan	Log
1237531	dotnet/maui	🛠️ Build Microsoft.Maui.sln	Log	dotnet/maui#33254
1237499	dotnet/maui	DeviceTestsAndroid_CoreCLR (Windows)	Log	dotnet/maui#33066
2865422	dotnet-docker-tools	🟪 Generate EOL Data for all images in msdotnetcontainersstaging.azurecr.io	Log
1237335	dotnet/sdk	🟣 Run TemplateEngine Tests	Log	dotnet/sdk#52157
1237300	dotnet/runtime	Send to Helix	Log
1237192	dotnet/runtime	Send to Helix	Log
1237195	dotnet/runtime	Send to Helix	Log
2865006	dotnet-docker-tools	🟪 Generate EOL Data for all images in msdotnetcontainersstaging.azurecr.io	Log
1237105	dotnet/runtime	Send to Helix	Log
1236999	dotnet/runtime	Send tests to Helix (Unix)	Log
1237007	dotnet/aspnetcore	Checkout dotnet/aspnetcore@refs/pull/64842/merge to s	Log	dotnet/aspnetcore#64842
2864591	dotnet-docker-tools	🟪 Generate EOL Data for all images in msdotnetcontainersstaging.azurecr.io	Log
2864498	dotnet-runtime	Run performance job script	Log
1236816	dotnet/runtime	Send tests to Helix (Unix)	Log
1236845	dotnet/maui	Controls CollectionView	Log
1236708	dotnet/maui	Controls (v18.4) Entry	Log	dotnet/maui#33252
1236377	dotnet/maui	Controls (v18.4) TabbedPage,TableView,TimePicker,TitleView,ToolbarItem	Log
1236571	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33246
1236608	dotnet/aspnetcore	Run E2E tests	Log
1236609	dotnet/roslyn	Build with analyzers	Log	dotnet/roslyn#80694
1236502	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33242
1236523	dotnet/maui	Controls (v18.4) TabbedPage,TableView,TimePicker,TitleView,ToolbarItem	Log	dotnet/maui#33075
2864197	dotnet-arcade-services	Deploy container app	Log
1236428	dotnet/maui	Build DeviceTests (CoreCLR)	Log
1236275	dotnet/maui	Provision Android SDK - Common Packages	Log	dotnet/maui#33236
1236276	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33236
1236116	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33091
1236152	dotnet/runtime	Send to Helix	Log
1236097	dotnet/maui	Controls Editor,Effects,FlyoutPage,Focus,Fonts,Frame,Gestures,GraphicsView	Log	dotnet/maui#33228
2863960	dotnet-docker-tools	🟪 Generate EOL Data for all images in msdotnetcontainersstaging.azurecr.io	Log
1235980	dotnet/sdk	🟣 Run TestBuild Tests	Log	dotnet/sdk#52157
1236041	dotnet/maui	Controls CollectionView	Log	dotnet/maui#33151
2863904	dotnet-runtime	Send job to Helix (Unix)	Log
1235681	dotnet/maui	Controls (v18.4) SearchBar,Shape,Slider	Log
1235945	dotnet/aspnetcore	Run E2E tests	Log	dotnet/aspnetcore#64742
2863800	dotnet-dotnet	Build (centOSStreamContainer)	Log
2863834	dotnet-performance	Send job to Helix (Windows)	Log
1235889	dotnet/runtime	Build product	Log	dotnet/runtime#122620
2863772	dotnet-runtime	Send job to Helix (Windows)	Log
1235781	dotnet/runtime	Send tests to Helix (Unix)	Log
2863743	dotnet-runtime	Send job to Helix (Windows)	Log
Displaying 100 of 980 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
23	136	980

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez