Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 8 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
968719 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77415
968529 dotnet/roslyn Run Integration Tests Log
967815 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77368
967718 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#74353
967674 dotnet/roslyn Run Integration Tests Log
967583 dotnet/roslyn Run Integration Tests Log
967515 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76863
966149 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77368
965179 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77368
964933 dotnet/roslyn Run Integration Tests Log
964352 dotnet/roslyn Run Integration Tests Log
964291 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77359
964211 dotnet/roslyn Run Integration Tests Log
964141 dotnet/roslyn Run Integration Tests Log
964125 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77353
962984 dotnet/roslyn Run Integration Tests Log
962925 dotnet/roslyn Run Integration Tests Log
962875 dotnet/roslyn Run Integration Tests Log
962147 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77337
962143 dotnet/roslyn Run Integration Tests Log
962101 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77202
962022 dotnet/roslyn Run Integration Tests Log
961647 dotnet/roslyn Run Integration Tests Log
961466 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77306
961623 dotnet/roslyn Run Integration Tests Log
961607 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77309
961590 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77331
961549 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77320
961515 dotnet/roslyn Run Integration Tests Log
961434 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77328
960895 dotnet/roslyn Run Integration Tests Log
960650 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77262
960497 dotnet/roslyn Run Integration Tests Log
959865 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77299
959725 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77315
959594 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76983
959539 dotnet/roslyn Run Integration Tests Log
958745 dotnet/roslyn Run Integration Tests Log
958670 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77305
958420 dotnet/roslyn Run Integration Tests Log
958374 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77303
958354 dotnet/roslyn Run Integration Tests Log
958344 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76665
958332 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77302
958166 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77297
958109 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77296
2646960 dotnet-interactive Test / Blame Log
957271 dotnet/roslyn Run Integration Tests Log
2645309 dotnet-interactive Test / Blame Log
955240 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77226
2644452 dotnet-interactive Test / Blame Log
953354 dotnet/roslyn Run Integration Tests Log
953158 dotnet/roslyn Run Integration Tests Log
952643 dotnet/roslyn Run Integration Tests Log
951994 dotnet/roslyn Run Integration Tests Log
951831 dotnet/roslyn Run Integration Tests Log
2642380 dotnet-interactive Test / Blame Log
2640448 dotnet-roslyn Run Unit Tests Log
947549 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
947519 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76665
947207 dotnet/roslyn Run Integration Tests Log
2639037 dotnet-interactive Test / Blame Log
945086 dotnet/roslyn Run Integration Tests Log
943509 dotnet/roslyn Run Unit Tests Log
943517 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
943510 dotnet/roslyn Run Integration Tests Log
941461 dotnet/roslyn Run Integration Tests Log
941307 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77059
2635492 dotnet-interactive Test / Blame Log
940054 dotnet/roslyn Run Integration Tests Log
2634639 dotnet-fsharp CmdLine@2 Log
2633709 dotnet-interactive Test / Blame Log
Build Definition Test Pull Request
968834 dotnet/roslyn workitem_12.WorkItemExecution dotnet/roslyn#77420
2655074 dotnet-roslyn workitem_227.WorkItemExecution
968399 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60337
968265 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47245
968347 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#46425
968264 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47244
968222 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47237
967261 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47220
967172 dotnet/aspnetcore Microsoft.AspNetCore.SignalR.StackExchangeRedis.Tests--net8.0.WorkItemExecution
966308 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#47181
965524 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47021
965388 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47184
965182 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47175
965175 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47174
965066 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47169
964829 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47159
964710 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47146
964688 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47157
2651913 dotnet-aspnetcore Microsoft.AspNetCore.App.Analyzers.Test--net9.0.WorkItemExecution
964593 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47119
964231 dotnet/aspnetcore Microsoft.AspNetCore.Components.Endpoints.Tests--net10.0.WorkItemExecution
964281 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#46425
964145 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47112
964071 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47144
964037 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47143
963883 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47112
963332 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47126
963730 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47135
963574 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47135
963545 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46967
963272 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46967
963137 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47101
963293 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47120
963324 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution dotnet/sdk#47116
963158 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47048
963152 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47069
963292 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47121
963283 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47085
963298 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47123
963125 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47116
963164 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47001
963143 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47096
963134 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47109
963049 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47068
963080 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47114
963030 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47106
2650674 dotnet-aspnetcore Microsoft.AspNetCore.Grpc.JsonTranscoding.Tests--net8.0.WorkItemExecution
2650657 dotnet-roslyn workitem_14.WorkItemExecution
962908 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47110
961913 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47001
961915 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#47002
962175 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47032
962311 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47096
962410 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47101
962734 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47107
2650135 dotnet-aspnetcore Microsoft.AspNetCore.Http.Abstractions.Tests--net8.0.WorkItemExecution
962168 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47081
962125 dotnet/aspnetcore Microsoft.AspNetCore.Identity.EntityFrameworkCore.InMemory.Test--net8.0.WorkItemExecution
962109 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47069
961908 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47086
961850 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47032
961810 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47082
961609 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47076
961388 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47032
961268 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47067
961216 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47064
961193 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47015
960086 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47035
2649227 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
960955 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46994
960718 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47056
960708 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47055
960644 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47033
960675 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47025
2648893 dotnet-aspnetcore Microsoft.AspNetCore.Http.Extensions.Tests--net8.0.WorkItemExecution
960198 dotnet/aspnetcore InMemory.FunctionalTests--net10.0.WorkItemExecution
960133 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47026
960156 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46931
960126 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#47042
959668 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47001
959727 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47032
959676 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47003
959119 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46991
959171 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47002
959106 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60296
959063 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47021
959076 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47023
959003 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47019
958956 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47013
958812 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46988
958903 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47013
958860 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47011
958752 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47010
958676 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46998
958621 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46997
958601 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47006
958540 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46998
958534 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46931
958488 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46965
958384 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46973
Displaying 100 of 390 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
9 62 415

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

@nagilson
Copy link
Member

nagilson commented Dec 3, 2024

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants