Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 8 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
960497 dotnet/roslyn Run Integration Tests Log
959865 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77299
959725 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77315
959594 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76983
959539 dotnet/roslyn Run Integration Tests Log
958745 dotnet/roslyn Run Integration Tests Log
958670 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77305
958420 dotnet/roslyn Run Integration Tests Log
958374 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77303
958354 dotnet/roslyn Run Integration Tests Log
958344 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76665
958332 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77302
958166 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77297
958109 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77296
2646960 dotnet-interactive Test / Blame Log
957271 dotnet/roslyn Run Integration Tests Log
2645309 dotnet-interactive Test / Blame Log
955240 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77226
2644452 dotnet-interactive Test / Blame Log
953354 dotnet/roslyn Run Integration Tests Log
953158 dotnet/roslyn Run Integration Tests Log
952643 dotnet/roslyn Run Integration Tests Log
951994 dotnet/roslyn Run Integration Tests Log
951831 dotnet/roslyn Run Integration Tests Log
2642380 dotnet-interactive Test / Blame Log
2640448 dotnet-roslyn Run Unit Tests Log
947549 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
947519 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76665
947207 dotnet/roslyn Run Integration Tests Log
2639037 dotnet-interactive Test / Blame Log
945086 dotnet/roslyn Run Integration Tests Log
943509 dotnet/roslyn Run Unit Tests Log
943517 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
943510 dotnet/roslyn Run Integration Tests Log
941461 dotnet/roslyn Run Integration Tests Log
941307 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77059
2635492 dotnet-interactive Test / Blame Log
940054 dotnet/roslyn Run Integration Tests Log
2634639 dotnet-fsharp CmdLine@2 Log
2633709 dotnet-interactive Test / Blame Log
2631578 dotnet-interactive Test / Blame Log
931325 dotnet/roslyn Run Integration Tests Log
930761 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76932
Build Definition Test Pull Request
2648893 dotnet-aspnetcore Microsoft.AspNetCore.Http.Extensions.Tests--net8.0.WorkItemExecution
960198 dotnet/aspnetcore InMemory.FunctionalTests--net10.0.WorkItemExecution
960133 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47026
960156 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46931
960126 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#47042
959668 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47001
959727 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47032
959676 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47003
959119 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46991
959171 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47002
959106 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60296
959063 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47021
959076 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47023
959003 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47019
958956 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47013
958812 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46988
958903 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47013
958860 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47011
958752 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47010
958676 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46998
958621 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46997
958601 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#47006
958540 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46998
958534 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46931
958488 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46965
958384 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46973
957939 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46983
957745 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46915
957614 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46981
957581 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46954
957549 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46972
957414 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46968
957373 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46965
957429 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46971
957416 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46970
957206 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46963
957160 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46927
957025 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60507
957064 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46961
2646299 dotnet-sdk Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.MauiBlazor #47785
957033 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46959
956955 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45872
956893 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46954
956885 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46926
956868 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46949
956314 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46233
956325 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46926
956205 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#46942
956101 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46933
956116 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46935
956125 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46939
956051 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46926
955638 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#46479
955520 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46917
955551 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46796
955514 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46924
955517 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46916
955483 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46921
955445 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45637
955221 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46908
955262 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46913
955224 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46233
955178 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46911
955098 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46909
954882 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46901
954942 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46907
954891 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46904
954890 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46759
954887 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46903
954885 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46900
954714 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46833
954659 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46896
954651 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46895
2644595 dotnet-aspnetcore Microsoft.AspNetCore.Hosting.WindowsServices.Tests--net9.0.WorkItemExecution
954233 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46870
954172 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46883
954047 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
953844 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46863
953649 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46871
953803 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46873
953805 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46879
953652 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46868
953646 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#46873
953520 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60376
2643695 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.Core.Test--net10.0.WorkItemExecution
953438 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46868
953411 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46874
2643482 dotnet-roslyn workitem_9.WorkItemExecution
2643419 dotnet-aspnetcore Microsoft.AspNetCore.Components.Forms.Tests--net10.0.WorkItemExecution
953179 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46868
953092 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#46860
952912 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46860
952938 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46836
952814 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46652
952597 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#42861
952584 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46829
952502 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#42861
952474 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46831
952393 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46837
952384 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#46803
Displaying 100 of 481 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
6 95 524

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

@nagilson
Copy link
Member

nagilson commented Dec 3, 2024

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants