Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build Issue Summary for 2024-08-12 #3909

Closed
github-actions bot opened this issue Aug 12, 2024 · 4 comments
Closed

Build Issue Summary for 2024-08-12 #3909

github-actions bot opened this issue Aug 12, 2024 · 4 comments
Assignees
@adamfarley
Labels
aarch Issues that affect or relate to the aarch ARCHITECTURE aix Issues that affect or relate to the AIX OS alpine-linux Issues that affect or relate to the Alpine LINUX OS arm Issues that affect or relate to the ARM OS jenkins Issues that enhance or fix our jenkins server macos Issues that affect or relate to the MAC OS solaris Issues that affect or relate to the SOLARIS OS testing Issues that enhance or fix our test suites weekly-build-triage windows Issues that affect or relate to the WINDOWS OS

Comments

@github-actions
Copy link

github-actions bot commented Aug 12, 2024 •
edited by adamfarley
Loading

Summary

Build failures: 6
Test failures: 16

TRSS Pipeline Links

JDK8: https://trss.adoptium.net/resultSummary?parentId=66abea49d24e1b006e9b858d
JDK8 Alpine: https://trss.adoptium.net/resultSummary?parentId=66abee86d24e1b006e9bc05f
JDK11: https://trss.adoptium.net/resultSummary?parentId=66b67768d24e1b006eb25140
JDK17: https://trss.adoptium.net/resultSummary?parentId=66b67299d24e1b006eb21f31
JDK21: https://trss.adoptium.net/resultSummary?parentId=66b66901d24e1b006eb1cc88
JDK23: https://trss.adoptium.net/resultSummary?parentId=66b5192bd24e1b006eaadef6
JDK24: https://trss.adoptium.net/resultSummary?parentId=66b51946d24e1b006eaadef8

Failed Builds

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-solaris-x64-temurin/504/
Cause: Error/exception found.
Preventable: no

[2024-08-01T20:01:43.321Z] hudson.plugins.git.GitException: Command "/usr/local/bin/git fetch --tags --force --progress -- https://github.com/adoptium/ci-jenkins-pipelines.git +refs/heads/*:refs/remotes/origin/*" returned status code 128:

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-ppc64le-temurin/353/
Cause: No error found

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-alpine-linux-x64-temurin/15/
Cause: Error/exception found.
Preventable: no

[2024-08-08T19:01:26.278Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-x64-temurin/313/
Cause: Error/exception found.
Preventable: no

[2024-08-08T19:02:29.954Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-x64-temurin/516/
Cause: Error/exception found.
Preventable: no

[2024-08-08T19:02:07.101Z] Execution error: hudson.AbortException: script returned exit code 1

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-s390x-temurin/290/
Cause: Error/exception found.
Preventable: no

[2024-08-08T20:44:56.327Z] Execution error: hudson.AbortException: No artifacts found that match the file pattern "workspace/target/*". Configuration error?

Builds with Failed Tests (suspected)

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-temurin/523/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-03T01:12:49.878Z] Build Test_openjdk8_hs_dev.functional_x86-64_mac #23 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-temurin/479/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-01T20:35:22.762Z] Build Test_openjdk8_hs_special.functional_ppc64le_linux #199 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-temurin/488/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-02T02:33:48.092Z] Build Test_openjdk8_hs_extended.functional_x86-64_linux #629 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-temurin/507/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-02T01:18:27.666Z] Build Test_openjdk8_hs_extended.system_x86-64_windows #932 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-alpine-linux-x64-temurin/444/
Cause: Smoke test failed.
Preventable: no

[2024-08-01T22:39:27.786Z] Build build-scripts » jobs » jdk8u » jdk8u-alpine-linux-x64-temurin_SmokeTests #312 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk11u/job/jdk11u-linux-x64-temurin/408/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-10T02:31:33.866Z] Build Test_openjdk11_hs_sanity.external_x86-64_linux #639 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-ppc64le-temurin/453/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-09T20:48:06.013Z] Build Test_openjdk17_hs_extended.functional_ppc64le_linux #415 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-x64-temurin/602/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-10T01:21:26.783Z] Build Test_openjdk17_hs_sanity.external_x86-64_linux #27 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk17u/job/jdk17u-linux-arm-temurin/357/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-10T23:56:57.142Z] Build Test_openjdk17_hs_extended.openjdk_arm_linux #165 completed: ABORTED

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-linux-ppc64le-temurin/157/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-09T22:06:35.137Z] Build Test_openjdk21_hs_sanity.openjdk_ppc64le_linux #149 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-aarch64-temurin/143/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-10T20:56:38.932Z] Build Test_openjdk21_hs_extended.openjdk_aarch64_mac #59 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-linux-x64-temurin/262/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-09T22:31:52.546Z] Build Test_openjdk21_hs_sanity.external_x86-64_linux #29 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-linux-ppc64le-temurin/15/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-08T22:18:48.528Z] Build Test_openjdk23_hs_special.openjdk_ppc64le_linux #27 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-aix-ppc64-temurin/16/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-09T06:52:15.538Z] Build Test_openjdk23_hs_extended.system_ppc64_aix #17 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-linux-riscv64-temurin/14/
Cause: Test job aborted.
Preventable: no

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-aarch64-temurin/142/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-08T21:02:20.164Z] Build Test_openjdk24_hs_extended.openjdk_aarch64_alpine-linux #7 completed: FAILURE

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-linux-ppc64le-temurin/299/
Cause: Post-build AQATest subjob failed.
Preventable: no

[2024-08-08T22:25:04.897Z] Build Test_openjdk24_hs_sanity.openjdk_ppc64le_linux #6 completed: FAILURE

End of list

Script Issues

  • Issue 0: Could not find all three of the pipelines for jdk8. Will triage the pipelines we could find.
  • Issue 1: Error: Platform linux-arm should be built for jdk8u, but was not launched.
  • Issue 3: Riscv not correctly identified as having failed.

End of Issues
@sxa
Copy link
Member

sxa commented Aug 12, 2024

@adamfarley It doesn't look like this picked up the ABORTED build + extended.openjdk in the riscv64 job for jdk23 - perhaps that's something we could look at improving.

Ref: adoptium/ci-jenkins-pipelines#1097

@github-actions github-actions bot added aarch Issues that affect or relate to the aarch ARCHITECTURE aix Issues that affect or relate to the AIX OS alpine-linux Issues that affect or relate to the Alpine LINUX OS arm Issues that affect or relate to the ARM OS jenkins Issues that enhance or fix our jenkins server macos Issues that affect or relate to the MAC OS solaris Issues that affect or relate to the SOLARIS OS testing Issues that enhance or fix our test suites windows Issues that affect or relate to the WINDOWS OS labels Aug 12, 2024
@adamfarley
Copy link
Contributor

@adamfarley It doesn't look like this picked up the ABORTED build + extended.openjdk in the riscv64 job for jdk23 - perhaps that's something we could look at improving.

Ref: adoptium/ci-jenkins-pipelines#1097

That's odd. Will look into it. Aborted jobs should be identified as failures, you're right.

@adamfarley
Copy link
Contributor

adamfarley commented Aug 12, 2024 •
edited
Loading

Build Triage

Failed Builds

21:02:28  docker-osuosl-ubuntu2004-ppc64le-1 does not seem to be running inside a container
21:02:30  $ docker run -t -d -u 1000:1000 -e BUILDIMAGESHA=adoptopenjdk/centos7_build_image@sha256:d7158d02fc35bdbc9654a7e2dcfc649ccb3e347b570eab98562808c6ed939783
21:02:30   --init -w /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin -v /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin:/home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin:rw,z -v /home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin@tmp:/home/jenkins/workspace/build-scripts/jobs/jdk11u/jdk11u-linux-ppc64le-temurin@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** adoptopenjdk/centos7_build_image cat
21:05:30  ERROR: Timeout after 180 seconds

Looks like this issue is consistent-ish on docker-osuosl-ubuntu2004-ppc64le-1, and started happening on the 26th of June (with the previous run on the 7th taking 14 seconds).
Raised a new issue here.

20:01:26  + docker pull adoptopenjdk/alpine3_build_image
20:01:26  Using default tag: latest
20:01:26  Error response from daemon: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io on 127.0.0.53:53: server misbehaving

The jobs before and after these ones show no sign of this issue. Will ignore for now, and raise an issue if it occurs again in the future. Documented here.

21:44:52  Downloading GA release of boot JDK version 23 failed.
21:44:52  Attempting to download EA release of boot JDK version 23 from https://api.adoptium.net/v3/binary/latest/23/ea/linux/s390x/jdk/hotspot/normal/adoptium
21:44:52    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
21:44:52                                   Dload  Upload   Total   Spent    Left  Speed
21:44:52  
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52  
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52    0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
21:44:52  
21:44:52    5  192M    5 10.0M    0     0  13.9M      0  0:00:13 --:--:--  0:00:13 13.9M
21:44:52  curl: (18) transfer closed with 191282016 bytes remaining to read

Looks like we lost the connection to api.adoptium.net in the middle of the boot jdk download.
Making a note in the networking issue.

@adamfarley
Copy link
Contributor

adamfarley commented Aug 13, 2024 •
edited
Loading

Test failure triage

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-mac-x64-temurin/523/
Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-ppc64le-temurin/479/
Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-linux-x64-temurin/488/
Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-windows-x64-temurin/507/
Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk8u/job/jdk8u-alpine-linux-x64-temurin/444/

Triaged here.

https://ci.adoptium.net/job/Test_openjdk11_hs_sanity.external_x86-64_linux_testList_0/10/
https://ci.adoptium.net/job/Test_openjdk17_hs_sanity.external_x86-64_linux_testList_0/5/console

ERROR: failed to solve: failed to read dockerfile: failed to prepare  as n8vdqkm4s4m4cl6yvnkb63lkq: symlink ../n8vdqkm4s4m4cl6yvnkb63lkq/diff /var/lib/docker/overlay2

This issue should be removed as a cause for failure once the functional test exclusion has been completed. Issue link.

https://ci.adoptium.net/job/Test_openjdk17_hs_extended.functional_ppc64le_linux_testList_0/6/console
https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.openjdk_ppc64le_linux_testList_1/7/console
https://ci.adoptium.net/job/Test_openjdk23_hs_special.openjdk_ppc64le_linux_testList_0/8/console
https://ci.adoptium.net/job/Test_openjdk24_hs_sanity.openjdk_ppc64le_linux_rerun/2/console

All of the ppcle failures seem to be caused by the Xvfb timeout issue here.

There are many more failures than those listed above. These are just examples for each affected JDK version.

https://ci.adoptium.net/job/Test_openjdk17_hs_extended.openjdk_arm_linux_testList_2/19/

Job timeout.

Looks like the one before that failed as well, but not the one before that.

All three ran on the same machine (test-docker-ubuntu2004-armv7l-3) so my first theory is that something happened between job 18 and job 17 (the 31st of July and the 8th of August 2024) to make this machine much slower.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk21u/job/jdk21u-mac-aarch64-temurin/143/

Lost connection to test-orka-macos14-arm64-t6n2q

https://ci.adoptium.net/job/Test_openjdk21_hs_sanity.external_x86-64_linux_testList_0/5/console

[exec] �[91mE: Problem executing scripts APT::Update::Post-Invoke 'rm -f /var/cache/apt/archives/*.deb /var/cache/apt/archives/partial/*.deb /var/cache/apt/*.bin || true'

Issue link.

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-aix-ppc64-temurin/16/

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk23/job/jdk23-linux-riscv64-temurin/14/

Failure: https://ci.adoptium.net/job/build-scripts/job/jobs/job/jdk/job/jdk-alpine-linux-aarch64-temurin/142/

@adamfarley adamfarley self-assigned this Aug 13, 2024
This was referenced Aug 16, 2024
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@adamfarley adamfarley

Labels
aarch Issues that affect or relate to the aarch ARCHITECTURE aix Issues that affect or relate to the AIX OS alpine-linux Issues that affect or relate to the Alpine LINUX OS arm Issues that affect or relate to the ARM OS jenkins Issues that enhance or fix our jenkins server macos Issues that affect or relate to the MAC OS solaris Issues that affect or relate to the SOLARIS OS testing Issues that enhance or fix our test suites weekly-build-triage windows Issues that affect or relate to the WINDOWS OS
Projects
2024 3Q Adoptium Plan
Status: Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sxa @adamfarley