chore(ci): introduce declarative pod specs #4139

mboskamp · 2024-02-28T13:33:29Z

Related to https://github.com/camunda/team-automation-platform/issues/52

mboskamp · 2024-05-30T08:37:24Z

CI stage failure analysis

I ran the CI with the following labels to understand the impact of the CI changes. Find the analysis of the failures below.
CI labels:

ci:all-as
ci:all-db
ci:default-build
ci:jdk
ci:migration
ci:rest-api
ci:rolling-update

ASSEMBLY

Camunda Platform - Webapp - Root

Type: build error
Name: EACCES
Rootcause: unknown

Log

[2024-05-28T10:47:34.945Z] [INFO] npm WARN config global `--global`, `--local` are deprecated. Use `--location=global` instead.
[2024-05-28T10:47:35.747Z] [INFO] npm WARN config global `--global`, `--local` are deprecated. Use `--location=global` instead.
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! code EACCES
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! syscall open
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! path /.npmrc
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! errno -13
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! Error: EACCES: permission denied, open '/.npmrc'
[2024-05-28T10:47:35.747Z] [INFO] npm ERR!  [Error: EACCES: permission denied, open '/.npmrc'] {
[2024-05-28T10:47:35.747Z] [INFO] npm ERR!   errno: -13,
[2024-05-28T10:47:35.747Z] [INFO] npm ERR!   code: 'EACCES',
[2024-05-28T10:47:35.747Z] [INFO] npm ERR!   syscall: 'open',
[2024-05-28T10:47:35.747Z] [INFO] npm ERR!   path: '/.npmrc'
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! }
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! 
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! The operation was rejected by your operating system.
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! It is likely you do not have the permissions to access this file as the current user
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! 
[2024-05-28T10:47:35.747Z] [INFO] npm ERR! If you believe this might be a permissions issue, please double-check the
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! permissions of the file and its containing directories, or try running
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! the command again as root/Administrator.
[2024-05-28T10:47:35.748Z] [INFO] 
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! A complete log of this run can be found in:
[2024-05-28T10:47:35.748Z] [INFO] npm ERR!     /home/jenkins/agent/workspace/22_cambpm-ce_cambpm-main_PR-4139/.npm/_logs/2024-05-28T10_47_35_621Z-debug-0.log
[2024-05-28T10:47:35.748Z] [INFO] node:child_process:902
[2024-05-28T10:47:35.748Z] [INFO]     throw err;
[2024-05-28T10:47:35.748Z] [INFO]     ^
[2024-05-28T10:47:35.748Z] [INFO] 
[2024-05-28T10:47:35.748Z] [INFO] Error: Command failed: npm set @xlts.dev:registry https://****/
[2024-05-28T10:47:35.748Z] [INFO] npm WARN config global `--global`, `--local` are deprecated. Use `--location=global` instead.
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! code EACCES
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! syscall open
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! path /.npmrc
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! errno -13
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! Error: EACCES: permission denied, open '/.npmrc'
[2024-05-28T10:47:35.748Z] [INFO] npm ERR!  [Error: EACCES: permission denied, open '/.npmrc'] {
[2024-05-28T10:47:35.748Z] [INFO] npm ERR!   errno: -13,
[2024-05-28T10:47:35.748Z] [INFO] npm ERR!   code: 'EACCES',
[2024-05-28T10:47:35.748Z] [INFO] npm ERR!   syscall: 'open',
[2024-05-28T10:47:35.748Z] [INFO] npm ERR!   path: '/.npmrc'
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! }
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! 
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! The operation was rejected by your operating system.
[2024-05-28T10:47:35.748Z] [INFO] npm ERR! It is likely you do not have the permissions to access this file as the current user
[2024-05-28T10:47:35.749Z] [INFO] npm ERR! 
[2024-05-28T10:47:35.749Z] [INFO] npm ERR! If you believe this might be a permissions issue, please double-check the
[2024-05-28T10:47:35.749Z] [INFO] npm ERR! permissions of the file and its containing directories, or try running
[2024-05-28T10:47:35.749Z] [INFO] npm ERR! the command again as root/Administrator.
[2024-05-28T10:47:35.749Z] [INFO] 
[2024-05-28T10:47:35.749Z] [INFO] npm ERR! A complete log of this run can be found in:
[2024-05-28T10:47:35.749Z] [INFO] npm ERR!     /home/jenkins/agent/workspace/22_cambpm-ce_cambpm-main_PR-4139/.npm/_logs/2024-05-28T10_47_35_621Z-debug-0.log
[2024-05-28T10:47:35.749Z] [INFO] 
[2024-05-28T10:47:35.749Z] [INFO]     at checkExecSyncError (node:child_process:828:11)
[2024-05-28T10:47:35.749Z] [INFO]     at execSync (node:child_process:899:15)
[2024-05-28T10:47:35.749Z] [INFO]     at exec (/home/jenkins/agent/workspace/22_cambpm-ce_cambpm-main_PR-4139/webapps/frontend/scripts/xlts.js:23:10)
[2024-05-28T10:47:35.749Z] [INFO]     at Object.<anonymous> (/home/jenkins/agent/workspace/22_cambpm-ce_cambpm-main_PR-4139/webapps/frontend/scripts/xlts.js:41:3)
[2024-05-28T10:47:35.749Z] [INFO]     at Module._compile (node:internal/modules/cjs/loader:1099:14)
[2024-05-28T10:47:35.749Z] [INFO]     at Object.Module._extensions..js (node:internal/modules/cjs/loader:1153:10)
[2024-05-28T10:47:35.749Z] [INFO]     at Module.load (node:internal/modules/cjs/loader:975:32)
[2024-05-28T10:47:35.749Z] [INFO]     at Function.Module._load (node:internal/modules/cjs/loader:822:12)
[2024-05-28T10:47:35.749Z] [INFO]     at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12) {
[2024-05-28T10:47:35.750Z] [INFO]   status: 243,
[2024-05-28T10:47:35.750Z] [INFO]   signal: null,
[2024-05-28T10:47:35.750Z] [INFO]   output: [
[2024-05-28T10:47:35.750Z] [INFO]     null,
[2024-05-28T10:47:35.750Z] [INFO]     Buffer(0) [Uint8Array] [],
[2024-05-28T10:47:35.750Z] [INFO]     Buffer(982) [Uint8Array] [
[2024-05-28T10:47:35.750Z] [INFO]       110, 112, 109,  32,  87,  65,  82,  78,  32,  99, 111, 110,
[2024-05-28T10:47:35.750Z] [INFO]       102, 105, 103,  32, 103, 108, 111,  98,  97, 108,  32,  96,
[2024-05-28T10:47:35.750Z] [INFO]        45,  45, 103, 108, 111,  98,  97, 108,  96,  44,  32,  96,
[2024-05-28T10:47:35.750Z] [INFO]        45,  45, 108, 111,  99,  97, 108,  96,  32,  97, 114, 101,
[2024-05-28T10:47:35.750Z] [INFO]        32, 100, 101, 112, 114, 101,  99,  97, 116, 101, 100,  46,
[2024-05-28T10:47:35.750Z] [INFO]        32,  85, 115, 101,  32,  96,  45,  45, 108, 111,  99,  97,
[2024-05-28T10:47:35.750Z] [INFO]       116, 105, 111, 110,  61, 103, 108, 111,  98,  97, 108,  96,
[2024-05-28T10:47:35.750Z] [INFO]        32, 105, 110, 115, 116, 101,  97, 100,  46,  10, 110, 112,
[2024-05-28T10:47:35.750Z] [INFO]       109,  32,  69,  82,
[2024-05-28T10:47:35.750Z] [INFO]       ... 882 more items
[2024-05-28T10:47:35.750Z] [INFO]     ]
[2024-05-28T10:47:35.750Z] [INFO]   ],
[2024-05-28T10:47:35.750Z] [INFO]   pid: 4668,
[2024-05-28T10:47:35.750Z] [INFO]   stdout: Buffer(0) [Uint8Array] [],
[2024-05-28T10:47:35.750Z] [INFO]   stderr: Buffer(982) [Uint8Array] [
[2024-05-28T10:47:35.750Z] [INFO]     110, 112, 109,  32,  87,  65,  82,  78,  32,  99, 111, 110,
[2024-05-28T10:47:35.750Z] [INFO]     102, 105, 103,  32, 103, 108, 111,  98,  97, 108,  32,  96,
[2024-05-28T10:47:35.750Z] [INFO]      45,  45, 103, 108, 111,  98,  97, 108,  96,  44,  32,  96,
[2024-05-28T10:47:35.750Z] [INFO]      45,  45, 108, 111,  99,  97, 108,  96,  32,  97, 114, 101,
[2024-05-28T10:47:35.751Z] [INFO]      32, 100, 101, 112, 114, 101,  99,  97, 116, 101, 100,  46,
[2024-05-28T10:47:35.751Z] [INFO]      32,  85, 115, 101,  32,  96,  45,  45, 108, 111,  99,  97,
[2024-05-28T10:47:35.751Z] [INFO]     116, 105, 111, 110,  61, 103, 108, 111,  98,  97, 108,  96,
[2024-05-28T10:47:35.751Z] [INFO]      32, 105, 110, 115, 116, 101,  97, 100,  46,  10, 110, 112,
[2024-05-28T10:47:35.751Z] [INFO]     109,  32,  69,  82,
[2024-05-28T10:47:35.751Z] [INFO]     ... 882 more items
[2024-05-28T10:47:35.751Z] [INFO]   ]
[2024-05-28T10:47:35.751Z] [INFO] }
[2024-05-28T10:47:35.751Z] [INFO] 
[2024-05-28T10:47:35.751Z] [INFO] Node.js v17.9.1

Camunda Platform - webapp - webjar

Type: build error, phantom error
Name: -
Rootcause: unknown, possibly caused by EACCES
notes: no error in the log, failure indicated in the Maven reactor summary.

Distro EE

Camunda Platform EE - Webapp - Plugins - Root

Type: build error
Name: EUSAGE
Rootcause: unknown, possibly out-of-sync package.json and package-lock.json

Details

[2024-05-28T11:16:55.935Z] [INFO] npm ERR! code EUSAGE
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! `npm ci` can only install packages when your package.json and package-lock.json or npm-shrinkwrap.json are in sync. Please update your lock file with `npm install` before continuing.
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.935Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! Missing: [email protected] from lock file
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! Clean install a project
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! Usage:
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! npm ci
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! Options:
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! [--no-audit] [--foreground-scripts] [--ignore-scripts]
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! [--script-shell <script-shell>]
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! aliases: clean-install, ic, install-clean, isntall-clean
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! 
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! Run "npm help ci" for more info
[2024-05-28T11:16:55.936Z] [INFO] 
[2024-05-28T11:16:55.936Z] [INFO] npm ERR! A complete log of this run can be found in:
[2024-05-28T11:16:55.936Z] [INFO] npm ERR!     /home/camunda/.npm/_logs/2024-05-28T11_16_52_623Z-debug-0.log

parent/pom.xml

Related to camunda/team-automation-platform#52

mboskamp · 2024-09-02T09:33:59Z

Current state:

All commits squashed
PR includes enabling of declarative podspecs for ASSEMBLY, JDK stages, and restapi-docs
The EE stages are changed with https://github.com/camunda/camunda-bpm-platform-ee/pull/954

Open TODOs:

On hold until Infra implemented https://github.com/camunda/team-infrastructure/issues/666
Final decision for image for JDK 11 and 17 builds is pending. See https://github.com/camunda/team-automation-platform/issues/158 for details.
Remove temporary shared-library branch name from Jenkinsfiles.

psavidis · 2024-09-17T14:33:31Z

Review

Stages Confirmed

ASSEMBLY - screenshot
stage-restapi-docs - screenshot - Runs only on master or version branches.
platform-jdk-openjdk-jdk-11-latest - screenshot
platform-jdk-openjdk-jdk-17-latest - screenshot
platform-jdk-jdk-11-latest - Will be treated in separate PR
platform-jdk-jdk-17-latest - Will be treated in separate PR

@mboskamp Do we have an execution for demonstrates the usage of the podspec for the stage-restapi-docs stage?

❓Is my understanding correct that the jdk-11-latest and jdk-17-latest are going to be treated separately in another PR?

mboskamp · 2024-09-18T04:09:50Z

@mboskamp Do we have an execution for demonstrates the usage of the podspec for the stage-restapi-docs stage?

Looking at the condition for stage-restapi-docs I believe it only runs on master or version branches (e.g. 7.21). See also cambpmDefaultBranch.

❓Is my understanding correct that the jdk-11-latest and jdk-17-latest are going to be treated separately in another PR?
Correct, there is a follow-up ticket for re-introducing the following stages:

platform-jdk-jdk-21-latest
platform-jdk-jdk-17-latest
platform-jdk-jdk-11-latest

mboskamp self-assigned this Feb 28, 2024

mboskamp added the ci:jdk Runs the builds for all supported Java versions. label Mar 22, 2024

mboskamp force-pushed the 52-declarative-pod-specs branch from a302e44 to 8909d65 Compare May 23, 2024 13:34

tasso94 reviewed Jun 5, 2024

View reviewed changes

parent/pom.xml Show resolved Hide resolved

mboskamp added the ci:e2e Runs the frontend end-to-end tests. label Jun 21, 2024

mboskamp force-pushed the 52-declarative-pod-specs branch from 765bc9b to 53bc350 Compare August 7, 2024 07:44

mboskamp removed ci:e2e Runs the frontend end-to-end tests. ci:migration Runs the process instance migration builds. ci:rest-api Runs extra builds for the REST API (currently only WLS compatibility builds). ci:rolling-update Runs the rolling update builds. labels Aug 8, 2024

mboskamp removed the ci:skipTests Skips tests execution in Assembly and Distro-ee stages. label Aug 27, 2024

mboskamp force-pushed the 52-declarative-pod-specs branch 2 times, most recently from b4ff922 to efa3aee Compare September 2, 2024 09:26

chore(ci): use declarative podspecs for frontend building stages

18b9c8c

Related to camunda/team-automation-platform#52

mboskamp force-pushed the 52-declarative-pod-specs branch from efa3aee to 18b9c8c Compare September 2, 2024 09:29

mboskamp marked this pull request as ready for review September 16, 2024 08:34

squash(ci): cleanup and use final images

cc9a08d

mboskamp added the ci:e2e Runs the frontend end-to-end tests. label Sep 16, 2024

mboskamp requested a review from psavidis September 16, 2024 13:04

psavidis approved these changes Sep 18, 2024

View reviewed changes

mboskamp merged commit b22d963 into master Sep 18, 2024
8 checks passed

mboskamp deleted the 52-declarative-pod-specs branch September 18, 2024 12:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore(ci): introduce declarative pod specs #4139

chore(ci): introduce declarative pod specs #4139

mboskamp commented Feb 28, 2024

mboskamp commented May 30, 2024

mboskamp commented Sep 2, 2024 •

edited

Loading

psavidis commented Sep 17, 2024 •

edited

Loading

mboskamp commented Sep 18, 2024

chore(ci): introduce declarative pod specs #4139

chore(ci): introduce declarative pod specs #4139

Conversation

mboskamp commented Feb 28, 2024

mboskamp commented May 30, 2024

CI stage failure analysis

ASSEMBLY

Camunda Platform - Webapp - Root

Camunda Platform - webapp - webjar

Distro EE

Camunda Platform EE - Webapp - Plugins - Root

mboskamp commented Sep 2, 2024 • edited Loading

psavidis commented Sep 17, 2024 • edited Loading

Review

mboskamp commented Sep 18, 2024

mboskamp commented Sep 2, 2024 •

edited

Loading

psavidis commented Sep 17, 2024 •

edited

Loading