Add Reproducible Build Comparisons to Jenkins Pipelines

[andrew-m-leonard]

Add the ability in the ci-jenkins-pipelines to support dual build with integrated reproducible build comparison.
Only supported for certain versions: jdk-17+

The following existing toolset: https://github.com/adoptium/ci-jenkins-pipelines/tree/master/tools/reproduce_comparison
provides some tools, these need moving to temurin-build repo.
These are currently being updated/extended with some in-progress work here: https://github.com/andrew-m-leonard/openjdk-build/tree/repro_validate/tooling
note renaming of compareLinux.sh to linux_repro_build_compare.sh

Suggested solution:

• Utilise aqa-test framework to create a new "reproducible-test" job
• test job performs a second build by invoking the standard build job as a sub-job, but passing build_args of --build-reproducible-date "ISO8601 date", where the date is the same date used by the original build
• then compare the two builds, eg: https://github.com/andrew-m-leonard/openjdk-build/blob/4871528098f006f9680d3f3579351fd1ff823a37/tooling/linux_repro_build_compare.sh#L105
• produce a test result which includes the reproducible percentage, eg see: https://github.com/andrew-m-leonard/openjdk-build/blob/4871528098f006f9680d3f3579351fd1ff823a37/tooling/windows_repro_compare.sh#L45

[zdtsw]

related to adoptium/ci-jenkins-pipelines#397

[sophia-guo]

What is the expected results? Looking at the console output https://ci.adoptium.net/job/jdk17u-linux-x64-temurin_reproduce_compare/21/console, what issues or other steps should be taken care of ? @andrew-m-leonard

[andrew-m-leonard]

@sophia-guo So the scripts need a JDK in the PATH so they can run "jimage" and "jmod". I suggest simply unpacking "original" into a 2nd folder that you then use as a JDK in PATH, so you have 3 folders:

1. originalJdkHome
2. originalHome
3. reproducedHome
   and:
   export PATH=<path to originalJdkHome>/bin:$PATH

The linux_repro_compare script takes the java home folder as the path, so I think you need to call it as:
./linux_repro_compare.sh temurin /home/jenkins/workspace/jdk17u-linux-x64-temurin_reproduce_compare/original/<jdkTag> temurin /home/jenkins/workspace/jdk17u-linux-x64-temurin_reproduce_compare/reproduced/<jdk-tag>
So you need to query the Jdk home folder.

The end results from the linux_repro_compare.sh script should be an "rc" of 0 if identical. It will also print something like:

ReproduciblePercent = 98.96 %

[sophia-guo]

Linux enabled. https://ci.adoptium.net/job/jdk17u-linux-x64-temurin_reproduce_compare/
Platform priority order for comparison: Linux x64, Windows x64, Linux aarch64, Linux ppc64, Linux s390x, Mac x64, Mac aarch64

[sophia-guo]

Aarch 64 linux adoptium/ci-jenkins-pipelines#742

errors in aarch64 reproducible comparison #3435

[sophia-guo]

Linux ppc64, Linux s390x

Issues #3435

[sophia-guo]

Window issue remove signature error message with jdk17 windows-x64

[sophia-guo]

Done.