Commit Graph

162 Commits

Author SHA1 Message Date
Marc Mattmüller 335bdead05 jobs/updateSrcRev: released commit and push part after the src rev update
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 13:39:18 +02:00
Marc Mattmüller 93eb7c12fa jobs/updateSrcRev: just make git reset HEAD after updating src rev
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 13:20:51 +02:00
Marc Mattmüller 86f82a6411 jobs/updateSrcRev: do not update src revision at clone step
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 12:56:42 +02:00
Marc Mattmüller c4d49cdc0e jobs/updateSrcRev: added cloning of the repository (was missing)
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 12:50:08 +02:00
Marc Mattmüller 3ff3dc9435 doc/nwl-ci: added update src rev part, branch seeding and nightly trigger
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 12:29:51 +02:00
Marc Mattmüller 2a56bbd0e8 jobs/updateSrcRevisions: added functionality to the skeleton
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 12:17:38 +02:00
Marc Mattmüller c79814899b jobs/common: update the yocto target (env.CI_IMAGE)
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 10:25:29 +02:00
Marc Mattmüller e0ae8a99e0 jobs/seed: moved environment getter into pipeline statement
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 10:02:19 +02:00
Marc Mattmüller bd63e87719 jobs/seed: use variable for branch and use environment syntax
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 09:41:58 +02:00
Marc Mattmüller a8e655a0d8 jobs/seed: use the parameter of the seeded branch for the seede jobs
The branch for the jobs to seed was set to main but we might want
to seed the branch develop. Thus the parameter of the seed job
replaces the hardcoded main.
I am not sure if this solution works but wihtout trying we won't
know :-D

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 09:26:49 +02:00
Marc Mattmüller 6779ef5846 jobs/seed: added nightly trigger with replaced pipelinetriggers
since job dsl plugin 1.77 the option 'triggers' is deprecated and
will be removed (causes problems:
https://issues.jenkins.io/browse/JENKINS-53775), see
https://github.com/jenkinsci/job-dsl-plugin/wiki/Migration#migrating-to-177
Thus the option triggers was replaced

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 09:07:34 +02:00
Marc Mattmüller 1840ec74ea docker/nwl-cicd.yaml: disable SCM poll for seed job
when seeding a branch other than the default one the poll
detects a SCM change and triggers right after a new seed job
which might revert the jobs seeded by the previous job run.
With this behavior it won't be possible to seed a specific
and run the intentionaly seeded jobs.
Thus, this commit disables SCM poll.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-09-04 08:38:40 +02:00
Marc Mattmüller be603724d2 jobs/common: refactored gitCheckout() for using more flexible
the function gitCheckout() holds the following steps:
- git clone unless done
- checking out a branch/tag/commit including rebase and updating
  submodules
- launching the update source revision script
- printing the submodule status
- printing the last 3 commits of the git history

But so far you could not use the steps separately. Thus, this
function was refactored by extracting some steps into own
functions so that they can be used easily.
Example: the job workspace is the cloned git repository and you
want to update the source revision hashes ;-P

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-29 14:40:31 +02:00
Marc Mattmüller 54161e2b5c jobs: added seed for new job UpdateSrcRevisions (incl. job skeleton)
A request was to have the update source revision part in a separate
job as in OEM Linux. This commit seeds a new job currently with
an empty skeleton.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-29 14:27:18 +02:00
Marc Mattmüller a138da021e jobs/buildAll: fixed build yocto job name and added clean-up of repo
with all the changes we have had regarding seed job integration in
the HAC instance the job name changed. Thus, fixing the name when
triggering the build job.
Additionally the script updating the source revisions leaves some
unstaged changes which is resolved by adding the clean-up of the
repository after building all targets.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-29 09:01:16 +02:00
Marc Mattmüller 705aa2c1ad jobs/buildTarget: added post step cleaning repository
the post step cleans the residuals from the update of the source
revisions.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-29 08:56:32 +02:00
Marc Mattmüller 246c859a35 jobs/common: added cleanup function restoring unstaged changes
with the script updating the source revisions some unstaged
changes reside in the repository. A following job will be unable
to succeed as the clone will fail. Thus, adding this function
which now can be used in the specific jobs.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-29 08:53:51 +02:00
Marc Mattmüller 3364307149 doc/nwl-ci: updated sections about integrating seed job in NWL HAC instance
On the ansible instance we saw that the seed job concept was working.
To be as felxible as possible as well on the HAC instance this
concept shall be integrated into this instance. Therefore this commit
holds all the steps so that the yocto build pipeline is starting to
build.
NOTE: currently the NWL project is in progress and the build is not
succeeding.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-28 18:22:42 +02:00
Marc Mattmüller fede53b9f5 Revert "jobs/seed: set git credentials back to admin_credentials"
This reverts commit c0086b4210.

There was a path mismatch for the ssh key. Thus this commit can be
reverted.
2023-08-28 17:31:55 +02:00
Marc Mattmüller c0086b4210 jobs/seed: set git credentials back to admin_credentials
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-28 16:55:18 +02:00
Marc Mattmüller 2efd3fdfa0 docker/nwl-cicd.yaml: added wipeWorkspace to seed job
withtout wiping the workspace seeding does not work correctly.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-28 16:32:40 +02:00
Marc Mattmüller 236f4b95d5 jobs: replaced admin_credentials with nmgit_credentials for git access
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-28 16:31:49 +02:00
Marc Mattmüller c582eb64d2 jobs/seed: set git credentials to admin_credentials and remove doc job
On the HAC instance, we currently do not want the documentation
job of the work of Marc Mattmueller, thus this job is removed.
Additionally the git credential ID differs between HAC- and ansible
instance. Therefore we set on this branch the credentials of the
HAC instance.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-28 14:01:35 +02:00
Marc Mattmüller f2a6d85321 jobs/seed: let the seeded jobs run anonymous
the reason is simple: There are currently still two AD's available
for HAC and Netmodule, i.e. the LDAP connection works only for
HAC employees.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-28 13:29:11 +02:00
Marc Mattmüller 7937b4bac7 doc/researchAnsible: updated due to enhancement of adding variable target
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 16:50:36 +02:00
Marc Mattmüller d2ce20787d playbooks: updated hosts with target variable
the playbooks shall only run on the hosts provided by the variable
target.
NOTE: the default target is set within the job templates

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 16:34:44 +02:00
Marc Mattmüller a3583e2b77 docker/plugins.txt: added plugin generic webhook trigger to list
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 15:47:57 +02:00
Marc Mattmüller a3edca0cb5 jobs/seed: removed the number in the description of the doc job
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 15:36:57 +02:00
Marc Mattmüller f4aeb3c3dd jobs/seed: adapted jenkins files and integrated split of nightly and yocto build
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 15:35:05 +02:00
Marc Mattmüller e645a68eac jobs/Common: added temporary source update tasks (sub-repositories)
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 11:58:12 +02:00
Marc Mattmüller 0afedfec06 jobs/Common: remove split of archiving built artifacts and manifests
The manifests will be added to the *.ci-artifacts file and thus
no longer need to be archived separately.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 11:58:00 +02:00
Marc Mattmüller 5768393db7 jobs/buildAll: released all legacy netmodule targets in nightly
The function isMachineSane() held so far a guard that only the
machine cn9130-cf-pro was built. According to the latest update
the legacy parts are now integrated and thus can be released to
be built.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 11:32:06 +02:00
Marc Mattmüller 64c24ccfcb doc/nwl-ci: added setup of hash equivalence server
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 11:28:21 +02:00
Marc Mattmüller 5313b9e4f1 jobs/Common: removed the duplicated file type for the temporary file name
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 10:04:25 +02:00
Marc Mattmüller f64940dcfd jobs/Common: temporary fix for the manifest file name
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 09:52:06 +02:00
Marc Mattmüller 3e5d3a0e69 jobs/Common: printing info about hash equiv server and fix typo
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 07:28:25 +02:00
Marc Mattmüller d63f4db6fa jobs/Common: integrated hash equivalence server into auto.conf
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-21 07:25:22 +02:00
Alexandre Bard 9bc8929d43 jobs/nwlTargets: Change machine names according to bsp layer 2023-08-10 14:02:03 +02:00
Alexandre Bard 4d61c07154 Jenkinsfile_Common: Build fitimage as default
The nwl-image-testable does not exists anymore and for the moment we are
using the fitimage.
2023-08-04 11:29:58 +02:00
Marc Mattmüller 450082c366 doc/nwl-ci: fixed server path of sstate-cache mirror
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-01 11:01:35 +02:00
Marc Mattmüller c50ff430a1 doc/nwl-ci: added change of manage script for an additional ssh key
to have the ssh key of nginx available in the docker instance, the
manage script needed to be adapted as each key was added with a
single mount command.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-01 10:59:36 +02:00
Marc Mattmüller 8f6ae85d9e jobs/buildAll,buildTarget: suppressed shell commands on job console
to have a better overview some shell commands of basic parts are
suppressed with set +x

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-01 10:58:03 +02:00
Marc Mattmüller 9d7597ea4b jobs/common: fixed sstate-cache sync and refactored for less output
Fixed the sstate-cache mirror synchroniziation including more
output about what is snychronized. Additionally suppressed the
shell commands to have less output on the job console.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-01 10:55:34 +02:00
Marc Mattmüller 40a9087135 jobs/buildAll: refactoring for a better readablility
with this commit a bug (testing if build job was successful) is
fixed too.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-08-01 09:19:55 +02:00
Marc Mattmüller a734db2932 doc/nwl-ci: documented adaptions for sstate-cache mirror and job split
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-07-31 18:07:36 +02:00
Marc Mattmüller ea82dedaa1 jobs/buildAll: workaround for administration permissions
getting the result of buildJob needs approval but as we are
triggering the job anonymous this is not possible. Thus, this
workaround is implemented

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-07-31 17:37:05 +02:00
Marc Mattmüller 74ef65ec33 jobs/buildAll: fixed small typo and enhanced stage status
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-07-31 17:12:51 +02:00
Marc Mattmüller 27afb7e2ef jobs/nwlTargets: added the legacy NetModule machines
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-07-31 16:28:31 +02:00
Marc Mattmüller 34717bd4bc jobs/common: adapted common jenkins file according the needs
the previous 2 commits need the changes of this file. But for a
better visibility it was committed separately

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-07-31 16:27:32 +02:00
Marc Mattmüller a3c8507d5a jobs: add new pipeline building a yocto target (BuildTarget)
this job is responsible to build a yocto target, syncing the sstate
cache and deploying the artifact to nexus.

Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
2023-07-31 16:26:36 +02:00