This commit holds now all the documentation to bring up a jenkins
instance using ansible and AWX.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
The topic Jcasc was already handled. With this commit we are able to
setup a Jenkins by using docker-compose.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
the git credential ID is different for the AWX instance, thus the
jobs are selected according the hostname.
additionally I reordered the seed jobs in nwl-cicd.yaml
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
This commit holds an intermediate state with the following key points:
* Having a NWL build pipeline integrated in the infrastructure of HAC
- NOTE: the pipelines can be triggered as anonymous but that's it
we do not have the permissions to do anything on this
Jenkins Controller
* The results of the research about ansible playbooks and AWX
* The documentation of all the work done like
- Thoughts about the next-level CI/CD at NetModule
- CI use-cases and Recommendations
+ workflow of the different teams
- CI pipelines within Bitbucket
+ similar to GitLab CI as used at NetModule
- Research about Ansible Playbook
- NWL CI CI setup on the HAC infrastructure
+ first setup
Squashed commit of the following:
commit 974b77234d
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 14:12:19 2023 +0200
doc/researchAnsible: added sections build docker image and conclusion
With this commit we set up a machine until building a docker image on
it. The next step would be to start the docker container or the
docker compound.
It is as well possible to run the playbooks without having an AWX
instance but AWX gives you more overview about the things that are
available and happening. E.g. you can set up schedules for re-
occurring jobs. For reasons of completness an example to launch
a playbook from command line is added in the conclusion section.
Additionally I added a section about combining playbooks in one
common playbook which might be useful to have really a single
button press for setting up a new machine.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 72a8b96ea0
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 13:34:01 2023 +0200
playbook/build-docker: do not gather facts and register build of docker
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit b25d6f32d3
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 13:20:51 2023 +0200
playbook/build-docker: using shell as the docker module is not available
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 29e807db1b
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 13:00:44 2023 +0200
playbook,docker: added playbook to build a docker image
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 35e28eb1a3
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 12:37:48 2023 +0200
playbooks/clone-repo: added condition when repo is already cloned
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 1960187318
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 11:52:58 2023 +0200
doc/researchAnsible: added section to clone a git repository
AWX uses separate ssh keys to access the host. The host itself uses
its own ssh keys to access bitbucket. The added section shows a way
how to handle such a condition.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 262c560f38
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 11:51:22 2023 +0200
doc/researchAnsible: added snippet reconfiguring docker network
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 8b56069a38
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 11:30:00 2023 +0200
playbooks/clone-repo: refactored the playbook
removed the logs to increase the security
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 15732a2cf7
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 11:14:09 2023 +0200
playbooks/clone-repo: fixed repo url (forgotten during refactoring)
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 14b51efb5d
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 10:58:33 2023 +0200
playbooks/clone-repo: 1 task for cloning, checking out and updating
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 0b66f54f97
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 10:50:47 2023 +0200
playbooks/clone-repo: changed creating auto ssh add file and its path
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit fcceaca96e
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 10:43:05 2023 +0200
playbooks/clone-repo: make auto ssh add file executable
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 2438809884
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 10:33:20 2023 +0200
playbooks/clone-repo: using shell commands to clone repo
by using shell commands we have more flexibility to clone the repo
using specific ssh keys.
Additionally we provide the passphrase for the ssh key using the
AXW vault.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 4d9f64f3dc
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 13 08:06:49 2023 +0200
playbooks/clone-repo: replaces ip with name of bitbucket
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 9920d1d9b4
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon Jun 12 17:52:19 2023 +0200
inventory: switching the host to a server in the HAC network
The created server for the conceptional work of the CoreOS CI is
currently available but not much used. Thus, I switched the host
of the inventory to this server. With it it should be possible to
clone a repository, build and launch a docker image.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 3216c8d0f6
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon Jun 12 12:00:23 2023 +0200
inventory,playbook/conf-docker-net: changed the VM ip and used sudo
the IP of my VM is adapted due to my smartphone acting as gateway
and DHCP server. Thus I made the work easier and change the IP in
the inventory.
For the docker network reconfiguration I used sudo so that we can
use the priviledged mode
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 3027f8e284
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 6 16:27:21 2023 +0200
playbooks: added configure docker network playbook first version
per default docker uses IP 172.17.0.0/16 which conflicts with the
test network at NetModule. Hence, we reconfigure it to
192.168.5.1/24
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit ef3fd030ba
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 6 14:29:16 2023 +0200
doc/ciWithinBitbucket: added link to keep in mind
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 4a7633f845
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 6 14:28:39 2023 +0200
doc/researchAnsible: added section for creating ssh keypairs
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit f691f5206c
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Jun 6 13:48:22 2023 +0200
playbooks;inventory: added variable to production.yaml and added create-ssh-key playbook
The production inventory got a new variable called host_name which we use in the
newly added playbook creating an SSH key.
The playbook holds the no_log tag for keeping the execution parts more secure.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 70d033bde7
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon Jun 5 13:23:50 2023 +0200
doc: added the installed Jenkins plugins on the NWL instance
additionally, I added the ones which are installed on the
NetModule Jenkins instance.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit c304cf9954
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon Jun 5 13:18:49 2023 +0200
doc: added new chapter with title CI within Bitbucket
the topic about using the Git server (Bitbucket or GitLab) for
user-space applications has driven me into that direction.
Unfortunately there is a lack of information and permission to
move on with this topic. Thus, I postponed it until I get some
news :-)
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit a9a720a364
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 30 16:53:20 2023 +0200
doc: added CI use-cases
visualized the different use-cases for the CI environment
including the TDD workflow.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 565493b9de
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 22 16:09:42 2023 +0200
playbook/clone-repo: replaced bitbucket name with ip
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 8837554aba
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 22 11:06:24 2023 +0200
playbooks/clone-repo: removed prompting but added std output
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit bce9b6c45f
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 22 10:59:28 2023 +0200
playbooks/clone-repo: fixed indentation
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 470a77f787
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 22 10:53:34 2023 +0200
playbooks/clone-repo: added missing syntax element for prompting
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 850396ebc3
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 22 10:38:11 2023 +0200
playbooks: added playbook to clone a repository
the repository url shall be prompted to keep it more flexible.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit ae29034593
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 16 14:22:12 2023 +0200
doc/researchAnsible: added part about basic pkg installation with sudo
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit c37bd6f380
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 15 18:18:19 2023 +0200
playbooks,inventory: added playbook installing basic tools on a VM
As soon as a virtual machine is ready, we install docker as it gives
the most flexbility for our CI and the docker images are versionized.
Hence, we install docker as main installation package.
We assume that the VM holds the following users:
- root
- superuser (added to sudoers)
- user
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 9e6a6d7c8d
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 15 09:52:33 2023 +0200
doc/researchAnsible: added job template for getting started playbook
Documented the job template to get the information residing in
the playbook getting_started/os-rls.yml
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit c22a7a2f38
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 17:02:50 2023 +0200
doc/researchAnsible: added sections for project and inventories
this commit holds the information about how to synchronize a git
project containing ansible playbooks and hosts with AWX.
NOTE: getting the hosts of the inventroy file is not that obvious,
hence it is worth to read it.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 6a824507ed
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 15:19:43 2023 +0200
ansible.cfg,os-rls.yml: added configuration for files and fixed var
fixed variable in playbook os-rls.yml and added config file for
the ansible file paths.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit ea59c88fe0
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 13:30:31 2023 +0200
inventory/production: add data type ending
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 616c35f9b1
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 13:26:40 2023 +0200
inventroy/production: reformatted the content
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 777d708883
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 13:22:00 2023 +0200
inventory: removed subdirectory and renamed ci to production
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit cc1c338e09
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 12:25:16 2023 +0200
researchAnsible: updated with setup of latest AWX version
The latest version of AWX requires a Kubernetes Cluster. This
commit holds the update of the page and shows both installation
methodes (directly with docker and the latest version with a
minikube).
Additionally, I added a new section setting up a virtual machine
for test purpose. With it another section for accessing such
machines over SSH.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 118b75408d
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 9 12:02:29 2023 +0200
inventroy,playbooks: arranged files in subdirectories
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 8b9d480e26
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 8 17:14:21 2023 +0200
inventory: added IP address of newly created VM
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit add58c392f
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 2 13:25:52 2023 +0200
inventory: renamed inventory
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 3dfabb5b3d
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 2 13:14:31 2023 +0200
playbooks,collections: renamed to .yml and added collection requirements
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 740a647460
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue May 2 12:33:30 2023 +0200
doc,ansible: documented setup of AWX, added structure for a first playbook
Documented the setup of an AWX instance using docker-compose.
Added a first playbook including inventory
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit d4f00bf431
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 1 12:04:54 2023 +0200
doc/nwl-ci: added parts about CI adaptions
the nightly timer triggers the job without target parameter. Thus,
the job checks if it is a nightly build and takes a default target
which is the clearfog one.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit a41f1b1148
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Mon May 1 09:11:19 2023 +0200
jobs/build: use default target when job is triggered by timer
In a nightly build the job parameter TARGET stays on "selected...".
Thus, a check verifies if the job is triggered by a timer and then
takes the default target which is the first one in the file
'nwlTargets'.
With it the description name of the build gets a postfix 'nightly'.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 27c7777f79
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 25 16:12:31 2023 +0200
jobs/common: removed settings for sstate- and equiv server
currently the environment is unclear and is set to ToDo
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit dd0c8c871c
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 25 15:15:04 2023 +0200
doc: updated changes due to permission restriction
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 3e52ea97ed
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 25 14:35:11 2023 +0200
jobs/common: set nwl image for CI
with the current Merge Request there are now 2 images for the NWL.
One is specially for the CI.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 0e39db0e35
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 18 16:04:00 2023 +0200
README,doc: added next-level-CI and NWL-CI documentation
adapted README accordingly to build the documentation.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 34eae1d78d
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 18 10:09:58 2023 +0200
README: adapted readme with a bit more details
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit c3056f4cb5
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 18 09:14:23 2023 +0200
jobs/common: removed residing parallel configuration for auto.conf
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit ca4b22b136
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 18 09:13:47 2023 +0200
jobs/build: added missing removing of pre clone directory
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit eb19873605
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 18 08:47:12 2023 +0200
jobs: adding git credentials and finalized pre-node step
need to clone the repository to load the list of the buid
targets in pre-node step.
added a git credential ID getter to clone repositories.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 4251812565
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 18 08:18:25 2023 +0200
jobs/Build: fixed apostrophes when setting the job description
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
commit 5b22271083
Author: Marc Mattmüller <marc.mattmueller@netmodule.com>
Date: Tue Apr 11 16:33:29 2023 +0200
jobs: added first draft of NWL build pipeline
this commit holds additionally a common jenkins file and a
file containing the targets (machines) to build. Latter is
used for the drop-down parameter in the build job.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
With this commit we set up a machine until building a docker image on
it. The next step would be to start the docker container or the
docker compound.
It is as well possible to run the playbooks without having an AWX
instance but AWX gives you more overview about the things that are
available and happening. E.g. you can set up schedules for re-
occurring jobs. For reasons of completness an example to launch
a playbook from command line is added in the conclusion section.
Additionally I added a section about combining playbooks in one
common playbook which might be useful to have really a single
button press for setting up a new machine.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
AWX uses separate ssh keys to access the host. The host itself uses
its own ssh keys to access bitbucket. The added section shows a way
how to handle such a condition.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
by using shell commands we have more flexibility to clone the repo
using specific ssh keys.
Additionally we provide the passphrase for the ssh key using the
AXW vault.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
The created server for the conceptional work of the CoreOS CI is
currently available but not much used. Thus, I switched the host
of the inventory to this server. With it it should be possible to
clone a repository, build and launch a docker image.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
the IP of my VM is adapted due to my smartphone acting as gateway
and DHCP server. Thus I made the work easier and change the IP in
the inventory.
For the docker network reconfiguration I used sudo so that we can
use the priviledged mode
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
per default docker uses IP 172.17.0.0/16 which conflicts with the
test network at NetModule. Hence, we reconfigure it to
192.168.5.1/24
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
The production inventory got a new variable called host_name which we use in the
newly added playbook creating an SSH key.
The playbook holds the no_log tag for keeping the execution parts more secure.
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
the topic about using the Git server (Bitbucket or GitLab) for
user-space applications has driven me into that direction.
Unfortunately there is a lack of information and permission to
move on with this topic. Thus, I postponed it until I get some
news :-)
Signed-off-by: Marc Mattmüller <marc.mattmueller@netmodule.com>
Marc Mattmüller