3406 Commits

Author SHA1 Message Date
Thiago Brito
6dcc7f8f89 Enable taint toleration for mariadb
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: Iab78370182b15b48df964eb2dfdc957a9868c708
2022-03-29 11:34:48 -03:00
Graham Steffaniak
b5c285ae98 Revert chart naming to .Release.Name expression
CHG required for existing deployments to be
	 upgraded in place.

Change-Id: Ife4278f17601358dcd853c29977f5e2e88e521dc
2022-03-28 19:35:14 +00:00
Graham Steffaniak
a4f39d7753 Remove helmv2 tillerVersion from helm-toolkit
Needed since the chart fails to lint with tillerVersion included.

Change-Id: If5ce0ffa3d5abbef0d91e0e667d1b30c866fa020
2022-03-25 15:00:57 -05:00
Zuul
373b20dc8c Merge "Move osh-infra jobs to use helm3" 2022-03-25 19:12:09 +00:00
Zuul
137189cc3a Merge "Enable taint toleration for memcached" 2022-03-25 18:48:50 +00:00
Zuul
66da955e5d Merge "[DATABASE] Minor change to list local archive files" 2022-03-25 18:48:47 +00:00
Zuul
a61ba9ea0b Merge "Enable taint toleration for ceph-rgw" 2022-03-25 15:30:59 +00:00
Zuul
c1fc27148c Merge "Enable taint toleration for ingress" 2022-03-25 15:30:56 +00:00
Zuul
953990b2fe Merge "Enable taint toleration for openvswitch" 2022-03-25 15:30:52 +00:00
Gage Hugo
79d75267ea Move osh-infra jobs to use helm3
This change updates many of the deployment scripts to properly
handle deploying each service via helm 3 and updates each job
to use the helm v3 install script.

Change-Id: I90a7b59231376b9179439c2554e46449d59b9c15
2022-03-24 13:05:42 -05:00
Tran, Huy (ht095u)
a22b71446e [DATABASE] Minor change to list local archive files
Minor change to list archive directory with files in sub-directory
as below. Without the change, only the directory name 'quarantine'
is displayed.

All Local Archives
==============================================
mariadb.openstack.all.2022-03-20T18:00:17Z.tar.gz
mariadb.openstack.all.2022-03-21T00:00:16Z.tar.gz
mariadb.openstack.all.2022-03-21T06:00:12Z.tar.gz
mariadb.openstack.all.2022-03-21T12:00:13Z.tar.gz
mariadb.openstack.all.2022-03-21T18:00:11Z.tar.gz
quarantine/mariadb.openstack.all.2022-03-23T00:00:12Z.tar.gz
quarantine/mariadb.openstack.all.2022-03-23T06:00:11Z.tar.gz
quarantine/mariadb.openstack.all.2022-03-23T12:00:14Z.tar.gz
quarantine/mariadb.openstack.all.2022-03-23T14:24:04Z.tar.gz

Change-Id: Ic47a30884b82cdecedbfff8ddf1d85fc00d89acc
2022-03-24 12:58:00 -05:00
Thiago Brito
010664e87e Enable taint toleration for memcached
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: If0e02fe8df0bef5065ab99f71263b55f03ab5c3a
2022-03-24 14:56:28 -03:00
Zuul
1f894e9004 Merge "Enable taint toleration for gnocchi" 2022-03-24 17:04:09 +00:00
Zuul
542f723e09 Merge "Updated chart naming for subchart compatibility" 2022-03-24 17:01:05 +00:00
Zuul
c678a9aca2 Merge "Fix indentation" 2022-03-24 16:57:06 +00:00
Zuul
51962f7c62 Merge "Fix invalid fields in values for postgresql" 2022-03-24 16:55:34 +00:00
Graham Steffaniak
8e3c97714b Updated chart naming for subchart compatibility
CHG: - reno-check script to ignore subchart
     - .Release.Name to match .Chart.Name instead:
       - mariadb
       - rabbitmq
       - memcached

Change-Id: Ieaecd5537c2843357b2787f6f59405b672ce8b8a
2022-03-23 17:24:05 -05:00
Thiago Brito
7d1d629e51 Enable taint toleration for gnocchi
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: If11d265c27b8f6a4c5996d60990eadde2346c0f8
2022-03-23 18:10:19 +00:00
Thiago Brito
0da995972d Enable taint toleration for ingress
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: Ibac507770edd09079e01206fd85b76a193d22915
2022-03-23 18:10:09 +00:00
Thiago Brito
09bf2fbb92 Enable taint toleration for ceph-rgw
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: I5e55e93d4034da5f7f323a6dcb3ca511abd9ac4e
2022-03-23 18:09:38 +00:00
Thiago Brito
1e2b18f6c3 Enable taint toleration for libvirt
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: I8e1a719235b364907491df25ce7e32133163ecf9
2022-03-23 18:09:12 +00:00
Thiago Brito
a65af0db27 Enable taint toleration for openvswitch
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: I0f6d98297e973f420cb363a8e6eb5e00bdfd4bb4
2022-03-23 16:24:02 +00:00
Thiago Brito
0d5b16cabb Enable taint toleration for helm-toolkit
This adds taint toleration support for openstack jobs

Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
Change-Id: I168837f962465d1c89acc511b7bf4064ac4b546c
2022-03-23 10:30:59 -03:00
Zuul
9a5da15288 Merge "[DATABASE] Code improvement" 2022-03-23 06:03:21 +00:00
Gage Hugo
bc5bad42b4 Fix invalid fields in values for postgresql
The postgresql chart currently fails to run when deployed with
helm v3 due to invalid fields defined in values.yaml that are
more strictly enforced. This change removes these invalid values
to allow deploying the postgresql chart with helm v3.

Change-Id: Iabd3cfa77da618026ceb2dfdffd5d2a0b1519d93
2022-03-22 17:00:53 -05:00
Gage Hugo
477eed26bf Fix indentation
The prometheus-blackbox-exporter chart current fails to install
with helm v3 due to an invalid indentation with metadata labels.

This change fixes the indentation to the correct amount in order
to successfully build and install when using helm v3.

Change-Id: I95942fe49b39a052dd83060b597807f6a52627e4
2022-03-22 15:35:17 -05:00
Sigunov, Vladimir (vs422h)
f845081bb5 [DATABASE] Code improvement
This is to cover some relatively rare sutuation, when backups
of different databases can share the same storage.

Change-Id: I0770e1baf3d33e2d56c34558a9a97a99a01e5e04
2022-03-22 14:43:27 -04:00
Ritchie, Frank (fr801x)
ec69dd0ef9 Exec libvirt even when creating secrets
With "hostPid: true" we want the entrypoint process to be libvirtd not a wrapper so that process lifecycle management works as expected.

The fix for now is

  * start libvirtd
  * create secrets (libvirtd needs to be running for this)
  * kill it

then start it again using exec so libvirtd is the entrypoint pid
and container lifecycle should work as expected.

Change-Id: I9ef8a66da0fba70e8db4be3301833263de0617e8
2022-03-22 14:08:26 +00:00
Zuul
b34409b7c3 Merge "Fix elasticsearch-data shutdown" 2022-03-21 18:16:13 +00:00
Zuul
b2254e3eb0 Merge "Fix elasticsearch cronjob rendering" 2022-03-21 18:16:10 +00:00
Gage Hugo
a1bd832b0f Fix comparison error with mariadb and helm v3
The mariadb chart currently fails to deploy due to
differences in handling comparison between helm v2
and v3. This change updates the comparison to work
in both versions.

Change-Id: I9143a16f3011c0c0ae5420e6ec41ad7745a28cab
2022-03-19 01:21:26 +00:00
Markin, Sergiy (sm515x)
848f392b3a [DATABASE] MariaDB de-clustering
Adjust chart behavior in case only one mariadb instance is present and replication is disabled.

Change-Id: Ifa540580cf9d5755b83dbb949555ec814dda2744
2022-03-17 17:34:42 +00:00
Phil Sphicas
03e7fedb2b Fix elasticsearch-data shutdown
The shutdown script for the elasticsearch-data container uses a trap
handler to run the steps outlined in the rolling restart procedure [0].
However, when trying to kill the elasticsearch process (step 3), the
script sends the TERM signal to itself.

The traps are handled recursively, causing the entire termination grace
period to be exhausted before the pod is finally removed.

This change updates the trap handler to terminate the child process(es)
instead, and wait for their completion.

0: https://www.elastic.co/guide/en/elasticsearch/reference/7.x/restart-cluster.html

Change-Id: I0c92ea5cce345cff951f044026a2179dcbd5a3e2
2022-03-16 16:04:15 -07:00
Phil Sphicas
c3da3a6f79 Fix elasticsearch cronjob rendering
The pod security context for the elasticsearch cron jobs is in the wrong
location, causing an error when installing or upgrading the chart.

    ValidationError(CronJob.spec.jobTemplate.spec):
        unknown field "securityContext" in io.k8s.api.batch.v1.JobSpec

This change fixes the rendering.

Change-Id: I0e04b1ba27113d4b7aeefa2035b2b29c45be455a
2022-03-16 15:58:31 -07:00
Sigunov, Vladimir (vs422h)
81179cb2e3 [ceph-mgr] Prevents repeated creation of ceph-mgr service account
Under some circumstances, armada job attempts to recreate an existing
Service Account for ceph-mgr. This patchset aims to remediate the issue.

Change-Id: I69bb9045c0e2f24dc2fa9e94ab6a09a58221e1f5
2022-03-16 13:32:50 -04:00
Phil Sphicas
3a10c5ba95 ingress: Add option to assign VIP as externalIP
Some CNIs support the advertisement of service IPs into BGP, which may
provide an alternative to managing the VIP as an interface on the host.

This change adds an option to assign the ingress VIP as an externalIP to
the ingress service. For example:

    network:
      vip:
        manage: false
        addr: 172.18.0.1/32           # (with or without subnet mask)
        assign_as_external_ip: true

Change-Id: I1eeb07a1f94ef8efcb21f3373e0d5f86be725b33
2022-03-11 11:48:09 -08:00
Stephen Taylor
3b9aa44ac5 [ceph-client] More robust naming of clusterrole-checkdns
Currently if multiple instances of the ceph-client chart are
deployed in the same Kubernetes cluster, the releases will
conflict because the clusterrole-checkdns ClusterRole is a global
resources and has a hard-coded name. This change scopes the
ClusterRole name by release name to address this.

Change-Id: I17d04720ca301f643f6fb9cf5a9b2eec965ef537
2022-03-10 07:21:54 -07:00
Stephen Taylor
77a94d4630 [ceph-mon] Release-specific ceph-templates configmap name
This change corrects the ceph-templates configmap name to be
release-specific like the other configmaps in the chart. This
allows for more robustness in downstream implementations.

Change-Id: I1d09d14f9ba94dbbe11d8a80776f57b9cdf41210
2022-03-08 07:57:08 -07:00
Sigunov, Vladimir (vs422h)
80fe5d81cc [CEPH] Less agressive checks in mgr deployment
Ceph cluster needs only one active manager to function properly.
This PS converts ceph-client-tests rules related to ceph-mgr deployment
from error into warning if the number of standby mgrs is less
than expected.

Change-Id: I53c83c872b95da645da69eabf0864daff842bbd1
2022-03-04 16:39:52 -05:00
Zuul
ebfd04448e Merge "Add force_boot command to rabbit start template" 2022-03-03 14:59:47 +00:00
Zuul
9b9863abc3 Merge "Fix field validation error" 2022-03-01 19:52:09 +00:00
Stephen Taylor
37c237fb78 [ceph-mon] Correct configmap names for all resources
The recent name changes to the ceph-mon configmaps did not get
propagated to all resources in the chart. The hard-coded names in
the unchanged cases were correct and resources deployed
successfully, but this change corrects those configmap names across
all resources for the sake of robustness.

Change-Id: I3195e5ba2726892a7b6e0c31c0fac43bae4aa399
2022-03-01 07:33:31 -07:00
Sigunov, Vladimir (vs422h)
1da245f608 [DATABASE] Maintain minimum given number of backups
Modifies the backup script in the way that there will always be
a minimum given number of days of backups in both local, and remote
(if applicable) locations, regardless the date that the backups
are taken.

Change-Id: I19d5e592905ce83acdba043f68ca4d0b042de065
2022-02-28 14:46:04 -05:00
Stephen Taylor
ad09539f71 [ceph-mon] Change configmap names to be based on release names
This change makes the ceph-mon configmap names dynamic based on
release name to match how the ceph-osd chart is naming configmaps.
The new ceph-mon post-apply job needs this in some cases in order
not to have conflicting configmap names in separate releases.

Change-Id: Id26d0a8310ccff80a608e25d2b0a74a41f9e6a55
2022-02-24 15:24:10 -07:00
Lo, Chi (cl566n)
2fc1ce4a14 Removing -x from database backup script
The set -x has produced 6 identical log strings every time the
log_backup_error_exit function is called.  Prometheus is using
the occurrence and number of some logs over a period of time to
evaluate database backup failure or not.  Only one log should be
generated when a particular database backup scenario failed.

Upon discussion with database backup and restore SME, it is
recommended to remove the set -x once and for all.

Change-Id: I846b5c16908f04ac40ee8f4d87d3b7df86036512
2022-02-23 16:42:29 -08:00
Zuul
110575049b Merge "Add DNS sanity checks to k8s deploy script" 2022-02-23 21:18:08 +00:00
Gage Hugo
f01f35a524 Fix field validation error
The metacontroller chart currently has the field
terminationGracePeriodSeconds in an invalid spot in the template
which causes a chart building error when using helm v3. This
change moves the field to the correct position in the template.

Change-Id: Ief454115f67af35f8dfb570d8315de82d97b536d
2022-02-21 09:58:14 -06:00
Anderson, Craig (ca846m)
feeab3291c Add DNS sanity checks to k8s deploy script
Check that k8s DNS is working, and terminate at the beginning if this is
not the case.

Change-Id: I30867671f39dd9d80f46f5a4381adc9d34df7ab7
2022-02-18 00:15:59 -08:00
Sigunov, Vladimir (vs422h)
728c340dc0 [CEPH] Discovering ceph-mon endpoints
This is a code improvement to reuse ceph monitor doscovering function
in different templates. Calling the mentioned above function from
a single place (helm-infra snippets) allows less code maintenance
and simlifies further development.

Rev. 0.1 Charts version bump for ceph-client, ceph-mon, ceph-osd,
ceph-provisioners and helm-toolkit
Rev. 0.2 Mon endpoint discovery functionality added for
the rados gateway. ClusterRole and ClusterRoleBinding added.
Rev. 0.3 checkdns is allowed to correct ceph.conf for RGW deployment.
Rev. 0.4 Added RoleBinding to the deployment-rgw.
Rev. 0.5 Remove _namespace-client-ceph-config-manager.sh.tpl and
         the appropriate job, because of duplicated functionality.
         Related configuration has been removed.
Rev. 0.6 RoleBinding logic has been changed to meet rules:
    checkdns namespace - HAS ACCESS -> RGW namespace(s)

Change-Id: Ie0af212bdcbbc3aa53335689deed9b226e5d4d89
2022-02-11 14:30:43 -07:00
Zuul
6063c8f14f Merge "[ceph-mon] Add a post-apply job to restart mons after mgrs" 2022-02-11 21:25:41 +00:00