3313 Commits

Author SHA1 Message Date
Zuul
da5bce229c Merge "Remove helm status from deployment scripts for osh-infra-monitoring-tls" 2021-10-26 15:14:31 +00:00
Zuul
4b86fc455a Merge "Remove helm status from deployment scripts for osh-infra-logging" 2021-10-26 10:35:04 +00:00
Zuul
6fc996dc15 Merge "Remove helm status from deployment scripts for osh-infra-logging-tls" 2021-10-26 08:28:40 +00:00
Zuul
16bc1ddc4f Merge "Remove helm status from deployment scripts for osh-infra-local-storage" 2021-10-26 08:20:21 +00:00
Zuul
6e00e5566e Merge "Remove helm status from deployment scripts for openstack-support" 2021-10-26 08:19:40 +00:00
Zuul
6ef7e614c1 Merge "Re-enable chart testing" 2021-10-25 20:26:42 +00:00
Zuul
b855f7cb2f Merge "Remove helm status from deployment scripts for network-policy" 2021-10-25 14:55:55 +00:00
Zuul
1bb3e1b2ed Merge "Revert "Remove Kibana indices before pod start up"" 2021-10-23 04:06:20 +00:00
Gage Hugo
fca6ec0277 Re-enable chart testing
A previous change to move the linting job to helm3 removed the
chart testing role. This change adds it back.

Change-Id: Ifb8b1885b4dbe8d964f46347c8c510c743af91f4
2021-10-22 17:29:10 -05:00
Zuul
68648ab6d9 Merge "Remove helm status from deployment scripts for keystone-auth" 2021-10-22 07:49:23 +00:00
Zuul
b93e2bbf1f Merge "Remove helm status from deployment scripts for federated-monitoring" 2021-10-22 07:49:20 +00:00
Zuul
52a3d466fa Merge "Remove helm status from deployment scripts for multinode" 2021-10-22 02:01:54 +00:00
Chi Lo
fa2c1e0b55 Revert "Remove Kibana indices before pod start up"
This reverts commit 122dcef6295e1b62c113476737c29b8b031fbe85.
https://review.opendev.org/c/openstack/openstack-helm-infra/+/805246

The changes from the above patchset is a result of upgrading
Elasticsearch and Kibana images to v7.14.  This image has been
reverted back to v7.9.2.  As such, these changes are no longer
correct.

Change-Id: I44e9993002cbf1d2c4f5cb23d340b01bad521427
2021-10-21 15:42:02 -07:00
Zuul
49e4b091fb Merge "Remove helm status from deployment scripts for elastic-beats" 2021-10-21 15:46:04 +00:00
Zuul
7a9cacb5b8 Merge "Remove helm status from deployment scripts for common" 2021-10-19 01:58:46 +00:00
Zuul
2d90f441a0 Merge "Remove helm status from deployment scripts for apparmor" 2021-10-18 15:52:40 +00:00
Stephen Taylor
718db3682e [ceph-mon] Skip monmap endpoint check for missing mons
This change adds a condition to ensure that an IP address was
obtained for a ceph-mon kubernetes endpoint before building the
expected endpoint string and checking it against the monmap. If an
IP address isn't available, the check is skipped for that mon.

Change-Id: I45a2e2987b5ef0c27b0bb765f7967fcce1af62e4
2021-10-18 14:16:53 +00:00
Zuul
66fedd5d39 Merge "Migrate Ingress resources to networking.k8s.io/v1" 2021-10-16 08:09:33 +00:00
Zuul
7b19f7e5e7 Merge "[ceph-client] Update ceph_mon config to ips from fqdn" 2021-10-15 20:39:05 +00:00
Tin Lam
41fa5e37ca fix(doc): fixes doc
This fixes a quick typo in the documentation.

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: Id5989c7f2c0e7cfbcecc65cfceb6383b3908c906
2021-10-15 10:49:44 -05:00
Phil Sphicas
f4972121bc Migrate Ingress resources to networking.k8s.io/v1
This change updates the helm-toolkit and ingress charts to migrate
Ingress resources to the networking.k8s.io/v1 API version, available
since v1.19. [0]

0: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#ingress-v122

Change-Id: Ic6bd6d158b1294da26c165797c90107831dcb508
2021-10-15 04:47:00 +00:00
Chinasubbareddy Mallavarapu
fa608d076c [ceph-client] Update ceph_mon config to ips from fqdn
As ceph clients expect the ceph_mon config as shown below for Ceph
Nautilus and later releases, this change updates the ceph-client-etc
configmap to reflect the correct mon endpoint specification.

mon_host = [v1:172.29.1.139:6789/0,v2:172.29.1.139:3300/0],
[v1:172.29.1.140:6789/0,v2:172.29.1.140:3300/0],
[v1:172.29.1.145:6789/0,v2:172.29.1.145:3300/0]

Change-Id: Ic3a1cb7e56317a5a5da46f3bf97ee23ece36c99c
2021-10-14 20:47:38 +00:00
Parsons, Cliff (cp769u)
f38880b26e [ceph-mon] Correct Ceph Mon Check Ports
The ceph-mon-check pod only knew about the v1 port before, and didn't
have the proper mon_host configuration in its ceph.conf file. This
patchset adds knowledge about the v2 port also and correctly configures
the ceph.conf file. Also fixes a namespace hardcoding that was found
in the last ceph-mon-check fix.

Change-Id: I460e43864a2d4b0683b67ae13bf6429d846173fc
2021-10-14 16:14:45 +00:00
Phil Sphicas
25b0cdc7ec [ceph-client] Fix ceph-rbd-pool deletion race
In cases where the pool deletion feature [0] is used, but the pool does
not exists, a pool is created and then subsequently deleted.

This was broken by the performance optimizations introduced with [1], as
the job is trying to delete a pool that does not exist (yet).

This change makes the ceph-rbd-pool job wait for manage_pools to finish
before trying to delete the pool.

0: https://review.opendev.org/c/792851
1: https://review.opendev.org/c/806443

Change-Id: Ibb77e33bed834be25ec7fd215bc448e62075f52a
2021-10-13 17:23:23 -07:00
jayonlau
42195465f7 Remove helm status from deployment scripts for osh-infra-monitoring-tls
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I7a14e510fb1cfadcf2e124314b52c7cac4ac0af1
2021-10-13 12:55:42 -04:00
jayonlau
311fe70d3b Remove helm status from deployment scripts for osh-infra-logging
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: If27f87fceb79162458f22c07a35fe813b6026830
2021-10-13 12:52:20 -04:00
jayonlau
0e94f35e9c Remove helm status from deployment scripts for osh-infra-logging-tls
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: Icc845f0ee15740802e97a4749e7181d6f372e4b2
2021-10-13 12:49:21 -04:00
Stephen Taylor
4d629d3db6 [ceph-mon] Prevent mon-check from removing mons when down temporarily
A race condition exists that can cause the mon-check pod to delete
mons from the monmap that are only down temporarily. This sometimes
causes issues with the monmap when those mons come back up. This
change adds a check to see if the list of mons in the monmap is
larger than expected before removing anything. If not, the monmap
is left alone.

Change-Id: I43b186bf80741fc178c6806d24c179417d7f2406
2021-10-13 10:47:56 -06:00
jayonlau
962686763b Remove helm status from deployment scripts for osh-infra-local-storage
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I507f6e786b5e35741030c500368638d586c99c12
2021-10-13 12:46:22 -04:00
jayonlau
391813463d Remove helm status from deployment scripts for openstack-support
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: Ia24fadf575dc5230246f3efa32a00fa1e3614abf
2021-10-13 12:43:08 -04:00
jayonlau
f4ec1c4cd3 Remove helm status from deployment scripts for network-policy
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I2264d29cd2dad1bc7636de8247ebec7f611a1f16
2021-10-13 12:38:05 -04:00
jayonlau
248a280293 Remove helm status from deployment scripts for keystone-auth
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I4cf135dc9852506cc2e853c9faa8544b7b2e2fae
2021-10-13 12:33:07 -04:00
jayonlau
74b79700c0 Remove helm status from deployment scripts for federated-monitoring
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I21ba5d8ca6f86954c793268142419e0a9e083943
2021-10-13 12:29:23 -04:00
jayonlau
60a9540e0b Remove helm status from deployment scripts for multinode
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: Ia600b979bf48629962577b3c5674bfa7415d78c0
2021-10-13 12:25:08 -04:00
jayonlau
2ef1d9b7ed Remove helm status from deployment scripts for elastic-beats
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I5c6dc5ea826c57b8c442ee0e876010a9ab726612
2021-10-13 12:17:49 -04:00
jayonlau
4df5e23c06 Remove helm status from deployment scripts for common
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I8e035d70dd652d5253f534ad6b28042347158ff4
2021-10-13 12:12:22 -04:00
Zuul
f4a74884e5 Merge "Update lint job to use helm v3" 2021-10-13 16:09:20 +00:00
jayonlau
38f529faca Remove helm status from deployment scripts for apparmor
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: Idd97b6c8d2531c8cd55629a3ce91b2581af904f4
2021-10-13 12:01:56 -04:00
Gage Hugo
e3203bd7fe Improve osh-infra-deploy helm v3 job
This change improves the osh-infra-deploy job to
successfully deploy minikube with helm v3 along with
the necessary namespaces. Future changes will modify
the install scripts for each job to make them helm
v3 compatible.

Change-Id: I08a94046f86f7c92be7580fbf10751150d2fcecc
2021-10-11 17:02:06 +00:00
Gage Hugo
41e60f065c Update lint job to use helm v3
This change updates the lint job to use helm v3. This
is part of the effort to migrate from helm v2 to v3 and
to ensure each chart is compatible with helm v3.

Change-Id: Ibc8ba5d8fe8efc3637d64df61305602385e644e4
2021-10-11 16:09:52 +00:00
Phil Sphicas
05f2a42330 Use Kubernetes v1.19.15 in kubeadm-aio image
Update Kubernetes version to v1.19.15, the latest patch release of the
earliest supported version (as of 2021-09-15).

Change-Id: Ia8f398098dfafa7fc029c982c71bce4a876668de
2021-10-07 22:14:24 -07:00
Gage Hugo
22e50a5569 Update htk requirements
This change updates the helm-toolkit path in each chart as part
of the move to helm v3. This is due to a lack of helm serve.

Change-Id: I011e282616bf0b5a5c72c1db185c70d8c721695e
2021-10-06 01:02:28 +00:00
Chinasubbareddy Mallavarapu
6e1f2b4087 [ceph-provisioner] Add support to connect to rook-ceph cluster
This is to add support for rook-ceph in provisioner chart so that
if any clients want to connect can  make use of it .

Change-Id: I26c28fac3fa0f5d0b0e71a288217b37a5ca8fb13
2021-10-05 16:30:17 +00:00
Stephen Taylor
46c8218fbf [ceph-client] Performance optimizations for the ceph-rbd-pool job
This change attempts to reduce the number of Ceph commands required
in the ceph-rbd-pool job by collecting most pool properties in a
single call and by setting only those properties where the current
value differs from the target value.

Calls to manage_pool() are also run in the background in parallel,
so all pools are configured concurrently instead of serially. The
script waits for all of those calls to complete before proceeding
in order to avoid issues related to the script finishing before all
pools are completely configured.

Change-Id: If105cd7146313ab9074eedc09580671a0eafcec5
2021-10-01 07:59:10 -06:00
Sean Eagan
b1a247e7f5 Helm 3 - Fix Job labels
If labels are not specified on a Job, kubernetes defaults them
to include the labels of their underlying Pod template. Helm 3
injects metadata into all resources [0] including a
`app.kubernetes.io/managed-by: Helm` label. Thus when kubernetes
sees a Job's labels they are no longer empty and thus do not get
defaulted to the underlying Pod template's labels. This is a
problem since Job labels are depended on by
- Armada pre-upgrade delete hooks
- Armada wait logic configurations
- kubernetes-entrypoint dependencies

Thus for each Job template this adds labels matching the
underlying Pod template to retain the same labels that were
present with Helm 2.

[0]: https://github.com/helm/helm/pull/7649

Change-Id: I3b6b25fcc6a1af4d56f3e2b335615074e2f04b6d
2021-09-30 16:01:31 -05:00
Zuul
0fa7e0fb7e Merge "feat(helm-toolkit): allow setting extra labels on pods" 2021-09-29 06:04:53 +00:00
Tin Lam
5f75ffa180 fix(ssl): fixes libvirt ssl job
Changes the override to use dynamically generated certs for the
libvirt-ssl jobs so they don't expire in the future. Also, changes it so
it is voting again like before.

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: If7215961b0b9a7cad75afd7f78592515b74a7b58
2021-09-27 12:45:29 -05:00
Marlin Cremers
4340e272d7 feat(helm-toolkit): allow setting extra labels on pods
Currently it isn't possible to set extra labels on pods that use
the labels snippet. This means users are required to fork the helm
repository for OpenStack services to add custom labels. Use cases
for this are for example injecting Istio sidecars.

This change introduces the ability to set one set of labels on all
resources that use the labels snippet.

Change-Id: Iefc8465300f434b89c07b18ba75260fee0a05ef5
2021-09-27 18:44:47 +02:00
Neely, Travis (tn720x)
4a490b894c Fix issue with db backup error return code being eaten
The return code from the send_to_remote_server function are
being eaten by an if statement and thus we never hit the elif
section of code.

Change-Id: Id3e256c991421ad6624713f65212abb4881240c1
2021-09-26 16:22:39 -05:00
Tin Lam
418143f3e4 fix(gate): disable ssl job
This patch sets temporary disables the ssl gate job and makes the check
job non-voting to unblock osh-infra. The certificate hardcoded in [0]
has expired.

Certificate:
    Data:
        Version: 3 (0x2)
        Serial Number:
            5f:61:31:9d:0f:ff:99:81:ba:6d:50:1a
        Signature Algorithm: sha256WithRSAEncryption
        Issuer: CN = libvirt.org
        Validity
            Not Before: Sep 15 21:26:53 2020 GMT
            Not After : Sep 15 21:26:53 2021 GMT

This will need to be updated or better, unhardcode this at the gate.

[0] https://opendev.org/openstack/openstack-helm-infra/src/branch/master/tools/deployment/openstack-support/051-libvirt-ssl.sh#L27-L51

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: I5ea58490c4fe4b65fec7bd3f11b4684cdc1a3e8b
2021-09-24 12:31:17 -05:00