3380 Commits

Author SHA1 Message Date
Zuul
6fedc626da Merge "Add gate script to deploy kubernetes using kubeadm." 2021-11-01 16:45:23 +00:00
jinyuanliu
6d808ceb47 Fix Python exceptions
If thread launch_cluster_Monitor() and launch_leader_election() operates on the configmap at the same time, Will cause a error 'Exception in thread "Thread-1"'.
This error will cause the thread to get stuck. Configmap will not be updated and the error "data too old" will be reported.
Just passing kubernetes_API exceptions is not enough, all are more appropriate.

Change-Id: I6baa9ece474f9c937fe9bce2231ef500562e0406
2021-11-01 05:57:33 +00:00
PRIYA, FNU (fp048v)
5407b547bb Set Security Context to ks-user job
We need flexibility to add securityContext to ks-user job , so that it can be executed without elevated privileges.

Change-Id: I24544015816d57d86c1e69f44b90b6b0271e76a4
2021-11-01 01:59:25 +00:00
Gage Hugo
57c452154e Remove fedora and centos jobs
The fedora and centos jobs have not been used or maintained for
quite some time. This change removes them and the related notes.

Also removed an outdate note about disabling all the experimental
and periodic jobs.

Change-Id: Ic8eb628e21c49957bdcd10a8d69d850ec921b6d6
2021-11-01 00:48:27 +00:00
Phil Sphicas
428cda6e33 [ceph-client] Consolidate mon_host discovery
This change updates the ceph.conf update job as follows:
* renames it to "ceph-ns-client-ceph-config"
* consolidates some Roles and RoleBindings

This change also moves the logic of figuring out the mon_host addresses
from the kubernetes endpoint object to a snippet, which is used by the
various bash scripts that need it.

In particular, this logic is added to the rbd-pool job, so that it does
not depend on the ceph-ns-client-ceph-config job.

Note that the ceph.conf update job has a race with several other jobs
and pods that mount ceph.conf from the ceph-client-etc configmap while
it is being modified. Depending on the restartPolicy, pods (such as the
one created for the ceph-rbd-pool job) may linger in StartError state.
This is not addressed here.

Change-Id: Id4fdbfa9cdfb448eb7bc6b71ac4c67010f34fc2c
2021-10-28 19:47:59 -07:00
Phil Sphicas
1ccc3eb0db [ceph-client] Fix ceph.conf update job labels, rendering
This change fixes two issues with the recently introduced [0] job that
updates "ceph.conf" inside ceph-client-etc configmap with a discovered
mon_host value:

1. adds missing metadata.labels to the job

2. allows the job to be disabled
   (fixes rendering when manifests.job_ns_client_ceph_config = false)

0: https://review.opendev.org/c/openstack/openstack-helm-infra/+/812159

Change-Id: I3a8f1878df4af5da52d3b88ca35ba0b97deb4c35
2021-10-28 19:47:14 -07:00
Gupta, Sangeet (sg774j)
6c044362d9 Add gate script to deploy kubernetes using kubeadm.
Change-Id: I164d0aa03f420cf263832e31c30807e9fccd8495
2021-10-29 01:05:29 +00:00
Andrii Ostapenko
092e295a67
Move to bionic nagios image
Change-Id: I0dd1f739ea4225dc56dc5bfd1fdafd872c8e4b73
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-10-27 11:38:56 -06:00
Zuul
b5d9406c47 Merge "Remove helm status from deployment scripts for tenant-ceph" 2021-10-27 01:43:05 +00:00
Zuul
a7442c33eb Merge "Remove helm status from deployment scripts for podsecuritypolicy" 2021-10-27 01:42:32 +00:00
Parsons, Cliff (cp769u)
cc793f2144 [ceph-osd] Update log-runner container for MAC
The log-runner previously was not included in the mandatory access
control (MAC) annotation for the OSD pods, which means it could not
have any AppArmor profile applied to it. This patchset adds that
capability for that container.

Change-Id: I11036789de45c0f8f66b51e15f2cc253e6cb230c
2021-10-26 18:50:28 +00:00
Zuul
14b8597558 Merge "Lint job: Install Helm before chart-testing" 2021-10-26 15:42:27 +00:00
Zuul
9fbcc80aee Merge "Remove helm status from deployment scripts for osh-infra-monitoring" 2021-10-26 15:14:33 +00:00
Zuul
da5bce229c Merge "Remove helm status from deployment scripts for osh-infra-monitoring-tls" 2021-10-26 15:14:31 +00:00
Zuul
4b86fc455a Merge "Remove helm status from deployment scripts for osh-infra-logging" 2021-10-26 10:35:04 +00:00
Zuul
6fc996dc15 Merge "Remove helm status from deployment scripts for osh-infra-logging-tls" 2021-10-26 08:28:40 +00:00
Zuul
16bc1ddc4f Merge "Remove helm status from deployment scripts for osh-infra-local-storage" 2021-10-26 08:20:21 +00:00
Zuul
6e00e5566e Merge "Remove helm status from deployment scripts for openstack-support" 2021-10-26 08:19:40 +00:00
Phil Sphicas
a934f83187 Lint job: Install Helm before chart-testing
Ensure that Helm is installed before running ct.

Change-Id: Id8a12a0d08ad930d6052af21071cba87c127dadd
2021-10-25 19:02:48 -07:00
Zuul
6ef7e614c1 Merge "Re-enable chart testing" 2021-10-25 20:26:42 +00:00
Zuul
b855f7cb2f Merge "Remove helm status from deployment scripts for network-policy" 2021-10-25 14:55:55 +00:00
Zuul
1bb3e1b2ed Merge "Revert "Remove Kibana indices before pod start up"" 2021-10-23 04:06:20 +00:00
Gage Hugo
fca6ec0277 Re-enable chart testing
A previous change to move the linting job to helm3 removed the
chart testing role. This change adds it back.

Change-Id: Ifb8b1885b4dbe8d964f46347c8c510c743af91f4
2021-10-22 17:29:10 -05:00
Zuul
68648ab6d9 Merge "Remove helm status from deployment scripts for keystone-auth" 2021-10-22 07:49:23 +00:00
Zuul
b93e2bbf1f Merge "Remove helm status from deployment scripts for federated-monitoring" 2021-10-22 07:49:20 +00:00
Zuul
52a3d466fa Merge "Remove helm status from deployment scripts for multinode" 2021-10-22 02:01:54 +00:00
Chi Lo
fa2c1e0b55 Revert "Remove Kibana indices before pod start up"
This reverts commit 122dcef6295e1b62c113476737c29b8b031fbe85.
https://review.opendev.org/c/openstack/openstack-helm-infra/+/805246

The changes from the above patchset is a result of upgrading
Elasticsearch and Kibana images to v7.14.  This image has been
reverted back to v7.9.2.  As such, these changes are no longer
correct.

Change-Id: I44e9993002cbf1d2c4f5cb23d340b01bad521427
2021-10-21 15:42:02 -07:00
Zuul
49e4b091fb Merge "Remove helm status from deployment scripts for elastic-beats" 2021-10-21 15:46:04 +00:00
Zuul
7a9cacb5b8 Merge "Remove helm status from deployment scripts for common" 2021-10-19 01:58:46 +00:00
Zuul
2d90f441a0 Merge "Remove helm status from deployment scripts for apparmor" 2021-10-18 15:52:40 +00:00
Stephen Taylor
718db3682e [ceph-mon] Skip monmap endpoint check for missing mons
This change adds a condition to ensure that an IP address was
obtained for a ceph-mon kubernetes endpoint before building the
expected endpoint string and checking it against the monmap. If an
IP address isn't available, the check is skipped for that mon.

Change-Id: I45a2e2987b5ef0c27b0bb765f7967fcce1af62e4
2021-10-18 14:16:53 +00:00
Zuul
66fedd5d39 Merge "Migrate Ingress resources to networking.k8s.io/v1" 2021-10-16 08:09:33 +00:00
Zuul
7b19f7e5e7 Merge "[ceph-client] Update ceph_mon config to ips from fqdn" 2021-10-15 20:39:05 +00:00
Tin Lam
41fa5e37ca fix(doc): fixes doc
This fixes a quick typo in the documentation.

Signed-off-by: Tin Lam <t@lam.wtf>
Change-Id: Id5989c7f2c0e7cfbcecc65cfceb6383b3908c906
2021-10-15 10:49:44 -05:00
Phil Sphicas
f4972121bc Migrate Ingress resources to networking.k8s.io/v1
This change updates the helm-toolkit and ingress charts to migrate
Ingress resources to the networking.k8s.io/v1 API version, available
since v1.19. [0]

0: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#ingress-v122

Change-Id: Ic6bd6d158b1294da26c165797c90107831dcb508
2021-10-15 04:47:00 +00:00
Chinasubbareddy Mallavarapu
fa608d076c [ceph-client] Update ceph_mon config to ips from fqdn
As ceph clients expect the ceph_mon config as shown below for Ceph
Nautilus and later releases, this change updates the ceph-client-etc
configmap to reflect the correct mon endpoint specification.

mon_host = [v1:172.29.1.139:6789/0,v2:172.29.1.139:3300/0],
[v1:172.29.1.140:6789/0,v2:172.29.1.140:3300/0],
[v1:172.29.1.145:6789/0,v2:172.29.1.145:3300/0]

Change-Id: Ic3a1cb7e56317a5a5da46f3bf97ee23ece36c99c
2021-10-14 20:47:38 +00:00
Parsons, Cliff (cp769u)
f38880b26e [ceph-mon] Correct Ceph Mon Check Ports
The ceph-mon-check pod only knew about the v1 port before, and didn't
have the proper mon_host configuration in its ceph.conf file. This
patchset adds knowledge about the v2 port also and correctly configures
the ceph.conf file. Also fixes a namespace hardcoding that was found
in the last ceph-mon-check fix.

Change-Id: I460e43864a2d4b0683b67ae13bf6429d846173fc
2021-10-14 16:14:45 +00:00
Phil Sphicas
25b0cdc7ec [ceph-client] Fix ceph-rbd-pool deletion race
In cases where the pool deletion feature [0] is used, but the pool does
not exists, a pool is created and then subsequently deleted.

This was broken by the performance optimizations introduced with [1], as
the job is trying to delete a pool that does not exist (yet).

This change makes the ceph-rbd-pool job wait for manage_pools to finish
before trying to delete the pool.

0: https://review.opendev.org/c/792851
1: https://review.opendev.org/c/806443

Change-Id: Ibb77e33bed834be25ec7fd215bc448e62075f52a
2021-10-13 17:23:23 -07:00
jayonlau
6d5c4265f8 Remove helm status from deployment scripts for tenant-ceph
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I649512e17fc62049fef5b9d5e05c69c0e99635f9
2021-10-13 13:03:18 -04:00
jayonlau
746a98ebed Remove helm status from deployment scripts for podsecuritypolicy
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I7ed4a88fca679b1d27c74f0e260e690093fdf591
2021-10-13 13:00:37 -04:00
jayonlau
24fd882cd6 Remove helm status from deployment scripts for osh-infra-monitoring
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I7d17d2ff4a44fc8d16cc653b33253cce536bfce1
2021-10-13 12:58:17 -04:00
jayonlau
42195465f7 Remove helm status from deployment scripts for osh-infra-monitoring-tls
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I7a14e510fb1cfadcf2e124314b52c7cac4ac0af1
2021-10-13 12:55:42 -04:00
jayonlau
311fe70d3b Remove helm status from deployment scripts for osh-infra-logging
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: If27f87fceb79162458f22c07a35fe813b6026830
2021-10-13 12:52:20 -04:00
jayonlau
0e94f35e9c Remove helm status from deployment scripts for osh-infra-logging-tls
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: Icc845f0ee15740802e97a4749e7181d6f372e4b2
2021-10-13 12:49:21 -04:00
Stephen Taylor
4d629d3db6 [ceph-mon] Prevent mon-check from removing mons when down temporarily
A race condition exists that can cause the mon-check pod to delete
mons from the monmap that are only down temporarily. This sometimes
causes issues with the monmap when those mons come back up. This
change adds a check to see if the list of mons in the monmap is
larger than expected before removing anything. If not, the monmap
is left alone.

Change-Id: I43b186bf80741fc178c6806d24c179417d7f2406
2021-10-13 10:47:56 -06:00
jayonlau
962686763b Remove helm status from deployment scripts for osh-infra-local-storage
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I507f6e786b5e35741030c500368638d586c99c12
2021-10-13 12:46:22 -04:00
jayonlau
391813463d Remove helm status from deployment scripts for openstack-support
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: Ia24fadf575dc5230246f3efa32a00fa1e3614abf
2021-10-13 12:43:08 -04:00
jayonlau
f4ec1c4cd3 Remove helm status from deployment scripts for network-policy
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I2264d29cd2dad1bc7636de8247ebec7f611a1f16
2021-10-13 12:38:05 -04:00
jayonlau
248a280293 Remove helm status from deployment scripts for keystone-auth
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I4cf135dc9852506cc2e853c9faa8544b7b2e2fae
2021-10-13 12:33:07 -04:00
jayonlau
74b79700c0 Remove helm status from deployment scripts for federated-monitoring
With the move to helm v3, helm status requires a namespace to be specified, but doing so breaks helm v2 compatability. This change removes the usage of helm serve in openstack-helm-infra's deployment scripts.

Change-Id: I21ba5d8ca6f86954c793268142419e0a9e083943
2021-10-13 12:29:23 -04:00