2747 Commits

Author SHA1 Message Date
Chinasubbareddy Mallavarapu
4214e85a77 [CEPH] Add missing ceph cluster name for helm tests
This is to export the ceph cluster name as environment variable
since its getting referred by scripts.
also to fix the query to get inactive pgs.

Change-Id: I1db5cfbd594c0cc6d54f748f22af5856d9594922
2020-08-14 16:09:19 -05:00
diwakar thyagaraj
acf6276f49 Add Application armor to Postgresql-backup pods
Change-Id: Idb4d214803bb98f1846154bb27d571f44ca74dba
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-08-14 18:23:02 +00:00
Kabanov, Dmitrii
4557f6fbe8 [ceph] Update queries to filter pgs correctly
The PS updates queries in wait_for_pgs function in ceph-client and
ceph-osd charts. It allows more accurately check the status of PGs.
The output of the "ceph pg ls" command may contain many PG statuses,
like "active+clean", "active+undersized+degraded", "active+recovering",
"peering" and etc. But along with these statuses there may be such as
"stale+active+clean". To avoid the wrong interpretation of the status
of the PSs the filter was changed from "startswith(active+)" to
"contains(active)".
Also PS adds a delay after restart of the pods to post-apply job.
It allows to reduce the number of useless queries to kubernetes.

Change-Id: I0eff2ce036ad543bf2554bd586c2a2d3e91c052b
2020-08-13 22:45:01 -07:00
Phil Sphicas
341e9b29df Ingress: Configure Default SSL Certificate
Adds configuration options for the --default-ssl-certificate feature of
NGINX Ingress Controller, which provides a default certificate for
requests that do not match any configured server names.[0]

To enable with a new certificate, specify:
  .conf.default_ssl_certificate.enabled=true
  .endpoints.ingress.host_fqdn_override.public.tls.crt="PEM cert data"
  .endpoints.ingress.host_fqdn_override.public.tls.key="PEM key data"
  .manifests.secret_ingress_tls=true

To enable using a TLS cert in an existing secret, specify:
  .conf.default_ssl_certificate.enabled=true
  .conf.default_ssl_certificate.name="name of the secret"
  .conf.default_ssl_certificate.namespace="namespace of the secret"

0: https://kubernetes.github.io/ingress-nginx/user-guide/tls/#default-ssl-certificate

Change-Id: Idd704fd880f56137923d4c38cc188b130ee3b56d
2020-08-14 05:32:51 +00:00
Zuul
adf9fc7fc4 Merge "Add TLS handling to mariadb backup and restore" 2020-08-14 04:48:47 +00:00
Zuul
486ad9a25f Merge "[ceph-osd] Move back to old naming convention for VGs" 2020-08-13 21:05:50 +00:00
Zuul
6df0a36443 Merge "Add apparmor profile to keystone-webhook container" 2020-08-13 20:40:48 +00:00
Zuul
c19ee4ab94 Merge "[ceph-client] Fix crush weight comparison in reweight_osds()" 2020-08-13 20:40:46 +00:00
Zuul
592153734a Merge "[ceph] Check for osds deployed with zero crush weight" 2020-08-13 20:03:31 +00:00
Kabanov, Dmitrii
4bc95447b6 [ceph-osd] Move back to old naming convention for VGs
The PS switches back to old naming convention for VGs. The old naming
convention have to be used until the changes which allow to handle
update of VG names are merged ( https://review.opendev.org/#/c/745166/ ).
Otherwise, OSDs will not come up after an upgrade.

Change-Id: I1bf9ca93149a93dfd5f79813533ace3a1fe58002
2020-08-13 19:14:01 +00:00
Gayathri Devi Kathiri
a57190fd8a Remove remaining test pods before new test run
If the test pod still exists, then the new test run
fails with ERROR: pods "abc-test" already exists

So, Removing remaining test pods before new test run

Change-Id: I3b3ed5ceaf420aa39a669b4a50a838ad154b1fdd
Closes-Bug: #1882030
2020-08-13 18:12:25 +00:00
Taylor, Stephen (st053q)
f66f9fe560 [ceph-client] Fix crush weight comparison in reweight_osds()
The recently-added crush weight comparison in reweight_osds() that
checks weights for zero isn't working correctly because the
expected weight is being calculated to two decimal places and then
compared against "0" as a string. This updates the comparison
string to "0.00" to match the calculation.

Change-Id: I29387a597a21180bb7fba974b4daeadf6ffc182d
2020-08-13 12:00:32 -06:00
Chinasubbareddy Mallavarapu
64b423cee0 [ceph] Check for osds deployed with zero crush weight
This is to check for osds deployed with zero crush weight from
helm tests.

Change-Id: Ie8d9c65b33bf7a026a342d1d7e81ec37cb981db3
2020-08-13 14:39:38 +00:00
KHIYANI, RAHUL (rk0850)
3332968caa Add apparmor profile to keystone-webhook container
Change-Id: I583c4c01e2c92c16705420fe726e3e7648a16705
2020-08-12 18:57:21 -05:00
Huang, Sophie (sh879n)
48c4d8c900 Add TLS handling to mariadb backup and restore
Added certification handling to restore_mariadb script.

Change-Id: Iff3a15c0b4e84857cafd5b70c6cbea5363734751
2020-08-12 23:13:49 +00:00
Zuul
8631c79548 Merge "Add security context template for keystone-webhook container" 2020-08-12 22:51:41 +00:00
Kabanov, Dmitrii
787052a975 [ceph-osd] update post apply job
The PS updates post apply job and moves execution of the command outside
of if statement. The output of the command stored in a variable
which will be checked in if statement. Added "-z" to correct comparison
of the length of the string (variable). It was accidentally missed in
the initial PS.

Change-Id: I907f75d0a9e5ef27fba5306ddb86199e94b01b3b
2020-08-12 15:49:20 +00:00
Zuul
dbd465c4c6 Merge "prometheus exporter to monitor health check for web URL" 2020-08-12 00:51:52 +00:00
Zuul
8bf7505396 Merge "Run node-problem-detector from 0 user" 2020-08-11 22:35:41 +00:00
KHIYANI, RAHUL (rk0850)
117fae68e6 Run node-problem-detector from 0 user
This adds the runAsUser flag to node-problem-detector at pod level

Change-Id: I0db38599e037ac38b24e50bbc2228ef1fd264c4e
2020-08-11 19:36:15 +00:00
Vipul Jain
628186f05e prometheus exporter to monitor health check for web URL
1) A separate prometheus job need to provide target and scrap metrics
2) it is based on https://github.com/prometheus/blackbox_exporter

Adding script file for deployment and job under zuul.d
Resolving conflict
Change-Id: Ia15ab7d8ef882886fe0e37cc2599e6815d7bcc6c
2020-08-11 22:39:54 +05:30
Taylor, Stephen (st053q)
f1e9a6ba83 [ceph-client] Refrain from reweighting OSDs to 0
If circumstances are such that the reweight function believes
OSD disks have zero size, refrain from reweighting OSDs to 0.
This can happen if OSDs are deployed with the noup flag set.

Also move the setting and unsetting of flags above this
calculation as an additional precautionary measure.

Change-Id: Ibc23494e0e75cfdd7654f5c0d3b6048b146280f7
2020-08-11 09:48:53 -06:00
KHIYANI, RAHUL (rk0850)
a58a78ff83 Add security context template for keystone-webhook container
This implements security context override at pod level and adds
readOnly-fs to keystone-webhook container

Change-Id: Ia67947b7323e41363a5ee379c0dfb001936b5107
2020-08-11 09:45:08 -05:00
Zuul
10fd77b6e4 Merge "Update alertmanager include snmp_notifier function" 2020-08-11 06:16:10 +00:00
Zuul
b05c64033f Merge "Add missing security context template to mariadb-backup pod" 2020-08-11 05:28:51 +00:00
Egorov, Stanislav
49e55bab46 Fix calico chart for hyperkube 1.12
During bootstrap process kubernetes node is not ready due to missed CNI.
It will be installed later but for a few deployments/jobs it's critical.
They can't start pods and looping in a while.

Workaround is here: add tolerations.

Change-Id: I8b3dacb71a7f102e7f74a6e4b6aee963ef12b8ed
2020-08-11 04:32:31 +00:00
Zuul
d2d3b05273 Merge "Prometheus: Render Rules as Templates" 2020-08-10 20:31:45 +00:00
Steven Fitzpatrick
fb7fc87d23 Prometheus: Render Rules as Templates
This change allows us to substitute values into our rules files.

Example:

- alert: my_region_is_down
  expr: up{region="{{ $my_region }}"} == 0
  
To support this change, rule annotations that used the expansion
{{ $labels.foo }} had to be surrounded with "{{` ... `}}" to render
correctly.

Change-Id: Ia7ac891de8261acca62105a3e2636bd747a5fbea
2020-08-10 18:16:35 +00:00
Zuul
87d7ddaf56 Merge "Add Application Armor to elastic-apm" 2020-08-07 19:35:35 +00:00
Oleh Hryhorov
d82abf1375 Moving job_rabbit_init from static to dynamic deps
The patch moves dependency for job_rabbit_init from static to
dynamic section because of the fact that in some cases users and
credentials for OpenStack services had been created in RabbitMQ
before deployment of the OpepnStack chart for an service. Values is
going to have the below structure. cinder-rabbit-init could be moved
from static to dynamic section:

values:
  dependencies:
    dynamic:
      job_rabbit_init:
        api:
          jobs:
            - cinder-rabbit-init

Change-Id: Ib2b9858262a229390f775ad831f8c50dfb4a19da
2020-08-07 19:23:50 +00:00
Kabanov, Dmitrii
f99444f37a [ceph-osd] update post_apply job
The PS updates wait_for_pods function and adds query to filter the pods
which are not in Running or Succeeded state.
Also the PS reduces the amount of 'kubectl get' requests.

Change-Id: Ie2abdaf0a87ca377f5ce287a3de9e87d1ca6c0d4
2020-08-07 17:16:53 +00:00
Xiaoguang(William) Zhang
7c94deae43 Update alertmanager include snmp_notifier function
Change-Id: I5aedbdcdbba397a9fddde19a0898cb91de08553a
2020-08-07 12:25:33 -04:00
dt241s@att.com
25d03950b0 Add Application Armor to Elastic FileBeat
Change-Id: Ifa6eb48e56e1a92d090ea9dbaaaf5890f95ae032
2020-08-07 14:34:37 +00:00
dt241s@att.com
564cada4ad Add Application Armor to elastic-apm
Change-Id: Id1e6b70db03f71b87539f6e3e466f39d8440b773
2020-08-07 14:34:27 +00:00
Andrii Ostapenko
817efe966c Pass parameter to skip helm tests for component in the same script
Pass parameter from job allowing to parallelize helm tests using
separate scripts.

Change-Id: I3e06c5590d51c75448dc5ff5978dc7fc90daca6f
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:15 +00:00
Andrii Ostapenko
fdcbd03784 Allow parallelization in gate runner
Change-Id: I393a22cfcaecb00d14d8ac643bd4b7ffbba03b12
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-06 00:51:11 +00:00
Zuul
a6a9146de4 Merge "Add missing security context template to nagios init container" 2020-08-05 19:06:21 +00:00
Zuul
fde1d53cd4 Merge "[Ceph-OSD] Refactor the code of OSD init script" 2020-08-05 18:59:12 +00:00
KHIYANI, RAHUL (rk0850)
cf131bacb2 Add missing security context template to nagios init container
This change adds security context template at container level
to implement readOnly-fs flag

Change-Id: Ibd4f8a916bcd74c1d89aa360e89d4477cd01d367
2020-08-05 10:29:30 -05:00
Zuul
8cd4e26a42 Merge "Fluentd: Allow for Multiple Config Files" 2020-08-05 14:48:13 +00:00
Kabanov, Dmitrii
cbc8001255 [Ceph-OSD] Refactor the code of OSD init script
The PS adds the changes which simplifies the code and
removes unnecessary steps.

Change-Id: I66e2b661e4d2cbc4a08d7690514321f9f3127e19
2020-08-05 14:45:50 +00:00
Zuul
e292b356b5 Merge "Use precreated minikube-aio image" 2020-08-04 22:01:04 +00:00
Zuul
3d76931e55 Merge "Fluentd: Remove Deployment Option" 2020-08-04 21:06:26 +00:00
Steven Fitzpatrick
4e73195bc2 Fluentd: Allow for Multiple Config Files
Change-Id: I2eb6ff2a599ee7bc479f9fc4955016b18902c879
2020-08-04 20:14:09 +00:00
Andrii Ostapenko
10019004da Use precreated minikube-aio image
With this commit minikube is installed using contents of precreated
minikube-aio image containing installation script, all required binaries
and images inside. Pulling a single image from dockerhub via opendev
dockerhub proxy and loading images allows to save up to 6 minutes in
minikube installation.

Change-Id: I5936f440eb0567b8dcba2fdae614e4c5e88a7b9a
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-08-04 19:46:43 +00:00
Steven Fitzpatrick
959417f321 Fluentd: Remove Deployment Option
This chart could deploy fluentd either as a Deployment
or a Daemonset. Both options would use the deployment-fluentd
template with various sections toggled off based on values.yaml

I'd like to know - Does anyone run this chart as a Deployment?
We can simplify the chart, and zuul gates, by changing the chart
to deploy a Daemonset specifically.

Change-Id: Ie88ceadbf5113fc60e5bb0ddef09e18fe07a192c
2020-08-04 19:06:37 +00:00
Zuul
3fa84d655f Merge "Add Application Armor to Ceph-Provisioners-config test" 2020-08-04 17:56:27 +00:00
Zuul
8d8d53c65c Merge "feat(tls): add tls to prometheus-openstack-exporter" 2020-08-04 14:54:26 +00:00
Zuul
8b09a07423 Merge "Fix overrides diff" 2020-08-03 23:05:18 +00:00
Zuul
262fa219d0 Merge "Remove updateStrategy of childresources of DaemonJobController." 2020-08-03 22:43:40 +00:00