2932 Commits

Author SHA1 Message Date
Andrii Ostapenko
0deef8370a Unpin prometheus-openstack-exporter image
This enables ability to continuously update and test an image with
osh-infra gate and periodic pipeline.

Change-Id: I34ad5f8033038216129955b049d3ed09dfc0c140
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-30 04:20:37 +00:00
Zuul
aad20a35c4 Merge "Make database backups work with openstack Train" 2020-09-29 19:49:55 +00:00
Luna Das
739ad9efe2 Add default value for property in x-kubernetes-list-map-keys
This PS fixes the CRD spec validation errors seen in k8s 1.18.6,
the errors were not seen in the previous k8s version.

Change-Id: Iec1381eca2a21268d40827dbce105899b8d129b3
2020-09-29 03:46:46 -05:00
rajesh.kudaka
9a3844aac6 mariadb security best practice fixes
This commit ensures the below mariadb settings with reference to [0]:
 - 'local_infile' Is Disabled
 - 'have_symlink' Is Disabled
 - 'secure_file_priv' Is Not Empty
 - 'sql_mode' Contains 'STRICT_ALL_TABLES'

[0] https://dev.mysql.com/doc/mysql-security-excerpt/8.0/en/general-security-issues.html

Change-Id: I701b9bc2bdfb91d67aef91e88f953a09ac72d8be
2020-09-29 03:14:17 -05:00
Parsons, Cliff (cp769u)
fc8d855a43 Make database backups work with openstack Train
This PS fixes a problem with the main backup script in the helm-toolkit,
which tries to create a swift container using the SWIFT_URL. The problem
is that the SWIFT_URL is malformed because the call to openstack get
catalog list has a different format in Train than it did in Stein. So a
solution that works for both Train and Stein is needed. This patch will
use openstack catalog show instead and will extract the public URL from
that output.

Change-Id: Ic326b0b4717951525e6b17ab015577f28e1d321a
2020-09-28 20:04:05 +00:00
Zuul
b3cea56e55 Merge "Override images provided as artifacts from buildset registry" 2020-09-28 19:25:49 +00:00
Zuul
094bce5e97 Merge "Realize libvirt SSL" 2020-09-28 19:09:55 +00:00
Andrii Ostapenko
7a0558bd78 Override images provided as artifacts from buildset registry
Switch from using images from defined in docker_images to provided as
zuul artifacts. Currently to be used in conjunction with [0] in
openstack-helm-images pipelines.

[0] https://review.opendev.org/741551

Change-Id: I43dbd38906e8854c87a361f2e5e479f57850252f
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-28 17:38:29 +00:00
Zuul
aa26614df4 Merge "[ceph-osd] wait for only osd pods from post apply job" 2020-09-28 17:10:48 +00:00
Chinasubbareddy Mallavarapu
67c905cae8 [ceph-osd] wait for only osd pods from post apply job
This is to wait only for osd pods during ceph-osd chart install/upgrade
process.

Change-Id: I99bc7c1548f7b13c93059ac832b9f0589b049fc7
2020-09-25 08:45:51 -05:00
okozachenko
3bcb347a5b Realize libvirt SSL
Motivation: libvirt 127.0.0.1 listen is terrible for live migration.
To resolve that, we can use 0.0.0.0 but it is not secure so tried
to realize SSL.
Once create secrets for cacert, client&server cert and keys then it will
 mounted on libvirt daemonset.
It means all instances use the same key and cert. This is not ideal
 but can be considered as the first stage.

Change-Id: Ic3407e484039afaf98495e0f6028254c4c2a0a78
2020-09-25 16:36:42 +03:00
Phil Sphicas
f7ed96c701 Add extra DNS names to Ingress (helm-toolkit 0.1.1)
The existing helm-toolkit function "helm-toolkit.manifests.ingress"
will create namespace-fqdn and cluster-fqdn Ingress objects when the
host_fqdn_override parameter is used, but only for a single hostname.

This change allows additional FQDNs to be associated with the same
Ingress, including the names defined in the list:

    endpoints.$service.host_fqdn_override.$endpoint.tls.dnsNames

For example:

    endpoints:
      grafana:
        host_fqdn_override:
          public:
            host: grafana.openstackhelm.example
            tls:
              dnsNames:
                - grafana-alt.openstackhelm.example

Will produce the following:

      spec:
        tls:
          - secretName: grafana-tls-public
            hosts:
              - grafana.openstackhelm.example
              - grafana-alt.openstackhelm.example
        rules:
          - host: grafana.openstackhelm.example
            http:
              # ...
          - host: grafana-alt.openstackhelm.example
            http:
              # ...

Change-Id: I9b068f10d25923bf61220112da98d6fbfdf7ef8a
2020-09-24 23:16:32 +00:00
Andrii Ostapenko
1532958c80
Change helm-toolkit dependency version to ">= 0.1.0"
Since we introduced chart version check in gates, requirements are not
satisfied with strict check of 0.1.0

Change-Id: I15950b735b4f8566bc0018fe4f4ea9ba729235fc
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-24 12:19:28 -05:00
Tin Lam
6d5b84a458 chore(ver): updates the k8s-keystone-auth version
The default value of the kubernetes keystone authorization webhook is
grossly outdated (v0.2). This patch set brings the default up to the
latest of this patch set (v1.19).

Change-Id: Idbf8d027ad6d5f4fb8bdedaf3047c06c66eef27d
Signed-off-by: Tin Lam <tin@irrational.io>
2020-09-24 05:41:44 +00:00
Steven Fitzpatrick
22ac30d879 Alerta: Fix values reference in ingress manifests
This change corrects the path in these Values references.

Change-Id: Ibbbd528fd0ecfb98b98ac0e0b95d108c4f320817
2020-09-22 15:51:33 -05:00
Mohammed Naser
52093576aa publish: fix missing task for creating new index
The task was missed which was causing the post pipeline to fail, this
patch should fix it by adding the missing task.

Change-Id: I13955b1c9ac3899325f7397da6bf5379b3991241
2020-09-18 16:16:50 -04:00
Zuul
87535287f3 Merge "lint: enable running on changed charts only" 2020-09-18 19:21:17 +00:00
Zuul
fa7bb3cdba Merge "[ceph-client] Fix issue with checking if autoscaler should be enabled" 2020-09-18 18:02:14 +00:00
Zuul
487c50a40a Merge "Publish Helm charts into tarballs.openstack.org" 2020-09-18 17:08:07 +00:00
Brian Wickersham
11ab577099 [ceph-client] Fix issue with checking if autoscaler should be enabled
This corrects an issue in the create_pool function with checking
if the pg autoscaler should be enabled.

Change-Id: Id9be162fd59cc452477f5cc5c5698de7ae5bb141
2020-09-18 13:19:55 +00:00
Huang, Sophie (sh879n)
b0fcd5a411 [Libvirt] Add support for Cinder external ceph backend
This patchset adds a libvirt secret for the Cinder uuid of external
ceph backend when Cinder externally managed ceph backend is
enabled.

Change-Id: I3667c13c31e49f00d2be02efa6d791ce0a580a8d
2020-09-17 22:40:19 +00:00
Mohammed Naser
d4e2228f03 lint: enable running on changed charts only
At the moment, we are using --all which means run the linting on all of
the charts.  However, the problem with using --all is that it disables
version checking which means we can't enforce version changes on Helm
charts.

This patch drops it which means the chart-testing logic will go over the
changed files and make sure that it lints those charts which have
undergone changes.

Because we use a mdoel of 1 commit per merge within Gerrit, this should
still give us the exact coverage that we need without potentially
missing any linting changes.

Change-Id: I64c7896b25c1f3daaa4f61723de8a6c722aaf3a6
2020-09-17 13:50:26 -04:00
Zuul
2bfce96304 Merge "Run chart-testing on all charts" 2020-09-17 14:38:19 +00:00
Zuul
529e1e8160 Merge "Ingress: Configure ingress dhparam secret" 2020-09-17 02:35:45 +00:00
KHIYANI, RAHUL (rk0850)
24a0dcdee4 Ingress: Configure ingress dhparam secret
Configuring dhparam secret to generate 2048 DH group for
nginx openstack ingress

Change-Id: I8d8add9d518cbf928f58bfcac71e2b6c74075060
2020-09-15 14:16:50 -05:00
Zuul
e6230f0392 Merge "[ceph-client] Update queries in wait_for_pgs function" 2020-09-14 21:24:26 +00:00
Stephen Taylor
7bc1f4559e [ceph-osd] Don't set CEPH_LVM_PREPARE to 0 for colocated db/wal
Due to some recent reordering of the Bluestore OSD init code, the check
for empty db and wal device strings that sets CEPH_LVM_PREPARE to 0 is
now incorrect as it checks for an existing volume group on the OSD
device to determine if an OSD previously existed on the device. That
device is now initialized prior to this check, so the check is invalid.
This change removes it.

Change-Id: I5236de171d94930e08770537663b14c2eedb0b32
2020-09-14 18:06:27 +00:00
Zuul
74996ccce8 Merge "[update] Node problem detector path for conntrack" 2020-09-14 14:51:09 +00:00
radhika pai
949724ad8f [update] Node problem detector path for conntrack
The path to get the conntrack value was incorrect.
Also the logic of the script is updated to raise conntrack alert.

Change-Id: I4d3ea74396eb726458d05df3d9c9a50fec74cf05
2020-09-11 19:29:30 +00:00
Mohammed Naser
887327aff8 Publish Helm charts into tarballs.openstack.org
This will start publishing all of the charts into tarballs.openstack.org
which should allow for easier public consumption of these charts.  This
patch covers adding publishing for openstack-helm-infra first.

Change-Id: Iaa14629c0d0c36b98c2295119af3008f14c0cd39
2020-09-11 19:13:22 +00:00
Zuul
6ac8c9728c Merge "Enable Apparmor to etcd chart" 2020-09-11 18:22:59 +00:00
Zuul
2a6108cbdc Merge "Alerta: Add ingress templates" 2020-09-11 18:21:46 +00:00
Mohammed Naser
c7a45f166f Run chart-testing on all charts
Added chart lint in zuul CI to enhance the stability for charts.
Fixed some lint errors in the current charts.

Change-Id: I9df4024c7ccf8b3510e665fc07ba0f38871fcbdb
2020-09-11 18:02:38 +03:00
Steven Fitzpatrick
c61c45f72d Alerta: Add ingress templates
This change adds templates to the alerta chart for
enabling ingress to the application

Change-Id: I5e4fb71465555dc1cb113bc4332d3c3957f81a45
2020-09-11 06:07:11 +00:00
Kabanov, Dmitrii
78137fd4ce [ceph-client] Update queries in wait_for_pgs function
The PS updates queries in wait_for_pgs function (init pool script). The queries
were updated to handle the cases when PGs have "activating" and "peered"
statuses.

Change-Id: Ie93797fcb72462f61bca3a007f6649ab46ef4f97
2020-09-10 21:54:36 +00:00
Zuul
6afb3e19e9 Merge "Implement missing security context template for daemonjob-controller" 2020-09-10 17:27:21 +00:00
Zuul
acb8f20bf1 Merge "[ceph-osd] Allow logical disk labels to change for Ceph OSD disks" 2020-09-10 17:27:20 +00:00
KHIYANI, RAHUL (rk0850)
1336208632 Implement missing security context template for daemonjob-controller
This change adds security context template at container level

Change-Id: I72b1d5678e1fd3464b73937a2c50362bde8ae1d5
2020-09-10 10:21:14 -05:00
Zuul
35235d1532 Merge "Upgrade etcd to 3.4.3" 2020-09-10 07:26:13 +00:00
Zuul
eab20578ef Merge "Add default reject rule at the end in Postgres pg_hba.conf to ensure all connections must be explicitly allowed." 2020-09-10 02:52:09 +00:00
diwakar thyagaraj
ffb4781445 Upgrade etcd to 3.4.3
Change-Id: I6a9e225c1acb3f7cfeadd601fa4f2abb37e133f3
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-09-09 16:29:02 +00:00
Stephen Taylor
b4d485b8ad [ceph-osd] Allow logical disk labels to change for Ceph OSD disks
This change allows Ceph OSDs to respond to logical disk changes
and continue to function instead of failing to initialize after
such a change. For example, /dev/sdd is deployed as an OSD disk
and then subsequently becomes /dev/sde due to a hardware-related
event. This change allows the OSD to adapt and run as /dev/sde.

Change-Id: I6c22088b8d884f9dd300d026415fb126af4b41d4
2020-09-09 15:24:44 +00:00
Steven Fitzpatrick
c336d93530 Alerta: Fix secret name and overrides
Change-Id: I0267b93abda3c7eff1d7d85cc220c34ff2b75465
2020-09-09 05:17:16 +00:00
Steven Fitzpatrick
4ec7fdc7e6 Alerta: Fix files with CRLF eol characters
Change-Id: I30a6dbb8b2aaf8a1e944530426995457b59a4c9a
2020-09-09 05:12:54 +00:00
PrateekDodda
81c8571224 Enable Apparmor to etcd chart
Added Apparmor Job to etcd

Change-Id: Ia1770ec44b0a3c186ee33a721d38b36120a3bc30
2020-09-08 19:57:19 -05:00
KHIYANI, RAHUL (rk0850)
cb1bd3c6d7 Add security context template at pod/container level for etcd chart
This change implements runAsUser flag at pod level and readOnly-fs
flag at container level

Change-Id: Idcb78a1125b51e3b2a71c8cab0e97246c3f1c5aa
2020-09-08 19:25:32 +00:00
Andrii Ostapenko
094acf9c86 Support old mariadb dump file naming
Fallback to old dump file naming for read operation to support archives
with legacy naming.

Change-Id: I0c9c7b2c1feaac9aca817041dae617b4d1056b84
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2020-09-04 00:53:37 +00:00
diwakar thyagaraj
6dd08e84ca Add Zuul Jobs for apparmor to alerta and Prometheus black-box
1)Moved Apparmor changes to overides so as to use experimental Jobs.
2)Changed Numerical Convention to openstack exporterw

Change-Id: I9ac1f6399c09fc54fcdb98eb0c6cf91912bc93c1
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-09-03 13:28:24 +00:00
Gnana Lakshmi Kilambhi (gk118g)
982e3754a5 Add default reject rule at the end in Postgres pg_hba.conf to ensure all connections must be explicitly allowed.
default reject at the end of pg_hba.conf is added to ensure all connections must be explicitly allowed.
List of dependant users are added to allow connections are: 
1. postgresql-admin
2. postgres
3. psql_exporter

Change-Id: Ic7bd19e5eb4745b91d94d5a88851280054459547
2020-09-03 12:53:17 +00:00
KAVVA, JAGAN MOHAN REDDY (jk330k)
dc58ef9ddd Move Tiller version to 2.16.9
Update Helm chart for Armada to use Tiller version 2.16.9.

Change-Id: I6556a6e2a1fad3946a92da5e8dd97e0da5803c62
2020-09-02 08:05:00 -05:00