3299 Commits

Author SHA1 Message Date
Ritchie, Frank (fr801x)
56ae7ae52c Disable RGW crash dumps
While ceph crash dumps are needed for mons and osds there is no
need for rgw.

Change-Id: I62c3c9a089d29528f79653c412fba5200fd1595e
2021-07-08 13:45:19 -05:00
xuxant02@gmail.com
812aba01b8 Added helm hook for rabbitmq job cluster wait
Job wait cluster was failing due to the field immutability which was
resulting in the manual delete of the job for every helm upgrade to be
successful. Reason being job being upgraded before the other manifest
that are required been updated. It can be avoided by using helm-hook
post-install and post-upgrade which will force the job manifest to be
applied only after all other manifest are applied. Hook annotation is
provided "5" so that the if other jobs are annotated, exporter job will
be last to created in case hooks are added to the other jobs in chart.
Also helm3_hook value is used for condition.

Change-Id: Ib83f1d4bef6300c2b76aa54f08927b74346184c7
2021-07-08 22:07:59 +05:45
xuxant02@gmail.com
9133218e83 Added the helm hook for create user job for exporter
exporter-jpb-create-user was failing due to the field immutability
which was resulting in the manual delete of the job for every helm
upgrade to be successful. Reason being job being upgraded before the
other manifest that are required been updated. It can be avoided by
using helm-hook post-install and post-upgrade which will force the
job manifest to be applied only after all other manifest are applied.
Hook annotation is provided "5" so that the if other jobs are annotated,
exporter job will be last to created.
helm3_hook value is used for the condition which will enable the disable
of the hook.

Change-Id: I2039abb5bad07a19fd09fc5e245485c3c772beca
2021-07-08 22:04:36 +05:45
Ritchie, Frank (fr801x)
3c4828935a Add hash for ceph rgw keystone user
This is needed for rgw pods will restart when keystone user secret
changes.

Change-Id: I2092bdc9a4e8a328aec393cf07f8be196be26c32
2021-07-07 13:34:41 -05:00
Stephen Taylor
07ceecd8d7 Export crash dumps when Ceph daemons crash
This change configures Ceph daemon pods so that
/var/lib/ceph/crash maps to a hostPath location that persists
when the pod restarts. This will allow for post-mortem examination
of crash dumps to attempt to understand why daemons have crashed.

Change-Id: I53277848f79a405b0809e0e3f19d90bbb80f3df8
2021-06-30 14:24:15 -06:00
Zuul
a2b9fe53e3 Merge "Nagios: Mount internal TLS CA certificate" 2021-06-30 16:59:40 +00:00
Gupta, Sangeet (sg774j)
7057def52b Nagios: Mount internal TLS CA certificate
Mounted internal TLS CA certificate to be able to communicate with
prometheus and elasticsearch.

Change-Id: I1fc5e1e7c46a95f50487eea5924a13bdcad51b51
2021-06-29 13:23:55 +00:00
Zuul
4b0bb674ed Merge "Use local auth before keystone for s3" 2021-06-28 17:38:27 +00:00
Zuul
6d3272a04f Merge "chore(openssl): updates cert generation" 2021-06-28 17:35:21 +00:00
Zuul
30e179b166 Merge "Uplift ingress to 0.42.0" 2021-06-28 16:46:55 +00:00
Zuul
60ea0b3883 Merge "kafka broker hosts should be defined with a comma separated list" 2021-06-28 16:46:49 +00:00
Tin Lam
00052793dd chore(openssl): updates cert generation
This patch removes the dependency on cfssl to generate certificates and
removes unused constructs in the script.

Change-Id: Ia933420157f456bf99a6ec5416e6dbb63bfa5258
Signed-off-by: Tin Lam <t@lam.wtf>
2021-06-27 06:10:04 +00:00
Zuul
d067a0bb7a Merge "Ceph OSD Init Improvements" 2021-06-25 21:56:26 +00:00
Smith, David (ds3330)
0ecb9bf288 kafka broker hosts should be defined with a comma separated list
The broker attribute should use a comma separated list with the port
definition included

Example: kafka1:9092,kafka2:9092,kafka:9092

The kafka client will connect to the first available host this
will provide resiliency if a host is not available

Change-Id: I5f82e96f2aa274379b6d808291d4b5109709bf72
2021-06-25 14:06:26 +00:00
jinyuanliu
cc9ad68b30 Clean up residual file
The soft link file has been deleted, This path cleans up the redundant files.

Change-Id: I71b9f7de7bf2cfac71984047b8d44d707ed2b07f
2021-06-25 13:53:01 +08:00
Parsons, Cliff (cp769u)
b3ebb46ce2 Ceph OSD Init Improvements
Some minor improvements are made in this patchset:
1) Move osd_disk_prechecks to the very beginning to make sure the
   required variables are set before running the bulk of the script.
2) Specify variables in a more consistent manner for readability.
3) Remove variables from CLI commands that are not used/set.

Change-Id: I6167b277e111ed59ccf4415e7f7d178fe4338cbd
2021-06-24 17:12:34 +00:00
Ritchie, Frank (fr801x)
787e692ea0 Use local auth before keystone for s3
This change is to have RGW use local authentication before Keystone
when both are enabled. This can improve performance:

https://cloudblog.switch.ch/2020/02/10/radosgw-keystone-integration-performance-issues-finally-solved/

Given that we do not duplicate local users in keystone with different
passwords this should be a safe change.

Change-Id: I976a47a5d68884ffb54a0ddd8ab802d69cecbf44
2021-06-24 10:47:27 -05:00
Stephen Taylor
62f5cab770 [ceph-rgw] Fix a bug in placement target deletion for new targets
A deployment that specifies a placement target with "delete: true"
should delete that placement target if it exists. For a clean
deployment the expectation is that the placement target should be
created and immediately deleted; however, the check for existence
happens before its creation and the delete doesn't execute as a
result. This change adds a recheck for existence immediately after
creation to remedy that.

Change-Id: I26f7fa79c5c851070e94af758d0a0438aa7efa52
2021-06-22 07:11:25 -06:00
Zuul
196592ded6 Merge "Enable Ceph CSI Provisioner to Stand Alone" 2021-06-21 04:17:52 +00:00
aw4825
ff2d317064 Removed additional checks from Elasicsearch Helm test
This test (create and remove test index) already validates that elasticsearch is working correctly. Removed additional check for repo verification for external service like S3 as this seems out of scope since this can be configured differently and causes test to fail.

Change-Id: Ic9328b204c82bdf0e328370d7060a265210c9e8a
2021-06-16 13:34:02 -05:00
Parsons, Cliff (cp769u)
d9404f89c2 Enable Ceph CSI Provisioner to Stand Alone
The current implementation of the Ceph CSI provisioner is tied too
closely with the older Ceph RBD provisioner, which doesn't let the
deployer deploy Ceph CSI provisioner without the old RBD provisioner.

This patchset will decouple them such that they can be deployed
independently from one another.

A few other changes are needed as well:
1) The deployment/gate scripts are updated so that the old RBD and
   CSI RBD provisioners are separately enabled/disabled as needed.
   The original RBD provisioner is now deprecated.
2) Ceph-mon chart is updated because it had some RBD storageclass
   data in values.yaml that is not needed for ceph-mon deployment.
3) Fixed a couple of bugs in job-cephfs-client-key.yaml where RBD
   parameters were being used instead of cephfs parameters.

Change-Id: Icb5f78dcefa51990baf1b6d92411eb641c2ea9e2
2021-06-15 14:48:09 +00:00
Zuul
bd17d4b849 Merge "Add manual mode to the created backup file name" 2021-06-11 17:06:25 +00:00
Gayathri Devi Kathiri
6d4dcc2474 Add manual mode to the created backup file name
This PS helps us understand the mode of backup taken
from the created backup file name.

Supporting PS: https://review.opendev.org/c/airship/porthole/+/793591

Change-Id: I96c8b856fc309381f8d956eaae248bfc3443d900
2021-06-11 14:10:41 +00:00
Haider, Nafiz (nh532m)
5c8bd68e76 rabbitmq: Add TLS support to helm test
Add http and https toggling to helm test for TLS

Change-Id: Ia01fc793d090a7d1cb97e2fd7dacaaa6edbad8d0
2021-06-10 21:13:09 +00:00
jinyuanliu
2e80509e0f Uplift ingress to 0.42.0
- Uplifts the image to nginx 0.42.0 to address CVEs
- Adds labels needed for nginx 0.42.0
- Updates release notes for ingress

Change-Id: I133d6d30d4a68628ee516f5896780cc8096ffd1f
2021-06-09 07:48:54 +00:00
Gupta, Sangeet (sg774j)
e1990e399f rabbitmq: Set separate for HTTPS
Additionally, add TLS to prometheus exporter.

Change-Id: I6b46d2274a57d07c9967321abaa1077a1e8b4da2
2021-06-09 03:50:06 +00:00
Zuul
c8dbd3d47d Merge "Prepending library/ to docker official images" 2021-06-09 03:17:21 +00:00
Zuul
2b20674cad Merge "docs: Update Freenode to OFTC" 2021-06-04 17:08:36 +00:00
Thiago Brito
5a0ba49d50 Prepending library/ to docker official images
This will ease mirroring capabilities for the docker official images.

Signed-off-by: Thiago Brito <thiago.brito@windriver.com>
Change-Id: I0f9177b0b83e4fad599ae0c3f3820202bf1d450d
2021-06-02 15:04:38 -03:00
Zuul
facd41d0f7 Merge "rabbitmq: Make helm test work with TLS" 2021-06-02 16:50:23 +00:00
jinyuanliu
a152194ee7 docs: Update Freenode to OFTC
http://lists.openstack.org/pipermail/openstack-discuss/2021-May/022780.html
Change-Id: I7a956b0136083eefee14a2b751f8b44aa50b6ab9
2021-06-02 01:52:39 +00:00
Sangeet Gupta
2a11071e8b rabbitmq: Make helm test work with TLS
Update helm test pod and script to use TLS certificates.

Change-Id: Ic599014227ad63303bdc2758862f02dcefec66c7
2021-06-01 17:11:56 +00:00
Parsons, Cliff (cp769u)
17d9fe4de9 Refactor Ceph OSD Init Scripts - Second PS
1) Removed some remaining unsupported ceph-disk related code.
2) Refactored the code that determines when a disk should be
   zapped. Now there will be only one place where disk_zap is
   called.
3) Refactored the code that determines when LVM prepare should
   be called.
4) Improved the logging within the OSD init files

Change-Id: I194c82985f1f71b30d172f9e41438fa814500601
2021-05-27 22:34:54 +00:00
Stephen Taylor
948e07e151 [ceph-rgw] Add placement target delete support to RGW
A new "delete" value has been added to the ceph-rgw placement
target spec to allow existing placement targets to be deleted in a
brownfield deployment. For deployments where a deleted placement
target does not exist, the placement target will be created and
deleted in a single step.

Change-Id: I34e6d97543b63848b267332556b62d50d1865f49
2021-05-25 19:49:27 +00:00
Zuul
5b2e007d7a Merge "feat(tls): Enable TLS for OpenStack RabbitMQ" 2021-05-25 16:31:30 +00:00
Zuul
379ea64572 Merge "[ceph-client] Add pool delete support for Ceph pools" 2021-05-25 14:22:57 +00:00
Zuul
72b836b3ba Merge "Remove panko residue" 2021-05-25 02:26:46 +00:00
Zuul
0189967a25 Merge "Unpin cmd2 package in pip" 2021-05-24 22:47:13 +00:00
Zuul
0ec5521c49 Merge "Update all jobs to at least Train" 2021-05-24 22:42:31 +00:00
Stephen Taylor
bcc31f9821 [ceph-client] Add pool delete support for Ceph pools
Two new values, "delete" and "delete_all_pool_data," have been
added to the Ceph pool spec to allow existing pools to be deleted
in a brownfield deployment. For deployments where a pool does not
exist, either for greenfield or because it has been deleted
previously, the pool will be created and then deleted in a single
step.

Change-Id: Ic22acf02ae2e02e03b834e187d8a6a1fa58249e7
2021-05-24 19:25:18 +00:00
Radhika Pai
38e9e187dd Change image key name for blackbox exporter
This ps change the key name for the blackbox exporter so that
it is consistent with the naming convention of other prometheus
exporters.

Co-authored-by: Chi Lo <cl566n@att.com>

Change-Id: Ia190aa6730fab99d7fb14c53b538c72a1bc698ce
2021-05-24 10:25:01 -07:00
Haider, Nafiz (nh532m)
2dc83fdde7 feat(tls): Enable TLS for OpenStack RabbitMQ
Enable TLS for Openstack RabbitMQ upstream

Co-authored-by: Sangeet Gupta <sg774j@att.com>

Change-Id: I7c08d41b212bc5095facf5f5823521fbfa4d3c47
2021-05-21 12:36:23 +00:00
Zuul
9111ae750e Merge "Update Grafana version and Selenium script" 2021-05-19 15:44:11 +00:00
Pai, Radhika
bfeb4255a0 Update Grafana version and Selenium script
This ps updates the version to 7.4.5
The css element in GUI has changed in the new Grafana version , so updated
 the selenium script to find the right element.

Change-Id: I972fddf73719fb5bef821679a5ab07491edf55ff
2021-05-18 15:01:16 -05:00
jinyuanliu
7baceae82f Remove panko residue
About panko chart,It's been removed.

Change-Id: I781f42f11e1bfc26537d393c527e34c66d29d0cf
2021-05-18 11:01:40 +08:00
Zuul
bbe6c506af Merge "fix(yaml): corrects Charts.yaml reference" 2021-05-17 19:24:36 +00:00
Zuul
136c449730 Merge "Remove env variable from s3 bucket job" 2021-05-17 19:24:32 +00:00
Tin
ef542612eb fix(yaml): corrects Charts.yaml reference
This patch set fixes a wrong source reference in Charts.yaml
in the k8s-keystone-webhook chart.

Change-Id: I51b3b0bec6641a92ccc1b9002d8daef128963c8c
Signed-off-by: Tin <tin@irrational.io>
2021-05-17 02:09:37 -05:00
Lo, Chi (cl566n)
f7fde88b6e Remove env variable from s3 bucket job
Remove the TLS_OPTION env from helm-toolkit s3-bucket job. There
can be different option for tls connection, depending on whether
the rgw server is local or remote. This change allows the
create-s3-bucket script to customize its connection argument
which can be pulled from values.yaml.

Change-Id: I2a34c1698e02cd71905bc6ef66f4aefcd5e25e44
2021-05-14 15:12:15 -07:00
Zuul
6c861be272 Merge "Remove deprecated svc annotation tolerate-unready-endpoints" 2021-05-13 02:47:13 +00:00