2932 Commits

Author SHA1 Message Date
Gupta, Sangeet (sg774j)
f2307f7db1 [ca-issuer]: Support different versions of cert-manager
v1.0.0 onwards of jetstack/cert-manager the apiVersion of CRD Issuer
was changed to v1. This patchset add support for earlier version of
cert-manager.

Change-Id: I884c4e8e8c07e30240cd9fb3c125bd2aee6c4ddf
2021-02-11 20:06:33 +00:00
Zuul
edcf774dea Merge "[CEPH] Update release notes for all ceph charts" 2021-02-08 18:25:33 +00:00
Zuul
1e892660d0 Merge "Remove snmp_notifier subchart from alertmanager" 2021-02-08 16:14:45 +00:00
Chinasubbareddy Mallavarapu
41b86c1071 [CEPH] Update release notes for all ceph charts
This change updates the releasenotes for all ceph charts to current
changes as of the date of this commit.

Change-Id: I18d08eb00c86c1022fdc2599d88ac5429ad661a6
2021-02-08 16:07:17 +00:00
Chinasubbareddy Mallavarapu
f4f072c2a7 [ceph-client] Update ceph-client release notes to current
This change updates the releasenotes for ceph-client to all current
changes as of the date of this commit.

Change-Id: I4e8746f428da383759884fbadacd6a50a847a19b
2021-02-05 22:12:22 +00:00
Zuul
485605e74a Merge "[ceph-client] Don't wait for premerge PGs in the rbd pool job" 2021-02-05 22:11:04 +00:00
Zuul
2be9fed154 Merge "[ceph-rgw] Update ceph-rgw release notes to current" 2021-02-05 20:57:01 +00:00
Zuul
aa05af211e Merge "[ceph-mon] Update ceph-mon release notes to current" 2021-02-05 20:56:56 +00:00
Zuul
d889d7f8cb Merge "[ceph-provisioners] Update ceph-provisioners release notes to current" 2021-02-05 20:56:52 +00:00
Zuul
301ec8a075 Merge "[ceph-osd] Update ceph-osd release notes to current" 2021-02-05 20:54:32 +00:00
Stephen Taylor
1dcaffdf70 [ceph-client] Don't wait for premerge PGs in the rbd pool job
The wait_for_pgs() function in the rbd pool job waits for all PGs
to become active before proceeding, but in the event of an upgrade
that decreases pg_num values on one or more pools it sees PGs in
the clean+premerge+peered state as peering and waits for "peering"
to complete. Since these PGs are in the process of merging into
active PGs, waiting for the merge to complete is unnecessary. This
change will reduce the wait time in this job significantly in
these cases.

Change-Id: I9a2985855a25cdb98ef6fe011ba473587ea7a4c9
2021-02-05 09:55:21 -07:00
Xiaoguang(William) Zhang
d3bf218250 Remove snmp_notifier subchart from alertmanager
snmp_notifier lack of features to forward alert labels from Alertmanager.

Change-Id: I4978df1bcdb45ad24e632d976eb407d4129715ad
2021-02-05 14:56:36 +00:00
Chinasubbareddy Mallavarapu
acf0054aa4 [ceph-provisioners] Update ceph-provisioners release notes to current
This change updates the releasenotes for ceph-provisioners to all current
changes as of the date of this commit.

Change-Id: I48a0e10fcae8920396658499321dede9ed026eff
2021-02-05 01:03:39 +00:00
Zuul
cafdc46c2e Merge "[CEPH] Uplift from Nautilus to Octopus release" 2021-02-04 23:33:34 +00:00
Zuul
14547b0151 Merge "Elasticsearch: Make templates job more generic" 2021-02-04 23:22:40 +00:00
Chinasubbareddy Mallavarapu
e3e6db5acd [ceph-rgw] Update ceph-rgw release notes to current
This change updates the releasenotes for ceph-rgw to all current
changes as of the date of this commit.

Change-Id: Ibaa817a2178e38f18cb6e16f4e9d65e8ae2e7b0a
2021-02-04 23:14:25 +00:00
Chinasubbareddy Mallavarapu
8c0343d68c [ceph-osd] Update ceph-osd release notes to current
This change updates the releasenotes for ceph-osd to all current
changes as of the date of this commit.

Change-Id: Ib2f1ae712d81ccc3d35e334b15ad71b602ebd87f
2021-02-04 23:00:47 +00:00
Chinasubbareddy Mallavarapu
57f70a54b6 [ceph-mon] Update ceph-mon release notes to current
This change updates the releasenotes for ceph-mon to all current
changes as of the date of this commit.

Change-Id: I9a29ed9b6d8e17de19c6e929f3c673107ebd7912
2021-02-04 22:36:14 +00:00
Steven Fitzpatrick
0ab71ae35c Elasticsearch: Make templates job more generic
This change updates the logic in our create-elasticsearch-templates
job to support creation of a variety of different API objects.

Change-Id: I380a55b93e7aabb606e713c21d71a383fef78b3f
2021-02-03 22:40:19 +00:00
Chinasubbareddy Mallavarapu
da289c78cb [CEPH] Uplift from Nautilus to Octopus release
This is to uplift ceph charts from 14.X release to 15.X

Change-Id: I4f7913967185dd52d4301c218450cfad9d0e2b2b
2021-02-03 22:34:53 +00:00
Steven Fitzpatrick
72f42ba091 Add LDAP to Alertmanager
This change adds an apache sidecar to the Alertmanager statefulset
in order to facillitate authentication to the service.

Change-Id: I6e3cfb582251ecd280644439bfbd432a1f86ede3
2021-02-02 16:27:14 +00:00
Zuul
1884f2c957 Merge "Added detailed FiXME for ks-service script bug and code changes in [0]" 2021-01-29 23:12:56 +00:00
Neely, Travis (tn720x)
69c525d791 Added detailed FiXME for ks-service script bug and code changes in [0]
On somewhat rare occasions the openstack service list call fails with
a connection aborted OSError 104 ECONNRESET. During an upgrade this failure
causes the script to think that the service it is checking for does not
exist and therefore it recreates the script. In turn this causes further
issues when other services try to use this duplicate service.
This is a temporary change in order to alliviate the issue while the root
cause is investigated.

[0] https://review.opendev.org/c/openstack/openstack-helm-infra/+/772416

Change-Id: Id0971a95eb54eca9486a9811f7ec6f603a007cbb
2021-01-29 13:50:15 -06:00
Zuul
223d37f2c3 Merge "Add possibility to use overrides for some charts" 2021-01-29 19:03:48 +00:00
Neely, Travis (tn720x)
ff3b0aa9e0 Allow openstack service list to retry in event of keystone connection issues
We've seen a few cases where the openstack service list is unable
to establish a connection with keystone thus causing the check to fail.
When this happens, an additional service is created unnecessarily.
When the addtional service is created, it tends to cause issues since
there are no endpoints asscociated with the new service.

Allow this check to retry several times.

Change-Id: I5a1985c680e90de71549177ffc3faf848a831bfa
2021-01-28 12:10:10 -06:00
Zuul
6090e8243d Merge "Add reno job to openstack-helm-infra repo" 2021-01-28 04:21:38 +00:00
Zuul
54c98615b4 Merge "Revert "feat(tls): Change Issuer to ClusterIssuer"" 2021-01-28 00:43:49 +00:00
Travis Neely
8a79d7c51b Revert "feat(tls): Change Issuer to ClusterIssuer"
This reverts commit f60c94fc16f81d220cfc32098cf518ae62afa99a.

Reason for revert: This introduced a bug:
https://cert-manager.io/docs/installation/upgrading/upgrading-0.15-0.16/#issue-with-older-versions-of-kubectl

Older versions of kubectl will have issues with the nested CRDs.

Change-Id: I322fc1382fe3d0a4517e4c7c5982ea50a721a1f7
2021-01-27 16:59:01 -06:00
astebenkova
a589db04e9 Add possibility to use overrides for some charts
The deal is that all the jobs' scripts include extra arguments
when deploying helm charts, except these ones in the commit.
It would be useful to use override files in these charts.

+ Fix typo in apparmor.yaml for node-exporter
+ Amend apparmor.yaml for openstack-exporter since
those values are already by default in values.yaml

Change-Id: Ibe8b38977216e618dccba7e8443b3cc05a772de5
2021-01-27 18:45:19 +02:00
Ritchie, Frank (fr801x)
75a115ea29 Run mon container as ceph user
This PS is to address security best practices concerning running
containers as a non-privileged user and disallowing privilege
escalation.

Change-Id: If4c0e9fe446091ba75d1a9818ffd3a0933285af4
2021-01-26 20:14:27 +00:00
Stephen Taylor
6cf614d7a8 [ceph-client] Fix Helm test check_pgs() check for inactive PGs
The 'ceph pg dump_stuck' command that looks for PGs that are stuck
inactive doesn't include the 'inactive' keyword, so it also finds
PGs that are active that it believes are stuck. This change adds
the 'inactive' keyword to the command so only inactive PGs are
considered.

Change-Id: Id276deb3e5cb8c7e30f5a55140b8dbba52a33900
2021-01-25 17:54:26 +00:00
Zuul
b21126fed1 Merge "Add elasticsearch ILM functionality" 2021-01-22 23:43:08 +00:00
Graham Steffaniak
c1241918c2 Add elasticsearch ILM functionality
Add functionality to delete indexes older than 14 days. ILM api
will handle deleting indexes.

Change-Id: I22c02af78b6ce979d0c70b420c106917b0fc5a4e
2021-01-21 09:02:57 -06:00
Gage Hugo
2a1677a36a Add reno job to openstack-helm-infra repo
With OSH now publishing charts regularly with each change, there
needs to be a way to track these changes in order to track the
changes between chart versions.

This proposed change adds in a reno check job to publish notes
based from the changes to each chart by version as a way to
track and document all the changes that get made to OSH-infra
and published to tarballs.o.o.

Change-Id: I5e6eccc4b34a891078ba816249795b2bf1921a62
2021-01-21 14:36:59 +00:00
Zuul
1336da0c6f Merge "Update Grafana version" 2021-01-20 22:23:58 +00:00
Zuul
be1c673fba Merge "[ceph-osd] Fix a bug with DB orphan volume removal" 2021-01-19 22:35:58 +00:00
Meghan
0e66ef972a Update Grafana version
This brings the Grafana version up to the current version
and fixes the selenium helm and gate test for the new login
dashboard.

Change-Id: I0b65412f4689c763b3f035055ecbb4ca63c21048
2021-01-19 12:36:59 -08:00
Zuul
9f0b100f5e Merge "Improvements for ceph-client helm tests" 2021-01-19 18:29:49 +00:00
Stephen Taylor
b2c0028349 [ceph-osd] Fix a bug with DB orphan volume removal
The volume naming convention prefixes logical volume names with
ceph-lv-, ceph-db-, or ceph-wal-. The code that was added recently
to remove orphaned DB and WAL volumes does a string replacement of
"db" or "wal" with "lv" when searching for corresponding data
volumes. This causes DB volumes to get identified incorrectly as
orphans and removed when "db" appears in the PV UUID portion of
the volume name.

Change-Id: I0c9477483b70c9ec844b37a6de10a50c0f2e1df8
2021-01-19 10:10:38 -07:00
Parsons, Cliff (cp769u)
970c23acf4 Improvements for ceph-client helm tests
This commit introduces the following helm test improvement for the
ceph-client chart:

1) Reworks the pg_validation function so that it allows some time for
peering PGs to finish peering, but fail if any other critical errors are
seen. The actual pg validation was split out into a function called
check_pgs(), and the pg_validation function manages the looping aspects.

2) The check_cluster_status function now calls pv_validation if the
cluster status is not OK. This is very similar to what was happening
before, except now, the logic will not be repeated.

Change-Id: I65906380817441bd2ff9ff9cfbf9586b6fdd2ba7
2021-01-18 16:12:33 +00:00
sgupta
f60c94fc16 feat(tls): Change Issuer to ClusterIssuer
ClusterIssuer does not belong to a single namespace (unlike Issuer)
and can be referenced by Certificate resources from multiple different
namespaces. When internal TLS is added to multiple namespaces, same
ClusterIssuer can be used instead of one Issuer per namespace.

Change-Id: I1576f486f30d693c4bc6b15e25c238d8004b4568
2021-01-15 18:46:09 +00:00
Apurva Gokani
25aa369025 postgres archive cleanup script
This change adds  cleanup mechanism to archive by following steps:
1) add archive_cleanup.sh under /tmp directory
2) through the start.sh this script will be triggered
3) It runs every hour, checking utilization of archive dir
4) If it is above threshold it deletes half of old files

Change-Id: I918284b0aa5a698a6028b9807fcbf6559ef0ff45
2021-01-14 16:21:14 +00:00
Zuul
204c51a669 Merge "Run as ceph user and disallow privilege escalation" 2021-01-12 20:09:50 +00:00
Zuul
6af7303516 Merge "Add elasticsearch snapshot policy template for SLM" 2021-01-12 18:08:08 +00:00
Stephen Taylor
4c097b0300 [ceph-osd] dmsetup remove logical devices using correct device names
Found another issue in disk_zap() where a needed update was missed when
https://review.opendev.org/c/openstack/openstack-helm-infra/+/745166
changed the logical volume naming convention.

The above patch set renamed volumes that followed the old convention,
so this logic will never be correct and must be updated.

Also added logic to clean up orphaned DB/WAL volumes if they are
encountered and removed some cases where a data disk is marked as in use
when it isn't set up correctly.

Change-Id: I8deeecfdb69df1f855f287caab8385ee3d6869e0
2021-01-11 14:49:43 -07:00
Phil Sphicas
f08d30df6b Use HostToContainer mountPropagation
For any host mounts that include /var/lib/kubelet, use HostToContainer
mountPropagation, which avoids creating extra references to mounts in
other containers.

Affects the following resources:
* ingress deployment
* openvswitch-vswitchd daemonset

Change-Id: I5964c595210af60d54158e6f7c962d5abe77fc2f
2021-01-07 20:29:24 +00:00
Zuul
96e002c64e Merge "Fix spacing inconsistencies with flags" 2021-01-06 20:44:41 +00:00
Smith, David (ds3330)
1934d32cdd Fix spacing inconsistencies with flags
Change-Id: I83676f62a4cfc7d8e20145a72f28eeab5ef4cc8d
2021-01-06 00:16:16 +00:00
jh629g
67618474ce Update default Kubernetes API for use with Helm v3
Updated Kubernetes api from extensions/v1beta1 to
networking.k8s.io/v1beta1 per docs[0] for kubernetes
1.16 deprecations as helm v3 linting will fail
when it parses extensions/v1beta1 seen here[1]

[0] https://kubernetes.io/blog/2019/07/18/api-deprecations-in-1-16/
[1] https://zuul.opendev.org/t/openstack/build/82f92508fb31418aa377f91d62e0d42e

Change-Id: I0439272587a2afbccc4d7c49ef6ad053c8b305e7
2021-01-05 16:43:38 +00:00
Frank Ritchie
abf8d1bc6e Run as ceph user and disallow privilege escalation
This PS is to address security best practices concerning running
containers as a non-privileged user and disallowing privilege
escalation. Ceph-client is used for the mgr and mds pods.

Change-Id: Idbd87408c17907eaae9c6398fbc942f203b51515
2021-01-04 12:58:09 -05:00