39 Commits

Author SHA1 Message Date
Zuul
ce2c0e08d2 Merge "Update helm version to 2.14.1" 2019-07-04 18:36:57 +00:00
Steve Wilkerson
b117b14c3a Update helm version to 2.14.1
This updates the helm version from 2.13.1 to 2.14.1

Change-Id: I619351d846253bf17caa922ad7f7b0ff19c778a2
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-25 21:33:20 +00:00
Dejaeger, Darren (dd118r)
083956e37b Add node selector to Ceph test pods
This PS looks to add a node selector into the Ceph test pod's
specs.

Change-Id: If73a5036c5e6a651393f81a136874b9e8a52b4f1
2019-06-24 17:41:09 +00:00
rk0850
9ea6575ed9 ceph-rgw: Add pod/container security context
This updates the ceph-rgw  chart to include the pod
security context on the pod template

This also adds the container security context

Change-Id: Ic75a1decfe156e1e8aa2ebe38238f6b77abb71f8
2019-04-22 15:33:23 +00:00
Pete Birley
dece008337 Ceph: Make /etc/ceph and /run emptydirs uniformly across all pods
This PS updates the ceph charts to make /etc/ceph an emptydir
uniformly across all charts, both ensuring no default config is loaded,
and also permitting read-only filesystems to back the containers.

Additionally /run is uniformly applied across all long running pods
as a memory backed emptydir.

Change-Id: I00d1b15758b7eb4476fb950ddcb38db9a5149ad0
Signed-off-by: Pete Birley <pete@port.direct>
2019-04-21 19:06:18 +00:00
Pete Birley
2abf62ff4d OSH-Infra: Add emptydirs for tmp
This PS adds emptydirs backing the /tmp directory in pods, which
is required in most cases for full operation when using a read only
filesystem backing the container.

Additionally some yaml indent issues are resolved.

Change-Id: I8b7f1614da059783254aa6efc09facf23fca3cad
Signed-off-by: Pete Birley <pete@port.direct>
2019-04-20 20:50:59 +00:00
Steve Wilkerson
7f04846c52 Ceph charts: Add missing templates, update dependency values
This addresses slight issues with the ceph-osd, ceph-provisioners,
and ceph-rgw charts. Those issues include:
- Remove duplicate test: key in ceph-osd dependencies
- Add missing image repo sync job to ceph-provisioner and rgw
- Use correct job name for image repo sync dependencies in charts
- Remove incorrect keystone service dependency for ceph-rgw, as
  the keystone jobs are dependent on the keystone service

This also updates the ceph-rgw chart to use dynamic dependencies
based on whether keystone auth or s3 auth is used

Change-Id: Id3b3f289bdd4ca4d1b2e9b6267b12427e422a08d
2019-04-07 06:42:29 +00:00
Steve Wilkerson
84f30ec103 Add release-annotation to pod spec, add missing annotations
This adds the release-annotation to the pod spec for the charts in
openstack-helm-infra. This also adds missing configmap annotations
to charts in openstack-helm-infra

Change-Id: Ie23f0c16a7a21d3929e98928db2bbcef69ae6490
2019-03-21 09:10:48 -05:00
Renis Makadia
3552406832 Ceph-RGW code cleanup
Currently both 'deployment:rgw_keystone_user_and_endpoints`
and 'conf: rgw_ks' are used and set to true to deploy
ceph-rgw with keystone integration.

Going forward, we should only use `conf: rgw_ks: enabled: true`
to deploy ceph-rgw with keystone integration.

Change-Id: I17aecd4f977ed897bb0771edc9acafd4479777d1
2019-03-15 05:03:13 +00:00
Chinasubbareddy M
babe91b75e ceph-rgw: Add network policy for ceph-rgw pods
This is to add ingress network policy for ceph-rgw pods

Change-Id: I32a5d3d9a05b920bc69d5b5bb5a2d27cf6f55542
2019-03-06 03:08:34 +00:00
Matthew Heler
aad0394963 [CEPH] Use civetweb by default for RGW with keystone
Currently there is a bug in the beast code that makes it fail
during the initial lookup for a keystone user map. For the time
being we will continue to use civetweb when keystone is present
until this issue is resolved.

Change-Id: I56bcd77f38adb3763d35f46443c1403816d1dcea
2019-02-20 20:10:21 -06:00
Zuul
045e64067b Merge "Ceph-RGW: Support rotation of s3 key pairs" 2019-02-07 20:32:26 +00:00
Zuul
b4ec10151c Merge "[CEPH] Expand the Keystone Helm tests for RGW" 2019-02-07 19:11:42 +00:00
Steve Wilkerson
cf0ed142f6 Ceph-RGW: Support rotation of s3 key pairs
This updates the helm-toolkit script for creating rgw s3 users
to first check if a user exists, then create the user if it does
not exist or modify the user's keys if it does exist. This is
accomplished by using jq to identify all existing access keys for
the specified user, removing those key pairs using the access key,
then modifies the existing user with the supplied access/secret
key pair for the given user

This also updates the ceph-rgw chart to use the helm-toolkit s3
user script for creating the admin s3 user instead of using a
similar script defined directly in the ceph-rgw chart

Change-Id: I575b66415d44db7bb752102e45595305d86e623b
2019-02-07 10:33:49 -06:00
Matthew Heler
e8ed3bcf76 [CEPH] Expand the Keystone Helm tests for RGW
- Since the admin key has been removed, we need to also replace
radosrgw-admin with openstack container commands.

- Additionally expand the helm tests for keystone to also upload
and validate an object in RGW (similiar to S3 helm tests).

Change-Id: I4be603121fc227dd48f83704e99bba94341c4c09
2019-02-06 20:43:20 -06:00
Steve Wilkerson
f4aa5dc574 Ceph-RGW: Update storage-init job application labels
This changes the application label for the ceph-rgw storage init
job to 'ceph' to match the other jobs defined for the chart, rather
than use 'ceph-rgw'

Change-Id: Ia0b679567161e91241250f0c250d24a45c5ebb92
2019-02-06 14:43:24 -06:00
Matthew Heler
ff18dbe5fd [CEPH] Extend RadosGW S3 configuration support
- Support using custom client params for S3 configurations
- Move common tuning for S3 and Keystone into there own
configuration option
- Cleanup the rgw helm tests, since copying the ceph admin key is
no longer required
- Cleanup duplicate portions of the code for configuring the RGW
backend and frontend port
- Add an rgw helm test check for the osh-infra-logging gates

Change-Id: I46dbb4c45b0b96f5cf555077e49d2e09a1171424
2019-02-04 14:08:09 -06:00
Pete Birley
0d55b9064c RGW: Fix helm-test pod template
This PS updates the helm test driven pod template:
 * places rgw keystone conditional to correct location
 * removes unrequired roles and bindings
 * adds dependency on the rgw being running
 * corrects spelling error
 * corrects s3cmd to work with version 1.6.1

Change-Id: I665dba9fdca1d840f4d864e32f07b6185af51d25
Signed-off-by: Pete Birley <pete@port.direct>
2019-02-01 21:21:10 +00:00
Matthew Heler
ec86891c8f [CEPH] select the RGW backend based on RGW version
Use the Beast backend only when Mimic binaries are installed.
Otherwise use civitweb if the binares are from Ceph Luminous.

Change-Id: Ia7cb64d8db7eed2fc0c57387b26a27163af34520
2019-01-08 10:19:26 -06:00
Matthew Heler
c0d028e245 Uplift Ceph charts to the Mimic release
Change the release of Ceph from 12.2.3 (Luminous) to latest 13.2.2
(Mimic). Additionally use supported RHEL/Centos Images rather then
Ubuntu images, which are now considered deprecated by Redhat.

- Uplift all Ceph images to the latest 13.2.2 ceph-container images.
- RadosGW by default will now use the Beast backend.
- RadosGW has relaxed settings enabled for S3 naming conventions.
- Increased RadosGW resource limits due to backend change.
- All Luminous specific tests now test for both Luminous/Mimic.
- Gate scripts will remove all none required ceph packages. This is
required to not conflict with the pid/gid that the Redhat container
uses.

Change-Id: I9c00f3baa6c427e6223596ade95c65c331e763fb
2019-01-05 14:38:38 +00:00
Chris Wedgwood
0c4e37391f 'NOP' cleanup for more consistent white-space use in charts
Where we have the style '{{ ...' we should use the style '... }}'.

Change-Id: Ic3e779e4681370d396f95d3804ca27db5b9d3642
2019-01-03 22:45:49 +00:00
Zuul
6d354f0f7b Merge "Revert "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA"" 2018-12-16 08:57:09 +00:00
Pete Birley
0bf3674539 Revert "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA"
This reverts commit 8d33a2911cda0c9e88406b9eeacbd8dfa70286f2.

Change-Id: Ic861b9bf9b337449b47a3558da8355e7a5bcacee
2018-12-16 04:21:46 +00:00
Zuul
b90bf10b89 Merge "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA" 2018-12-15 09:32:21 +00:00
Mike Pham
8d33a2911c Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA
This PS implements the helm toolkit function to generate the
Egress in kubernetes network policy manifest based on overrideable values.
It also enbale the K8s network policy at Osh-infra gate.

Change-Id: Icbe2a18c98dba795d15398dcdcac64228f6a7b4c
2018-12-14 16:32:40 -05:00
Zuul
f81e2c54d1 Merge "Update Ceph-rgw helm tests" 2018-12-13 22:39:22 +00:00
Renis Makadia
458b8f6692 Update Ceph-rgw helm tests
Change-Id: I7b328da18ef10840baf8454e2fb3abaeeb542068
2018-12-13 11:21:13 -06:00
Pete Birley
c256cce537 Ceph: Allow multiple test pods to be present in clusters
This ps allows multiple ceph test pods to be present in cluster with
more than one ceph deployment.

Change-Id: I002a8b4681d97ed6ab95af23e1938870c28f5a83
Signed-off-by: Pete Birley <pete@port.direct>
2018-12-12 07:29:01 -06:00
Jean-Charles Lopez
f7e03d4763 Helm Tests for Ceph-RGW chart
Co-Authored-By: Renis Makadia <renis.makadia@att.com>

Change-Id: I81cc0cb498b2ca911d5b7bfa7c3bd9b8552e0e2b
2018-12-01 08:08:28 +00:00
Matthew Heler
225b85eb5f Additional Ceph RGW tuning and cleanups
Set RGW rados handles from 1 to 4
Remove support for fastcgi (it's no longer supported)

Change-Id: Ie260a3e1e5eab2065ec6a4d0637c144965a4214d
2018-11-12 20:13:33 +00:00
Pete Birley
a01e2db6ab Ceph-RGW: Use hostname not podname for pod specific config
This PS moves to use the hostname, not the pod name for the
instances specific config sections.

Change-Id: If2bc60c9f4f12038e8aa70fbd33a009cdf652b75
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-17 01:38:34 +00:00
Chinasubbareddy M
2f2cb7d567 Ceph: Add configmap hash as annotation
adding configmap  hash to following ds/deployments to trigger
rolling updates if there are any update for configmap

- ceph-mon
- ceph-mds
- ceph-mgr
- ceph-rgw

Change-Id: I4173cb12c18640c9b1a0e5a698d48f4735e250fb
2018-09-22 07:26:52 +00:00
Chinasubbareddy M
d5fecffdc1 ceph-rgw: stop storage init job on each run
this is to stop executing storage init job if we have ceph
deployment false under values

Change-Id: Iee3f7cf4c98a2c68c27b42011ffe6f07b278c2c4
2018-09-19 14:41:02 -05:00
Pete Birley
bb3ff98d53 Add release uuid to pods and rc objects
This PS adds the ability to attach a release uuid to pods and rc
objects as desired. A follow up ps will add the ability to add arbitary
annotations to the same objects.

Change-Id: Iceedba457a03387f6fc44eb763a00fd57f9d84a5
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-13 05:35:35 +00:00
Steve Wilkerson
fe437272b4 Ceph-RGW: Fix configmap-bin template
This changes the conditional check for including the configmap-bin
template in the ceph-rgw chart to their original state, and also
adds the rgw-s3-admin.sh script that was removed unintentionally

Change-Id: I60c3660a5bca37199effcf74f3060059345a327b
2018-09-07 13:35:14 +00:00
Zuul
090373d352 Merge "Ceph-rgw: make configmap names to be driven via chart values" 2018-09-05 00:03:42 +00:00
Renis Makadia
6be67bafea Ceph-RGW missing mon port configuration
- Adding missing changes from merged PS 590095

Change-Id: I0bae35ff08c9d422f9f284f65089171f9879766a
2018-09-04 11:56:13 -07:00
Chinasubbareddy M
b39e27891b Ceph-rgw: make configmap names to be driven via chart values
This to avoid configmap names conflicts with ther ceph charts

Change-Id: I73906fe69dd729fef0299149350caf021aab07e5
2018-09-04 13:19:02 -05:00
Steve Wilkerson
25bc83b580 Ceph: Move Ceph charts to openstack-helm-infra
This continues the work of moving infrastructure related services
out of openstack-helm, by moving the ceph charts to openstack
helm infra instead.

Change-Id: I306ccd9d494f72a7946a7850f96d5c22f36eb8a0
2018-08-28 15:03:35 -05:00