1795 Commits

Author SHA1 Message Date
weiyj
e99c122dfe fix typo errors
Change-Id: I4571bcce48038452d28318cb7344ac9fea778aea
2019-05-20 21:29:11 +00:00
Steve Wilkerson
38a6062b7a Fix helm-toolkit snippet for statefulset updates
This fixes the incorrect statefulset update helm-toolkit
snippet, as the previous implementation used incorrect keys
and fields for statefulset updates. See below:

https://kubernetes.io/docs/tutorials/stateful-application/basic-stateful-set/#updating-statefulsets
https://github.com/kubernetes/kubernetes/issues/68397

Change-Id: I5044460f19f0c824b08f99a90472c2e4a0e53e52
2019-05-20 08:12:15 -05:00
Renis Makadia
5985b61286 Ceph-Client: Update, Enable and Cleanup helm tests
- Update ceph-client chart to
1) By default, enable ceph-client helm test. Update enabler
key in values.yaml to follow pattern as in other charts
2) Add needed dependancy for ceph-client helm tests
3) Update helm test script to reduce output and update
error msgs
4) Removed unwanted ENV variables SPECS and EXPECTED_POOLMINSIZE
- Update gate scripts to run helm test command

Change-Id: I6a0e4f5107e49dac081ac2037bcc0f9c0864793f
2019-05-18 03:09:45 +00:00
Zuul
defb8b1f23 Merge "Ceph: Decrease ceph mon data store space to 15%" 2019-05-18 02:05:43 +00:00
Zuul
ce43b2927d Merge "Create upgrade statefulset tpl for helm-toolkit" 2019-05-18 01:40:49 +00:00
Chinasubbareddy Mallavarapu
a40d93cef1 Ceph: Decrease ceph mon data store space to 15%
Ceph issues a HEALTH_WARN status in cluster log when the available
disk space of the monitor’s data store is lower than or equal to this percentage.

This is to decrease the value from default value 30% to 15%.

Change-Id: Id412969f1dfb08b07356747f13aa31f00b41130d
2019-05-17 14:39:37 -05:00
Taylor, Stephen (st053q)
47a4b611b3 Do not use blkid to create partition symlinks
This removes the use of blkid to find disk partitions and their
associated partition UUIDs. Instead /proc/partitions is parsed
to enumerate disk partitions and sgdisk is used to extract their
partition UUIDs. This prevents a race condition from causing a
deadlock between ceph-osd and krbd when deploying ceph-osd pods.

Change-Id: I875f8c0565ce6efb7cd2052725af37dec3bb3a59
2019-05-17 11:20:51 -06:00
Gage Hugo
4f29af3d59 Create upgrade statefulset tpl for helm-toolkit
This change creates a snippet in helm-toolkit for specifying
the maxUnavailable and maxSurge values under rollingUpdate for
statefulsets. This can be utilized then by charts that contain
statefulsets.

Change-Id: I6f48cf1d2faf78b56103525771e3d4c3ecdc6db6
2019-05-17 17:18:30 +00:00
Jean-Philippe Evrard
5f5e988fb3 Point to OSH-images images
We now have a process for OSH-images image building,
using Zuul, so we should point the images by default to those
images, instead of pointing to stale images.

Without this, the osh-images build process is completely not
in use (and completely opaque to deployers), and updating the
osh-images process or patching its code has no impact on OSH.

This should fix it.

Change-Id: Ic00bd98c151669dc2485cd88e0e8c2ab05445959
2019-05-17 08:17:32 +00:00
RAHUL KHIYANI
6a19f3e1c5 Fluent-logging: Fix read-only-fs
This PS adds the default read-only-rootfs to true for fluent-logging chart

Change-Id: I82084c2712f5d1a99c5206e1488f60ae2819d007
2019-05-16 14:10:15 -05:00
Zuul
b69584bd65 Merge "Expose Anti-Affinity Weight Setting" 2019-05-16 17:17:03 +00:00
RAHUL KHIYANI
366357d893 Kibana: set read-only-fs
This PS permits read-only filesystems to back the containers by setting
the default to true

Additionally /run is uniformly applied across all long running pods
as a memory backed emptydir

Change-Id: Ia7344e2c8caa1f25101bf30445cdfe277f89c143
2019-05-15 20:19:59 +00:00
Zuul
28fb847ab1 Merge "HTK: Update kubernetes_pod_anti_affinity function" 2019-05-15 19:38:26 +00:00
Zuul
c8ea0fa9fe Merge "Postgresql: Fix security context" 2019-05-15 16:35:18 +00:00
Zuul
d815b5af38 Merge "Ceph: Dont attempt to reuse monmap if it exists" 2019-05-15 16:35:16 +00:00
RAHUL KHIYANI
2ddb43f525 Postgresql: Fix security context
This PS fixes the use of the security context macros for the
postgresql chart

Change-Id: I7d5080686e98837b95297b9a33e7241c79193830
2019-05-14 22:12:38 +00:00
Roy Tang (rt7380)
576a5510f9 HTK: Update kubernetes_pod_anti_affinity function
Currently the weight value is hardcoded for anti-affinity type
preferredDuringSchedulingIgnoredDuringExecution.  This ps updates
the htk function to retrieve the weight value from the configured
setting if it exists, or default to use the original hardcoded
value of 10 if it is not set (for backward compatibility).

Change-Id: I98c8b05ed7861c9c17e9c32569f53bde6ac2579d
2019-05-14 17:08:52 -05:00
Roy Tang (rt7380)
85bd731562 Expose Anti-Affinity Weight Setting
This ps exposes the anti-affinity weight value, including
default, that will be consumed by the updated htk function.

Change-Id: Id8eb303674764ef8b0664f62040723aaf77e0a54
2019-05-14 17:04:52 -05:00
Zuul
e8ce5947f6 Merge "Add overrides for openSUSE Leap15 images" 2019-05-14 17:13:02 +00:00
Zuul
f721383f27 Merge "Add OpenSUSE Leap15 specific values overrides" 2019-05-14 17:13:00 +00:00
Zuul
9388c2ba5a Merge "Grafana: Add security context to chart and read-only-fs" 2019-05-13 21:45:01 +00:00
Zuul
096801c84f Merge "Enable fluentd monitoring in single and multinode jobs" 2019-05-12 16:50:51 +00:00
Pete Birley
656f51d8d9 Ceph: Dont attempt to reuse monmap if it exists
This PS forces the monmap to be clobbered each time the container starts
which is required to recover from ome senarios when using an emptydir
to back /etc/ceph.

Change-Id: I2cf271593591ce07435893336cff98a8b1c72166
Signed-off-by: Pete Birley <pete@port.direct>
2019-05-12 16:21:39 +00:00
Zuul
93ae58c6d1 Merge "ceph-osd: Fix security context" 2019-05-10 17:57:46 +00:00
RAHUL KHIYANI
9b265d744e Elasticsearch: Add read-only-fs
This PS adds the default read-only-rootfs to true for elasticsearch chart

Change-Id: Iff06ee40e299d7dd4f4724a39ad5eb67eeae19dd
2019-05-10 13:44:23 +00:00
Zuul
f49ac503dd Merge "Fix broken network policy check/gate" 2019-05-10 07:34:30 +00:00
Zuul
df2e70e566 Merge "Tiller: Add read-only-fs" 2019-05-10 06:46:49 +00:00
Meg Heisler
e1f2a3cf78 Fix broken network policy check/gate
This adds a basic egress policy to the charts run by the
network-policy check. A change was recently merged requiring
the eggress tag to be in the chart but did not add it, this
addresses that

Change-Id: I60669c9351db7854cba8c69723eb783a966d2a56
2019-05-10 05:55:22 +00:00
Zuul
8ea9be76ab Merge "ceph-mon: Fix security context" 2019-05-10 02:29:34 +00:00
Steve Wilkerson
7c093716ca Enable fluentd monitoring in single and multinode jobs
This updates the scripts for deploying fluentd to include
overrides for enabling prometheus monitoring. Despite not
deploying prometheus in the osh-infra-logging job, we can still
leverage the post run job to gather metrics from the exporters
service. This gives us the means for verifying the functionality
of the exporter

Change-Id: Id98474de89d86419157635007e2f114f0947498e
2019-05-10 01:18:13 +00:00
RAHUL KHIYANI
0caaace0dd Tiller: Add read-only-fs
This PS adds the default read-only-rootfs to true for tiller chart

Change-Id: Ic6a00e28eefa5f5425c8f853ce32807246a7f91c
2019-05-10 01:17:21 +00:00
Zuul
96fcdf1c45 Merge "Openvswitch: Add read-only-fs" 2019-05-09 21:12:53 +00:00
Zuul
ead842d1d8 Merge "Elasticsearch: Heap configuration and ingest node updates" 2019-05-09 21:10:26 +00:00
Zuul
2db538ce99 Merge "Curator: Update image, add separate configmaps for service" 2019-05-09 21:10:25 +00:00
Zuul
a6a15f2e31 Merge "Add missing password to armada-lma manifest" 2019-05-09 21:02:57 +00:00
Zuul
1164377c93 Merge "Fluentd-Exporter: Use bitnami fluentd exporter image" 2019-05-09 20:47:50 +00:00
Zuul
bca4e477b5 Merge "Logs format standardization for LMA component" 2019-05-09 20:43:40 +00:00
RAHUL KHIYANI
fafc14f043 Openvswitch: Add read-only-fs
This PS adds the default read-only-rootfs to true for openvswitch chart

Change-Id: I59c687ff13335073c69456bc72f6b6e51081378c
2019-05-09 19:38:21 +00:00
Zuul
273b30706b Merge "prometheus-process-exporter: Add pod/container security context" 2019-05-09 16:23:12 +00:00
Steve Wilkerson
88f21acf34 Curator: Update image, add separate configmaps for service
This updates the Curator image to use version 5.6.0, which adds
additional actions for use, such as the ability to shrink indices.

This also adds a separate configmap and config secret for Curator,
as this allows us to use separate configmap annotations on the
Elasticsearch component pods to prevent Curator config updates
from triggering recreation of Elasticsearch components. This helps
alleviate overhead associated with Elasticsearch service restarts.

Change-Id: I0aec7756b0dc09bc3981ede950dc88f821aeca4b
2019-05-09 10:22:25 -05:00
Steve Wilkerson
4c0f82eb9a Add missing password to armada-lma manifest
This adds the password for the mariadb sst user to the armada-lma
manifest, as it was previously missed

Change-Id: I8768569fff96bf15cb4b2a577a0f667972fda886
2019-05-08 08:34:34 -05:00
Steve Wilkerson
9c3bb06525 Fluentd-Exporter: Use bitnami fluentd exporter image
This updates the fluentd-exporter to use the bitnami image for the
chart instead of a personal image

Change-Id: I162dca4556646eb781c380acea307d2feb156d18
2019-05-08 13:16:20 +00:00
Kabanov, Dmitrii (dk370c)
f95cd4ac69 [Ceph] Update image links for CephFS and RBD provisioners.
This PS allows to use Ubuntu based images for CephFS and
RBD provisioners.

Change-Id: Ie7afe1344891e54639dc0d9a076be97d8047ee07
2019-05-08 02:47:07 +00:00
RAHUL KHIYANI
4999508454 prometheus-process-exporter: Add pod/container security context
This updates the prometheus-process-exporter chart to include the pod
security context on the pod template. This changes the pod's
user from root to the nobody user instead

This also adds the container security context to set
allowPrivilegeEscalation to false and readOnlyRootFilesystem to true

Change-Id: I623227f9f9c878a8e7745f46f2cc77f6904005fb
2019-05-07 22:05:41 +00:00
Ian Howell
22dcebb93d This adds the ability to specify custom resource dependencies
Change-Id: If4166749085522ee0f10fa673d9fa36094091baa
2019-05-07 05:30:08 +00:00
Rahul Khiyani
d8ca55c685 Logs format standardization for LMA component
Added file name, line number and function name to logging message format
for troubleshooting purpose
    - This change is related to Grafana's session-db-sync job

Change-Id: Iaadbedfda0fd9cd7fe4b5c09fc05cb6181c400d1
2019-05-06 21:13:27 +00:00
Steve Wilkerson
031ee3e6af Elasticsearch: Heap configuration and ingest node updates
This updates the Elasticsearch chart to allow for setting the
heap size per node type instead of for all nodes equally. This
also adds the required environment variable to configure whether
a node is an ingest node. This is set to false, as suggested for
elasticsearch versions <= 6.x

This also removes the ES_PLUGINS_INSTALL environment variable as
it is not used for anything in the current charts

Change-Id: I9096774db46dcbcd48b8a5448f0510984bf4108f
2019-05-06 14:55:45 -05:00
Zuul
9771b16e87 Merge "Define test specific timeouts for Armada LMA components" 2019-05-03 15:07:43 +00:00
Zuul
6a43cc527c Merge "Make network policy template a little more generic" 2019-05-02 18:37:33 +00:00
Zuul
309bc587d5 Merge "Add restore postgresql script to the configmap-bin" 2019-05-01 17:38:37 +00:00