479 Commits

Author SHA1 Message Date
Taylor, Stephen (st053q)
9057c770a6 Enable cephfs tests
Cephfs tests were disabled in order to merge
https://review.opendev.org/695568 due to gate failures that were
blocking it. CephFS isn't used in openstack-helm-infra, so it
wasn't required for that work. This change re-enables the cephfs
tests so we can work through any issues that are causing further
failures.

Since the the issue got fixed in 14.2.8 , upgrading all daemons to 14.2.8.
(https://tracker.ceph.com/issues/43770)

Change-Id: I376d39b7ee00ccb1ab8046b58f92b19a822272e1
2020-04-21 22:25:52 +00:00
Pete Birley
19a1fbf8f7 Ceph: Dont mount log directories to host
This PS updates the bind mounts for ceph logs directorys to be
emptydirs. This ensures we do not polute the hosts permanantly
with ceph logs, which should be directed to stdout.

Change-Id: I6d72c0864b9ecc493cd62564e0e0450d90cfcf00
Signed-off-by: Pete Birley <pete@port.direct>
2020-04-07 18:05:04 +00:00
Steven Fitzpatrick
9d2e08f1a4 Fluentd: Switch to Native Metrics Plugin
This change updates the fluentd chart to use the native
fluent-plugin-prometheus for metric production. This plugin
provides more detailed metrics about fluentd's operations,
specifically regarding input and output statistics.

https://github.com/fluent/fluent-plugin-prometheus

Using the plugin, each fluentd pod produces metrics, so
scape annotations have been added to the pod spec. The
zuul check on metric producers has been updated to account
for this.

Depends-On: https://review.opendev.org/714167
Change-Id: I809356d92b0cff1e31cb2062102bbedefd4843fd
2020-03-30 00:44:58 -05:00
diwakar thyagaraj
c0bec2c744 Enable Apparmor to fluentd
Change-Id: I21640c263cbf7871319d2710160e37a9dddf0eb2
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-03-25 21:50:53 +00:00
Zuul
965fd345c3 Merge "Revert "Enable Apparmor for fluentd"" 2020-03-25 00:01:34 +00:00
Steve Wilkerson
d898a65a2d Revert "Enable Apparmor for fluentd"
This reverts commit a3110abd66727e8fab881a044110d01d2f405019.

Change-Id: I90180d5caa6cd7873220fcc91570c92ae7a234e5
2020-03-24 19:46:19 +00:00
Zuul
eb5bccc4be Merge "Fix Kibana Selenium tests" 2020-03-23 16:18:10 +00:00
Zuul
0415bdef08 Merge "Fix Grafana Selenium tests" 2020-03-23 14:22:46 +00:00
Luna Das
55beab680f Add more fields to daemonjob crd spec.
Change-Id: I1690035c7e35887245bbdcfdc97b19409fd6ab8a
2020-03-20 04:03:13 +00:00
dt241s@att.com
a3110abd66 Enable Apparmor for fluentd
Change-Id: I6b759beff9fd3166a9868a4d71319836f272bc25
2020-03-18 21:26:48 +00:00
diwakar thyagaraj
c4b2be6bcc Enable AppArmor profile to Openvswitch.
This adds Apparmor profile to Openvswitch. This change also refactors
the apparmor job to utilize the feature gates system instead of relying
on separate scripts

Change-Id: Ie53162cfdea5553191d3b5dbdfec195e4001b255
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-03-17 16:39:54 +00:00
dmyrhorodskyi
49b50d632b Fix Kibana Selenium tests
XPath to expected element was changed after
Kibana upgrade, this commit changes XPath
according chnges in new Kibana.

Change-Id: I501de225e1226991db9c263cedf38397cda7b51f
2020-03-17 17:33:37 +02:00
dt241s@att.com
d59b6e5944 Enable Apparmor to Kibana
Also added new apparmor zuul gates jobs for Logging, as initial 
apparmor is  getting timeout.

Change-Id: Iea0a5055238d75f401caf9ddb0ddd9985a091aab
2020-03-14 04:37:32 +00:00
Luna Das
9b9913d64a Add Helm Charts for MetaController and DaemonJobController.
These charts bootstraps a metacontroller on a
Kubernetes cluster using the Helm package manager.
This enables you to deploy custom controllers as
service + deployment pairs. A DaemonJobController
chart bootstraps the CompositeController and register
DaemonJob CRD, the daemonjob controller executes
DaemonJob(CR's) in kubernetes Cluster.

Change-Id: Ic946f564ea1cf07e89c90a598e59230dc240950c
2020-03-10 01:04:42 +05:30
dmyrhorodskyi
0d2f62a3ed Fix Grafana Selenium tests
Since grafana values_overrides were added we need
to align Selenium tests as well.

Change-Id: Ib2e16e08ec20d24924c14fe80927d8180ede06d0
2020-03-06 14:41:58 +02:00
Radhika Pai
dc9e435abb Grafana: Change to import the dashboards in json raw format
This code change is to enable grafana to use the raw json format
dashboards . This is to avoid the conversion of dashboards from json to
yaml and back to json during which the format is encountering issue.
Also this will help in adding new dashboards and maintaining the old
ones.
All the exisiting dashboards under values_override folder are updated to
use raw json format.

Change-Id: I48a7db1514857e082cecbb3b57deff9174509601
2020-03-04 09:52:36 -06:00
Zuul
5ce6115f2e Merge "Grafana: Provision to add customized HomePage" 2020-03-04 01:55:29 +00:00
Zuul
231bc0cadb Merge "Make more sections in daemonset overridable." 2020-03-03 10:01:06 +00:00
songgongjun
d74e937726 Make more sections in daemonset overridable.
The work of enable dpdk in starlingx needs to achieve the overrides
of parameters such as images, tags, labels, and pods. This function
is being implemented through the support of ovs per-host overrides.
In order to transfer the parameters such as images after overrides
to the daemonset file to achieve the corresponding functions, the
functions of overrides need to be upgraded. Move the $daemonset_yaml
parameter in the daemonset file to the overrides file, so that
daemonset file uses parameters after overrides.This patch and
https://review.opendev.org/#/c/707775/ depend on each other.

Change-Id: I210e54b28e32ba1b8e281659fee8e6eda38d79d0
Story: 2007291
Task: 38754
Depends-on: https://review.opendev.org/#/c/708894/
Signed-off-by: songgongjun <gongjun.song@intel.com>
2020-03-03 05:28:53 +00:00
dt241s@att.com
920bddde64 Enable Apparmor to nagios
Change-Id: I5927d32903cabd93b9d78c0c47994a94162deb1c
2020-02-28 13:31:50 +00:00
Radhika Pai
b0bb378a3c Grafana: Provision to add customized HomePage
This code will help to add any customized dashboard as a Home Page for
Grafana. The add_home_dashboard script will be executed after the
Grafana is deployed which sets a new Dashboard(OSH Home) as a landing
Page for a specific Organization.

Change-Id: I32b6b9cad4eaefe7d153cae797d3b3143be5c49b
2020-02-26 10:00:21 -06:00
Zuul
46c3b737c5 Merge "Add Apparmor to Grafana" 2020-02-25 22:12:39 +00:00
dt241s@att.com
cc392aaa85 Add Apparmor to Grafana
Added apparmor feature gate and Zuul Gate Job

Change-Id: I9ce522f77447b1cb3f189ab7023c5c711e577618
2020-02-25 19:25:12 +00:00
dt241s@att.com
f9c346fa37 [FIX] Fixes apparmor for ingress
This also adds Apparmor Gate Script.

Change-Id: Id25d9cddc8f8c4c98dd8cd044f679201a908c875
2020-02-25 06:10:17 +00:00
Zuul
e54f5f778f Merge "Enable runtime Apparmor default for All Ceph Components" 2020-02-24 19:00:28 +00:00
diwakar thyagaraj
344c0543fa Enable runtime Apparmor default for All Ceph Components
Change-Id: Id62fe453846ffe6ab01198177d5d8046378d61bf
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-02-24 15:52:11 +00:00
KHIYANI, RAHUL (rk0850)
d50371be9b Adding default apparmor profile to mariadb complete pods
Change-Id: I9a62b36c8cda0a6eaf8ac6b40f138b2706c63d15
2020-02-24 15:43:06 +00:00
Pete Birley
bda5983180 Add namespace configuration chart
This chart provides default configuration objects for a
kubernetes namespace.

Change-Id: If1b1545956064bb0897c8d67d9f13ef606ed2ba3
Signed-off-by: Pete Birley <pete@port.direct>
2020-02-21 13:51:56 -06:00
Prateek Dodda
b84f536ebd Add Docker default AppArmor profile to rabbitmq exporter chart
Change-Id: If1b420f91d1d23cc454a9ca8eff95a88a7e0b414
2020-02-19 12:40:08 -06:00
Zuul
d8c937f608 Merge "Enable Docker default Apparmor for Postgresql and prometheus-postgresql." 2020-02-18 20:58:17 +00:00
Zuul
6a0a7f3cc4 Merge "Add Docker default AppArmor profile to mariadb exporter chart" 2020-02-18 19:29:24 +00:00
Zuul
9191cf2d58 Merge "Enable Docker default Apparmor for all Prometheus Containers" 2020-02-18 17:38:20 +00:00
Zuul
3781948505 Merge "Check Elasticsearch and Curator Compatibility" 2020-02-18 17:27:48 +00:00
diwakar thyagaraj
17592f54ae Enable Docker default Apparmor for all Prometheus Containers
Change-Id: I97fc39e52b36fc0be84abd049fdbce1e7026107d
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-02-18 14:46:09 +00:00
KHIYANI, RAHUL (rk0850)
2712f54117 Add Docker default AppArmor profile to mariadb exporter chart
Change-Id: I6d5fcbb511f4f9cdb31727421fe320beeff1a882
2020-02-18 04:49:44 +00:00
dt241s@att.com
f633555f16 Enable Docker default Apparmor for Postgresql and prometheus-postgresql.
Change-Id: I013ca5f99e5032c44f0d679e467da9e928c02a6b
2020-02-17 23:01:06 +00:00
dt241s@att.com
8bd4a2624a [FIX] Add apparmor to prometheus.
This also fixes Elasticsearch apparmor Jobs.

Change-Id: I8f2a9aa12beffe3ca394a2e9dd00aba7e5292f29
2020-02-14 23:13:38 +00:00
Steven Fitzpatrick
31d0161a39 Check Elasticsearch and Curator Compatibility
This change updated the script used by zuul to check elasticsearch
deployment so that the curator will be ran during the timeframe of the
check, verifying the compatibility of the ES and Curator versions being
used.

Change-Id: I309530d71061fbb42c80e133948a0e0c3cf1927e
2020-02-11 15:17:06 +00:00
Zuul
3dd0eb0cdf Merge "Fluentd: Update kernel and auth inputs to use systemd" 2020-01-31 22:20:22 +00:00
Kabanov, Dmitrii
844d2cd16d [Ceph-rgw] Add bootstrap job
The PS adds bootstrap job for ceph-rgw chart.

Change-Id: I3055e1afe8072277166b8a659c940320720a0588
2020-01-28 01:49:57 +00:00
Zuul
de5dd82ff8 Merge "Update overrides used in apparmor nonvoting check" 2020-01-27 21:32:55 +00:00
Steve Wilkerson
781e65ac5d Fluentd: Update kernel and auth inputs to use systemd
This updates the overrides provided for deploying fluentd as a
daemonset to get kernel messages from the journal instead of
/var/log/kern.log directly, and also uses the journal to get
messages associated with logging to auth.log (syslog facility
10). This provides additional metadata and
a cleaner interface for gathering these logs via fluentd

Change-Id: I8e832db276095771d6a869e998d7a69795dfee37
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2020-01-16 13:38:52 +00:00
Zuul
042ac52397 Merge "Update Elastic Beats versions to 7.1.0" 2020-01-14 00:09:44 +00:00
Pete Birley
641bb04d4a Apparmor: Update to use the runtime default profile
This moves from using the docker profile to the default
runtime profile - which allows container engines other than
docker to work out of the box.

Change-Id: Ica5a48f8c43b90f07969b41e10dc472a772b5b43
Signed-off-by: Pete Birley <pete@port.direct>
2020-01-13 13:04:35 -06:00
Zuul
c2ece6a45a Merge "Support for local storage" 2020-01-09 23:18:16 +00:00
Smruti Soumitra Khuntia
2ac08b59b4 Support for local storage
This change adds a means of introducing new storage classes
and local persistent volumes.

Change-Id: I340c75f3d0a1678f3149f3cf62e4ab104823cc49
Co-Authored-By: Steven Fitzpatrick <steven.fitzpatrick@att.com>
2020-01-09 10:24:31 -06:00
Steve Wilkerson
45ac5fbe0f Update Elastic Beats versions to 7.1.0
This updates the Elastic Beats charts to 7.1.0 to keep them
aligned with the Kibana and Elasticsearch chart versions, which
is required for compatibility

This also updates the experimental job to use the single node
minikube deployment as opposed to the standard 5 node multinode
deployment

Change-Id: I4baba6ca2ea2f3785f11905138b67979a4501caa
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2020-01-09 13:11:43 +00:00
Gage Hugo
f9713b0051 Get osh-infra netpol gate passing
This change adds in missing network policy overrides for
fluent-daemonset and prometheus-exporter, as well as removes
existing mariadb network policies overrides that were causing
the network policy check job to fail.

Change-Id: Ib7a33f3d14617f9a9fda264f32cde7729a923193
2020-01-09 04:38:25 +00:00
Steve Wilkerson
bd527e42c6 Update overrides used in apparmor nonvoting check
This updates the overrides used in the apparmor nonvoting job, as
recent changes to the Elasticsearch chart values structure have
resulted in this jobs repeated failure

Change-Id: Id5427cd19a382e72435ab361003bbd5f99d678ce
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2020-01-08 20:08:54 +00:00
Steve Wilkerson
ddd5a74319 Prometheus: Add feature-gate support in deployment scripts
This updates the deployment scripts for Prometheus to leverage the
feature gate functionality rather than bash generation of the list
of override files to use for alerting rules

Change-Id: Ie497ae930f7cc4db690a4ddc812a92e4491cde93
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2020-01-07 22:06:19 +00:00