2260 Commits

Author SHA1 Message Date
Steve Wilkerson
d898a65a2d Revert "Enable Apparmor for fluentd"
This reverts commit a3110abd66727e8fab881a044110d01d2f405019.

Change-Id: I90180d5caa6cd7873220fcc91570c92ae7a234e5
2020-03-24 19:46:19 +00:00
dt241s@att.com
a3110abd66 Enable Apparmor for fluentd
Change-Id: I6b759beff9fd3166a9868a4d71319836f272bc25
2020-03-18 21:26:48 +00:00
Huang, Sophie (sh879n)
4f30b1361e Mariadb: Add ingress network policy overrides
This patch set adds in default mariadb ingress network policy
overrides for openstack namespace.

Change-Id: I037de30f868dfeb0dedb1c32209b8be6d4690962
2020-03-17 20:00:42 +00:00
Zuul
1a3de19e4f Merge "Enable AppArmor profile to Openvswitch." 2020-03-17 19:57:10 +00:00
Zuul
f5132a0d61 Merge "[ceph-client] Set target size ratio of pools for pg autoscaling" 2020-03-17 19:15:44 +00:00
Zuul
f0e3ce9a08 Merge "Add ability to set the domain name in the Nagios chart" 2020-03-17 17:52:47 +00:00
Wickersham, Brian (bw6938)
4a35fb3faf [ceph-client] Set target size ratio of pools for pg autoscaling
Setting the target size ratio of each pool initially which will
autoscale the num of pgs immediately before any data is written to
the pools. This will reduce backfilling as data is written as the
autoscaling would have been done when the pool was first created.

Change-Id: I00b5372d669068621577ae0fe370219a4aa53b6f
2020-03-17 16:53:42 +00:00
diwakar thyagaraj
c4b2be6bcc Enable AppArmor profile to Openvswitch.
This adds Apparmor profile to Openvswitch. This change also refactors
the apparmor job to utilize the feature gates system instead of relying
on separate scripts

Change-Id: Ie53162cfdea5553191d3b5dbdfec195e4001b255
Signed-off-by: diwakar thyagaraj <diwakar.chitoor.thyagaraj@att.com>
2020-03-17 16:39:54 +00:00
Zuul
c81c3f0be0 Merge "Enable Apparmor for ElasticSearch" 2020-03-17 16:19:56 +00:00
Zuul
273088f0a3 Merge "Remove duplicate key" 2020-03-17 15:19:07 +00:00
Meg Heisler
3b7227b393 Add ability to set the domain name in the Nagios chart
This allows the ability to set the domain name in the
Nagios deployment. This change goes along with a change
to imageswhich will allow the ability to append the
domain name to the host name in Nagios so the full
FQDN appears in the dashboard.

Change-Id: I512112921111e49345f19dfca70406b56dd55452
2020-03-17 08:33:35 -05:00
dt241s@att.com
1871b830af Enable Apparmor for ElasticSearch
Change-Id: Ie7dc4399be4f0a62576e336c1de02810eeb09212
2020-03-16 20:08:18 +00:00
Zuul
f26b203637 Merge "Memcached: Add ingress network policy overrides" 2020-03-16 19:07:21 +00:00
dt241s@att.com
d59b6e5944 Enable Apparmor to Kibana
Also added new apparmor zuul gates jobs for Logging, as initial 
apparmor is  getting timeout.

Change-Id: Iea0a5055238d75f401caf9ddb0ddd9985a091aab
2020-03-14 04:37:32 +00:00
Tin Lam
6d849acf93 Remove duplicate key
There is a duplicate network_policy: key (one for ingress and one for
egress). This patch set fixes the netpol override yaml so it is correct.

Change-Id: I0df65ce248c010b5cf6e54515cfa10206436fa6c
Signed-off-by: Tin Lam <tin@irrational.io>
2020-03-14 04:26:33 +00:00
Zuul
6228f5e958 Merge "MariaDB: avoid synchronization in state configmap updates" 2020-03-13 21:14:11 +00:00
Zuul
266a3eb457 Merge "Revert "Make more sections in daemonset overridable."" 2020-03-13 19:53:46 +00:00
Zuul
ad67fd22fc Merge "[Update] Grafana: add home dashboard script" 2020-03-13 19:06:54 +00:00
Pete Birley
0a2ecabb2b Revert "Make more sections in daemonset overridable."
This reverts commit d74e93772684f99652dc6a8922f25c11d502f00e.

This change looks ok, but we need use cases, and tests to make a change to such a complex and heavily used part of osh

(see: http://eavesdrop.openstack.org/meetings/openstack_helm/2020/openstack_helm.2020-03-03-16.00.log.html)

Change-Id: Ice77dcb53fee0e7a64ade9415f9cbf25f5d51d0e
2020-03-13 16:18:52 +00:00
Zuul
7c77bc8f4c Merge "Modify ks-user member role creation" 2020-03-13 15:20:19 +00:00
Andrii Ostapenko
e0e9e623a3 Remove extra securityContext in postgresql backup cron job
Change-Id: I0a55f06fe93f7ab0852621fd9927542d87d1be7e
2020-03-13 04:24:46 +00:00
Radhika Pai
20aad64409 [Update] Grafana: add home dashboard script
Adding a loop to wait for the grafana dashboard to be up and contain the
OSH Home dashboard before running the script.
This should resolve the job completing before the OSH Home dashboard is
in the grafana pod.

Change-Id: I7ab20fad3ce7f7216e2b2679d863f02f97ef1ff4
2020-03-12 14:08:35 -05:00
Gage Hugo
6f9f579b04 Modify ks-user member role creation
This change reverts the member role handling to pre-refactor for
the htk ks-user.sh script.

Change-Id: I5d239be3e14d8b1ea428cae9c0014eb92202932b
2020-03-12 12:04:54 -05:00
Zuul
e60437bc9d Merge "[ceph-mon] update stop script not to remove mons from monmap" 2020-03-10 15:21:12 +00:00
Chinasubbareddy Mallavarapu
f098f760f0 [ceph-mon] update stop script not to remove mons from monmap
This is to update ceph-mon stop script  not to remove mons from
monmap as in multinode clusters three mons in the monmap are required
to handle the quorum properly.

Change-Id: I0dd643007ea0558244bfecae1d90db78828e9834
2020-03-09 20:11:23 +00:00
Luna Das
9b9913d64a Add Helm Charts for MetaController and DaemonJobController.
These charts bootstraps a metacontroller on a
Kubernetes cluster using the Helm package manager.
This enables you to deploy custom controllers as
service + deployment pairs. A DaemonJobController
chart bootstraps the CompositeController and register
DaemonJob CRD, the daemonjob controller executes
DaemonJob(CR's) in kubernetes Cluster.

Change-Id: Ic946f564ea1cf07e89c90a598e59230dc240950c
2020-03-10 01:04:42 +05:30
Zuul
2c9714fcfb Merge "Grafana: Change to import the dashboards in json raw format" 2020-03-05 22:28:54 +00:00
Chinasubbareddy Mallavarapu
7425e3e5c0 [CEPH] update all ceph daemons startup scripts to support msgr2
This is to update all ceph daemons startup scripts as per msgr2 protocol and
also to update v2 port for mon_host config.
This also removes setting mon_addr config since we already have mon_host config.

v1 default port: 6789
V2 default port: 3300

Change-Id: I3d95edbd89f5ac8b40a34f41c1099311cee4f875
2020-03-04 23:22:02 -06:00
Zuul
89bc837094 Merge "Actually add Kibana Liveness Probe" 2020-03-04 23:09:26 +00:00
Zuul
da0f5c7b9b Merge "[ceph-client] update checkdns script logic to handle mon_host config" 2020-03-04 21:30:51 +00:00
Zuul
c8983256af Merge "prometheus-kube-state-metrics; expose readiness probe via HTK" 2020-03-04 20:55:04 +00:00
Fitzpatrick, Steven (sf280x)
53991041ab Actually add Kibana Liveness Probe
The patch submitted last week mistakenly added a liveness probe
for the apache sidecar container instead of the failing Kibana
container.

Change-Id: I61a979099f5c387a8256788ceab2f91e45d17838
2020-03-04 13:27:55 -06:00
Zuul
c12f0cd030 Merge "[ceph-pools] Stop setting pgp_num to nautilus based deployments" 2020-03-04 17:28:03 +00:00
Radhika Pai
dc9e435abb Grafana: Change to import the dashboards in json raw format
This code change is to enable grafana to use the raw json format
dashboards . This is to avoid the conversion of dashboards from json to
yaml and back to json during which the format is encountering issue.
Also this will help in adding new dashboards and maintaining the old
ones.
All the exisiting dashboards under values_override folder are updated to
use raw json format.

Change-Id: I48a7db1514857e082cecbb3b57deff9174509601
2020-03-04 09:52:36 -06:00
Zuul
5ce6115f2e Merge "Grafana: Provision to add customized HomePage" 2020-03-04 01:55:29 +00:00
Chinasubbareddy Mallavarapu
dcdd4a5d0e [ceph-pools] Stop setting pgp_num to nautilus based deployments
Starting in Nautilus, setting pgp_num step is no longer necessary
as long as pgp_num and pg_num currently match, pgp_num will automatically
track any pg_num changes.
More importantly, the adjustment of pgp_num to migrate data and (eventually)
converge to pg_num is done gradually to limit the data migration load on the system.

Change-Id: I2e3c9bd1fada8105fbf4e095a78db63c4ba80825
2020-03-04 01:13:47 +00:00
Chinasubbareddy Mallavarapu
ffd06369ad [ceph-client] update checkdns script logic to handle mon_host config
This is to update checkdns script loigc not to update ceph.conf when dns is up
as current logic is repalcing ceph.conf file with configmap where we have fqdn for
ceph-mon endpoint which is causing parsing issues in Nautilus.

Change-Id: Iae2a38fdc99654430812451c57ac2655887f942a
2020-03-04 01:11:19 +00:00
Chris Wedgwood
3b42996949 [mariadb] Update to 10.2.31
Move to updated MariaDB version 10.2.31.  Tweak start.py for python3
as /usr/bin/python doesn't exist and isn't robust.

Change-Id: Ib64ed5de34e3ff87c634d09f98aaddeb374d2bd6
2020-03-03 23:04:10 +00:00
Phil Sphicas
2a4b369f25 MariaDB: avoid synchronization in state configmap updates
Each MariaDB instance updates the grastate configmap on a periodic
basis, every 10s by default. Collisions can occur when multiple
instances try to write their state at the same time (within a few
milliseconds). One instance will write successfully, and the other will
get a 409 error. There is nothing to break the synchronization, so the
failures tend to be persistent.

This change adds a small sleep after a collision is encountered,
creating an offset between the cycles.

Change-Id: Ib8a64f8f7ee15a6579e901d80ae759c38e0e901e
2020-03-03 14:12:46 -08:00
Chinasubbareddy Mallavarapu
444a5ae67f [libvirt] Use ceph image for ceph related scripts
This is to update two of init containers to use ceph confighelper image as
they are executing ceph based scripts and the image also will have latest
clients installed for ceph activities.

Change-Id: Ie4fbd8af2645d5bc5b7e4f0fd22874987a0f55f6
2020-03-03 15:31:42 +00:00
Zuul
231bc0cadb Merge "Make more sections in daemonset overridable." 2020-03-03 10:01:06 +00:00
songgongjun
d74e937726 Make more sections in daemonset overridable.
The work of enable dpdk in starlingx needs to achieve the overrides
of parameters such as images, tags, labels, and pods. This function
is being implemented through the support of ovs per-host overrides.
In order to transfer the parameters such as images after overrides
to the daemonset file to achieve the corresponding functions, the
functions of overrides need to be upgraded. Move the $daemonset_yaml
parameter in the daemonset file to the overrides file, so that
daemonset file uses parameters after overrides.This patch and
https://review.opendev.org/#/c/707775/ depend on each other.

Change-Id: I210e54b28e32ba1b8e281659fee8e6eda38d79d0
Story: 2007291
Task: 38754
Depends-on: https://review.opendev.org/#/c/708894/
Signed-off-by: songgongjun <gongjun.song@intel.com>
2020-03-03 05:28:53 +00:00
Zuul
d56f8ce2c9 Merge "Refactor ks-user HTK script" 2020-02-28 20:52:49 +00:00
dt241s@att.com
920bddde64 Enable Apparmor to nagios
Change-Id: I5927d32903cabd93b9d78c0c47994a94162deb1c
2020-02-28 13:31:50 +00:00
Chinasubbareddy Mallavarapu
07c62ddfd5 [ceph-mon] Add mon hosts as per msgr2 protocol
This is to update mon_host configuration to support both v1 and v2
of messenger.

ex: mon_host = [v1:172.29.0.11:6790/0,v2:172.29.0.11:3300/0]

Change-Id: I02785ea42c07d1aecbef2cf0c32dd6a1a236659f
Signed-off-by: Pete Birley <pete@port.direct>
2020-02-27 20:36:16 +00:00
Gage Hugo
6300aa6d25 Refactor ks-user HTK script
This change refactors the ks-user helm-toolkit script
to reduce the number of calls to keystone for domains
or projects that already exist. Also added in a case
to check if the role is admin to avoid superfluous
API calls.

Change-Id: Ic4811e668ee1daed194bb4996baadc43aa742d3a
2020-02-27 19:41:59 +00:00
Zuul
5355ff5627 Merge "Add Liveness Probe to Kibana Deployment" 2020-02-26 22:54:26 +00:00
Zuul
76e0645132 Merge "Add Liveness Probe to Openstack Exporter Deployment" 2020-02-26 22:37:30 +00:00
Steven Fitzpatrick
05d4b34715 Add Liveness Probe to Openstack Exporter Deployment
Kill the openstack exporter pod if it is not ready after 3 mintues

Change-Id: Id20d01052aecce19b845c610424c5375dc14cd43
2020-02-26 16:13:09 +00:00
Steven Fitzpatrick
371b1cbe89 Add Liveness Probe to Kibana Deployment
This change adds a liveness probe to the Kibana deployment spec.
If multiple kibana replicas are deployed simultaniously they race
to update the .kibana index in Elasticsearch, which sometimes
results in a pod to stall without starting it's http server.

Change-Id: Ib685d738ced59df66ff3501749316a01b5cacf79
2020-02-26 16:12:40 +00:00