194 Commits

Author SHA1 Message Date
Pete Birley
8bb71f6659 Gate: Cleanup scripts for k8s keystone auth gate
This PS cleans up the scripts for the k8s k8s keystone auth gate.

Change-Id: I248439f9b8ffa372dfaba5acba0c8c587231d901
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-12 13:43:41 -05:00
Pete Birley
7f4a37440f VBMC: Move and update vbmc image to osh-infra
This PS updates and moves the vmbc image to osh infra.

Change-Id: I9f8d21df8974d1484d9f087ee296fede2a87e545
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-08 09:38:24 -05:00
Zuul
7c839c82b2 Merge "Gate: Move to K8s 1.10.8" 2018-10-06 06:30:08 +00:00
Zuul
77393ab143 Merge "Libvirt: Fix image" 2018-10-06 00:58:41 +00:00
Pete Birley
f8880d27ad Libvirt: Fix image
This PS fixes the libvirt image, buy removing the ubuntu-cloud
archive repo and pinning to a good version.

Change-Id: I5097d8893b92d020f7a5a1cb5925dec0b01d4da2
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 15:41:12 -05:00
Gupta, Sangeet (sg774j)
a34a7d8e50 Adding Falco
This commit adds falco daemonset of the node for behavioral activity
monitor designed to detect anomalous activity.

Change-Id: I783a2acc03592471c81a8a54e1dc0df140b34a42
2018-10-05 16:18:51 +00:00
Pete Birley
19376ee9e6 Gate: Move to K8s 1.10.8
This PS moves to use k8s 1.10.8, which includes a couple of fixes
for PVC mounts.

* https://github.com/kubernetes/kubernetes/pull/66863

Change-Id: Ica30950a8200f5755897b51fd2b4d24c69a10e61
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 07:44:42 -05:00
Pete Birley
feeeed4d5d Gate: Remove unused helm chart deployment role and playbook
This PS removes the unused helm chart deployment role and playbook.

Change-Id: I01c58a628589ec35af2557c8cc93ea47fe084089
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-05 01:43:33 +00:00
Pete Birley
25985f7b43 Libvirt: escape kube cgroups and pid reaper
This PS moves to run the Libvirt process as a transient unit
on the host, free fom k8s controlled cgroups. In addition it
also uses the cloud archive provided libvirt/qemu packages.

Change-Id: Idfe9ae6f072acd86f877df0c3dfe3db4c20902d6
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-03 19:11:00 +00:00
Steve Wilkerson
fa09705867 Fluentbit: Add kernel, kubelet, and dockerd logs
This adds inputs for kernel logs on the host, as well as dockerd
and kubelet logs via the systemd plugin. This also adds a filter
for adding the hostname to the kernel log events, for renaming the
fields for systemd logs as kibana can not visualize fields that
begin with an underscore, and adds elasticsearch indexes for both
kernel and systemd logs

Change-Id: I026470dd45a971047f1e5bd1cd49bd0889589d12
2018-10-01 11:56:58 +00:00
sai battina
e155c92f14 Helm: Update helm to 2.11.0
This helps to fix a bug when adding stable repos

Change-Id: I3eb28a037f7eb22016a29bc36e4a791a5bfda852
2018-09-25 18:14:49 +00:00
Steve Wilkerson
a084769410 Elasticsearch S3 repo
This ps adds the ability to use the ceph radosgw s3 api for
snapshot repositories. It removes the ability to use a RWM pvc, as
the radosgw solution provides a more robust approach for storing
index snapshots

Change-Id: Ie56ac41ccdc61bfadcac52b400cceb35403e9fae
2018-09-19 15:53:21 -05:00
Zuul
333fdc931b Merge "Gate: Trim dev-deploy gates" 2018-09-19 15:52:48 +00:00
Pete Birley
101f58ae4b Gate/Dev: Fix perms for upstream-resolv.conf
This PS fixes the permissions for the upstream resolv.conf used by the
dns redirector.

Change-Id: Ieef113a6e7b72767318516c63cf48dcac202cf4d
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-18 11:55:20 -05:00
Steve Wilkerson
bc6e22f392 Gate: Trim dev-deploy gates
This attempts to trim down the dev-deploy gates until further
gate refactoring is complete. This disables the elasticsearch and
fluentd exporters and removes the openstack exporter from the
single node deployment gates to ease the load on nodepool vms

Change-Id: If211511e8f52fe39d293966abbd7e62b45b65970
2018-09-17 13:56:51 +00:00
Zuul
d208d55a46 Merge "Gate: only restart network manager if required" 2018-09-17 13:49:01 +00:00
Zuul
0f2dace4e8 Merge "Gate/Dev: Allow custom upstream dns servers to be preserved" 2018-09-15 16:59:22 +00:00
Pete Birley
620d374730 Gate: only restart network manager if required
We only need to restart network manager if disabling dns management.

Change-Id: Idfdf68678a68c2808527de4226ff91e9ea5f8d67
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-15 14:39:17 +00:00
Pete Birley
79d11e4044 Gate/Dev: Allow custom upstream dns servers to be preserved
This PS updates the dns redirect pod deployment to support a persistant
set of customised upstream nameservers to be used.

Change-Id: Ib163f8ed9ceadca69b56cd5f146ffd194d98cdc3
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-15 13:13:29 +00:00
Zuul
2fce7e8212 Merge "Correct the task name for tiller installed" 2018-09-14 21:03:16 +00:00
Zuul
accaf8aabf Merge "Update the env usage of docker_container module" 2018-09-13 13:53:54 +00:00
Zuul
e6966ffdaf Merge "Gate: Update gate permit running on ubuntu 18.04" 2018-09-11 19:19:27 +00:00
Pete Birley
e67f7bafd5 Gate: Update gate permit running on ubuntu 18.04
This PS updates the gate to permit running on the current LTS ubuntu
release.

Change-Id: I7e32a4ab0dc79e4b5f7a16f8a8cb5e9ee182ee08
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-11 15:20:48 +00:00
Steve Wilkerson
6b944f557b Libvirt: Move chart to openstack-helm-infra
This moves the libvirt chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Change-Id: I02ce197f8d100da74c086d84e2f9d2b902a69e97
Story: 2002204
Task: 21723
2018-09-10 09:45:55 -06:00
Steve Wilkerson
3dcbfae101 Openvswitch: Move chart to openstack-helm-infra
This moves the openvswitch chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Change-Id: I6e00231b8de54c01bc9bb31e0433753a9f281542
Story: 2002204
Task: 21730
2018-09-07 12:35:40 +00:00
Zuul
40e0ddba33 Merge "Gate: Add process exporter to gate deployments and docs" 2018-09-05 20:52:24 +00:00
Steve Wilkerson
93630ac6e3 MariaDB: Move chart to openstack-helm-infra
This moves the mariadb chart to openstack-helm-infra as part of
the effort to move charts to the appropriate repositories

Change-Id: Ife56e28de46c536108cebb4f4cdf6bad2a415289
Story: 2002204
Task: 21725
2018-09-04 18:57:53 -05:00
Steve Wilkerson
0bfb2979ec Gate: Add gate for openstack support infrastructure
As part of the effort to move the supporting infrastructure
services to openstack-helm-infra, this adds a gate that will be
used for those services specifically

Change-Id: Id7c5649330eb41a0017a740ade9465fd66abb32f
2018-09-04 16:42:21 -05:00
Steve Wilkerson
0aae608aa0 Gate: Add process exporter to gate deployments and docs
This adds the process exporter to both the developer and multinode
gates, along with adding the relevant deployment steps to the docs

Change-Id: I85d5c398fbbb62145c9bb4e3a885e9a774725e5a
2018-09-04 15:54:25 -05:00
Zuul
b6f7ff7db5 Merge "Add Ceph to osh-infra gates" 2018-08-30 04:24:53 +00:00
Pete Birley
96703649a5 Helm-Toolkit: TLS cert generator
This PS adds a function to generate tls certificates from a
CA. It also adds a script to generate a snakeoil ca for dev
and future gating work.

Change-Id: Ic94a9ab5fa3ebb912b507008a6b2f78e16dade67
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-29 11:26:44 -05:00
Pete Birley
f8e8ff0082 Kube: Disable anon auth on kubelet
This PS disables anon auth on the kublets api.

Change-Id: I77127ae53d713edd815cd00e15acdf1492762efc
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-28 22:37:26 +00:00
Steve Wilkerson
8037bf4ca9 Add Ceph to osh-infra gates
This adds a ceph developer gate to openstack-helm-infra, which
depends on ceph moving to openstack-helm-infra. This also replaces
the NFS backed storage for the multinode gate with ceph instead

Change-Id: I11268463aa037a2e037217a2dbc89c7432c0d277
2018-08-28 15:39:03 -05:00
Zuul
b6fc24b996 Merge "Revert "Update OSH Author copyrights to OSF"" 2018-08-28 19:33:45 +00:00
Jean-Philippe Evrard
bf069b2311 Revert "Update OSH Author copyrights to OSF"
This reverts commit 178aa271a44956e86f4e962bf815fa827d93c9af.

Change-Id: I38a52d866527dfff2689b618e055f439bc248c13
2018-08-28 17:25:54 +00:00
Zuul
1a33c34cbd Merge "Update OSH Author copyrights to OSF" 2018-08-28 15:23:49 +00:00
Matt McEuen
178aa271a4 Update OSH Author copyrights to OSF
This PS updates the "Openstack-Helm Authors" copyright attribution
to be the "OpenStack Foundation", as decided in the 2018-03-20
team meeting:
http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-03-20-15.00.log.html

No other copyright attributions were changed.

Change-Id: I1137dee2ae5728771835f4b33fcaff60fcc22ca9
2018-08-26 17:17:06 -05:00
Pete Birley
c5feca82a3 K8S: Update to current 1.10.x release
This PS bumps the k8s version to that of the current release.

Change-Id: Ife6edac83f6e7639d6142d64aff458450a2e58ff
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-23 12:28:22 -05:00
Pete Birley
e74dce4307 Helm: dont update the default stable repo on install
Helm now tries to update the stable repo when running helm init
by default. This ps adds the flag to prevent this, which is required
when running in airgapped, and some corporate, environments.

Change-Id: I38c487f88d17e9429c30cb03bf2d0f3652f1db99
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-22 22:03:47 -05:00
Zuul
1e644650a0 Merge "Grafana: Update default refresh intervals, enable gate ingress" 2018-08-22 16:48:11 +00:00
Zuul
ba93bc11c4 Merge "Helm: Move to use 2.10 release" 2018-08-22 04:19:33 +00:00
Pete Birley
c62c5dcf88 Helm: Move to use 2.10 release
This PS moves to use the Helm 2.10 release, which brings in a version
of sprig that supports TLS certificate creation from defined CAs.

Change-Id: I80233f8f31727c80bcd667cfa0d851488da39588
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-21 15:52:20 +00:00
Steve Wilkerson
9ee7561521 Grafana: Update default refresh intervals, enable gate ingress
This updates the grafana dashboards to use a default refresh
value of 5m to prevent dashboards with intensive queries (like the
container dashboard) from submitting frequent, expensive requests
to Prometheus

This also removes the override to disable the ingress service for
grafana in the developer deployment script, as it was overlooked
when enabling ingresses after the ingress chart was introduced

Change-Id: I0958a3978cec25a1350172cbe75996f1346858c5
2018-08-20 10:59:53 -05:00
Gupta, Sangeet (sg774j)
61584fdb9d kubernetes-keystone-webhook base64 encoding
Changing the chart to accept plain certificates rather than a base64
encoded string. The chart will handle the base64 encoding internally.

Change-Id: I3cd0710652b1b731fa4bcd9e92dd59ce2c436eb6
2018-08-10 15:54:49 -05:00
caoyuan
08641418a2 Update the env usage of docker_container module
env parameter should be dictionary of key,value pairs rather than
"=" due to ansible docs[0], this PS to update it.

[0]: https://docs.ansible.com/ansible/latest/modules/docker_container_module.html#id3

Change-Id: I79d20b101b56b6df7f2a9162868ec98214f183bf
2018-08-04 01:30:33 +00:00
caoyuan
ab9dca30a9 Correct the task name for tiller installed
Change-Id: Ibf146f3a4c377c9b6d58aceb0a572386fcbff3eb
2018-08-04 01:07:35 +00:00
Pete Birley
ac27096002 Gate: specify user for tiller image used for bootstrapping cluster
This PS updates the ansible roles to update the user used with
the tiller image used for bootstrapping to allow access to approprate
config files used. This is required for use with the current master
tiller image, which no longer deffaults to the root user.

Change-Id: I61f28a2ebeecb22eb66e0394417b0af3a9116483
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-01 11:01:07 -05:00
Zuul
cb3ad183ca Merge "K8s: update to 1.10.6 in OSH gates" 2018-07-31 18:20:33 +00:00
Pete Birley
9e2d684188 K8s: update to 1.10.6 in OSH gates
This PS bumps the version of k8s used in the gates to 1.10.6

Change-Id: I396fe0c0e276d17eb52bfe289a464b7008b8d4d2
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-30 18:30:59 -05:00
Steve Wilkerson
9fd4cd0917 Deploy ingress in osh-infra dev and multinode gates
This deploys the ingress chart in the openstack-helm-infra dev
and multinode gates, which allows for enabling ingresses in the
charts where defined

Change-Id: I055c7b02d9af68f6e3c5eda33d69dd0b8b1b70ca
2018-07-30 07:14:00 -05:00