130 Commits

Author SHA1 Message Date
Tin Lam
b80d9146d1 Update helm to v2.9.1
This patchset updates helm version to v2.9.1.

Change-Id: I438142cd9649749933fbe7153d149e7d0b0a5537
Signed-off-by: Tin Lam <tin@irrational.io>
2018-05-19 14:56:20 +00:00
Pete Birley
ec58d6e133 Keystone-Webhook: fix gate boolean
This PS fixes the conditional for the keystone webhook deployment
in the gate.

Change-Id: I7a2c00d467df98903578123a089a934a8f68cd01
2018-05-18 16:39:56 -05:00
Pete Birley
39e1f7f9f3 KubeADM: Keystone Kubernetes Webhook
This PS adds the ability to deploy the Keystone Kubernetes Webhook
chart via kubeadm-aio

Change-Id: I18b0477a775de942f940e9c0984559089dca1cdb
Co-Authored-By: Tin Lam <tin@irrational.io>
Co-Authored-By: Gage Hugo <gagehugo@gmail.com>
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-18 00:53:58 -05:00
Steve Wilkerson
287b14933e Update nfs-provisioner and ldap deployment scripts
This updates the lma-nfs-provisioner deployment script to run make
on the nfs-provisioner chart. Previously, it relied on the local
image registry deployment step being run to lint and package the
nfs-provisioner chart. This change allows the nfs-provisioner to
be deployed without the local image registry if desired.

This also updates the ldap deployment script to only run make on
the ldap chart instead of pulling the default images with the
make-pull directive

Change-Id: I3d8f321d7a8af50fd80ffbd6a337fa17675f5700
2018-05-15 20:55:31 +00:00
Zuul
fbf2464042 Merge "Add ldap support to grafana, update version, add helm tests" 2018-05-15 07:41:37 +00:00
Zuul
956fa604d3 Merge "Add ldap support in elasticsearch/kibana apache proxies" 2018-05-15 03:53:15 +00:00
Zuul
36c2c9754a Merge "LDAP: Move ldap chart to openstack-helm-infra" 2018-05-15 03:53:14 +00:00
Steve Wilkerson
e081c19fe8 Add ldap support to grafana, update version, add helm tests
This adds ldap support to the grafana chart. This required updating
the version of Grafana to 5.0, as this version allows for using
configuration files to bootstrap the datasources and dashboards
instead of using the grafana http api. This was a necessary change
as using ldap for grafana presented issues trying to create the
datasource via the http api

This also adds a basic helm test for grafana. This test simply
verifies whether the prometheus datasource configured exists and
whether the number of dashboards reported by the admin api matches
the number of dashboards expected

Change-Id: I2e987cb425adba9f909722ffdb25b83f82710c4d
2018-05-15 01:42:04 +00:00
Steve Wilkerson
3c692abd6e Add ldap support in elasticsearch/kibana apache proxies
This adds required configuration for enabling LDAP through
the apache proxy in the elasticsearch and kibana charts by
default

Change-Id: Iaff8f328ff50944ddad94ec86b1134ca73750176
2018-05-14 13:53:30 +00:00
Steve Wilkerson
85208fe98a LDAP: Move ldap chart to openstack-helm-infra
This moves the ldap chart to openstack-helm-infra from
openstack-helm, allowing for ldap to provide an authentication
mechanism for components of the LMA stack, and can still be used for
keystone in openstack-helm, as openstack-helm-infra is a required
project

Change-Id: I211bc47c7a3ae875614102c8f64daa1099f702e8
2018-05-14 08:53:00 -05:00
Pete Birley
be3f300623 Gate: place role default vars within the role
This PS places the role default vars within the appropriate role,
in addition it exposes kubeadm's selfhosted param and deploys the
kubeadm binary to master nodes.

This PS exposes the selfhosted param, and deploys kubeadm to master
nodes.

Change-Id: I5ad1b593a711ffe353b012394d54044dede0691d
2018-05-14 03:28:31 +00:00
Pete Birley
80db87033b Gate: stop pulling default images
This PS stops pulling the charts default images, as the make file
target cannot target over-rides - resulting in longer gate runs with
twice as many images pulled than required in some cases.

Change-Id: I04c1d43d6ac9d2f509604709139583b085b406e3
See: https://review.openstack.org/#/c/566738/
2018-05-13 09:40:05 -05:00
Pete Birley
dd92edfb58 Gate: use infra mirror when in infra for kubeadm aio image
This PS uses the infra mirrors in the kubeadm aio build when
running the gate in openstack-infra.

Change-Id: Id9a4bf2b13051dfcf5aea688511da24cd245de9c
2018-05-11 16:43:22 -05:00
Steve Wilkerson
b492ee54c3 OSH-infra multinode gate rework
This moves to using bash scripts for deploying the charts for the
multinode gates in osh-infra as opposed to using the ansible
chart builder

Change-Id: I2951ccf57250a5e6e272872f2d6f7a81bd11f184
2018-05-10 00:06:04 +00:00
Steve Wilkerson
db643c1cdd Single node dev deploy gate for osh-infra
This adds a gate for a single node development deployment for
all charts in openstack-helm-infra

Change-Id: I42e8daf41a7eec428ec3d269adbb5c416d092818
2018-05-09 21:56:06 +00:00
portdirect
0d969910af Kube: Kubernetes v1.10.2 support
This Ps adds support for kubernetes v1.10.2

Change-Id: Ic1db020cc86fa9db78f3f3cfcda92e3291a889a8
2018-05-09 14:22:45 -05:00
Pete Birley
b9edac6148 Kubernetes: enable mount propagation
This PS enables the mount propogation feature gate.

Change-Id: I7a37f45ff6061b144c6f04233712cd84fccb3e83
2018-04-22 15:35:40 -05:00
Pete Birley
39ab1c3b5d Gate: Improve centos support
This PS updates the CentOS Gate.

Change-Id: Ic29b9e5949fb3fb3433802f7933208f3cabfef72
2018-04-20 11:28:36 -05:00
Pete Birley
5750d2a01f Gate: update Ansible conventions
Using tests as filters is deprecated, and will be removed in 2.9.

Change-Id: I2bc31177cdb3d59319c4cb04f77db573f3217479
2018-04-18 23:32:35 -05:00
Zuul
6dd5f87a3d Merge "Helm: update helm version to v2.8.2" 2018-04-19 00:22:26 +00:00
Pete Birley
a7da953e39 Helm: update helm version to v2.8.2
This PS updates the helm version in the gate to helm 2.8.2

Change-Id: Ied757f6d653255f198de524f41111cd2928a03dc
2018-04-18 21:55:00 +00:00
Pete Birley
37d836c8c7 Gate/Dev: RPM and structure improvements
This PS restores the use of the distro provided docker for RPM based
distros. It also removes the roles subdirectory from the playbooks
and replaces it with a symlink for local dev use.

Change-Id: Ic11adb85813e92488f5ebbe6714ad7da8d3938e2
2018-04-18 13:56:47 -05:00
Pete Birley
6921006103 Gate: update paths for pip 10 installation
Pip>=10 moves the entrypoint to /usr/local/bin from /usr/bin, this
ps forces the shell to forget all locations following upgrade
to allow it to adapt to the new location.

Change-Id: I1ed92b75f689e982397cd4fc87ac262256e161e8
2018-04-15 16:54:56 +00:00
Steve Wilkerson
9dd81954fd Move roles and playbooks to top level
This proposes moving the playbooks and roles to the top level of
osh-infra to be consumed by osh

Change-Id: I7e3516da8e516060f94b8b9c8875918504de7446
2018-04-09 20:52:18 -05:00
portdirect
59d4141d6a Update to F27 and update docker packages
This PS moves the fedora gates to use F27. It also updates
the docker packages used for both fedora and centos

Change-Id: Ic5ab5793d7176a81a8ea70c82b1d53a1fdf5f740
2018-04-06 17:21:41 +00:00
Steve Wilkerson
99befc2484 Nagios Chart
This adds the nagios chart to osh-infra to provide additional
monitoring functionality. It uses helper functions to consume
yaml definitions for services, commands, hosts and hostgroups
to generate the required configurations for those entities in
nagios's configuration

Change-Id: I6238bb8cb1e5c8dc48594ddea50693f3e7b0a176
2018-03-23 13:45:40 +00:00
Zuul
f461e53e52 Merge "Provide ability to specify proxy" 2018-03-14 14:10:57 +00:00
Paul Carver
e01268bb50 Correcting a spelling error
perfoming -> performing

Change-Id: I639d8a4d0021dbdcd66ff711f86c25f1313a823f
2018-03-12 20:26:30 -04:00
Tin Lam
391bbf69d7 Provide ability to specify proxy
This patch set provides ability to configure the proxy setting in
the ansible playbook used to run the gate.

Change-Id: I7ae66cb16fa6db7d46a0a3f23c289cc625e583c4
Signed-off-by: Tin Lam <tin@irrational.io>
2018-03-12 04:15:30 +00:00
Pete Birley
21a6217c58 Gate: get full process list from host
This PS adds the ps command to the gate log collection task.

Change-Id: Ife1710854547b28a6dfa6b3e4d527ebf4d04179b
2018-03-09 12:45:44 +00:00
Zuul
3a552b4200 Merge "KubeADM: force calico interface to match to same as kubelet" 2018-03-09 00:32:34 +00:00
Pete Birley
c9ffaea770 KubeADM: force calico interface to match to same as kubelet
This PS forces calico to use the same interface as the kubelet
for inter-node communication.

Change-Id: I7d03beec46cccba4a57e092bf108695e8e88996f
2018-03-08 22:20:56 +00:00
Hemanth Nakkina
5392ac810b Remove Api version requirement for CronJob Curator
Curator job in Elasticsearch helm chart has a condition on
api version batch/v2alpha1. Cronjob resource is deprecated
in batch/v2alpha1 from k8s 1.8 and batch/v1beta1 is enabled
by default.

Remove the condition on API version as it is no more required.

Closes-Bug: #1753524
Change-Id: Ia296b3742e655fae508e5d4402e7f3881db31688
2018-03-06 08:51:08 +05:30
Pete Birley
ca3929025b Gate: collect more host level logs
This PS collects more host level logs in the gate scripts.

Change-Id: I0ec13f45fd4561fec59d08b08eb78390a3866156
2018-02-26 07:20:25 +00:00
Pete Birley
1bf13af26c Node-Labels: Add linuxbridge node label to nodes
This PS adds the linxubridge node label to nodes to simplify
deployment and testing of the neutron linuxbridge backend.

Change-Id: I3095c21a75ad3057539f4fed431cb18c68e49a9b
2018-02-26 03:57:49 +00:00
Pete Birley
e0c688d7ee dependencies: move static dependencies under a 'static' key
This PS moves static dependencies unser a 'static' key to allow
expansion to cover dynamic dependencies.

Change-Id: Ia0e853564955e0fbbe5a9e91a8b8924c703b1b02
2018-02-24 17:39:55 -05:00
Steve Wilkerson
4f1f180e8e Add prometheus annotations to tiller-deploy service
This adds the prometheus annotations to the tiller chart, allowing
for the scraping of metrics from tiller.  currently, tiller exports
metrics specific to the grpc calls being made against it

Change-Id: Ibe10098689cc37a9de6306af86f4d63d8aab318b
2018-02-20 10:05:05 -06:00
portdirect
3713266f4c K8s: udpate KubeADM-AIO to use K8s v1.9.3
This PS updates the version of K8s used in the gate to v1.9.3

Change-Id: I284083e0cdf828701c439c44edfd3a975dcd69c3
2018-02-17 15:21:06 -05:00
Steve Wilkerson
5d95b0e2cb Add fluentd prometheus exporter for logging metrics
This adds templates for a prometheus exporter for fluentd to
adequately capture log metrics and fluentd service metrics for
consumption by prometheus

Change-Id: I6d6a8c2be07af819dc6d99b8ce5f1d4b635a69f0
2018-02-13 19:09:35 +00:00
portdirect
7a322f0a08 KubeADM: Label namespaces
This PS removes the duplicate labeling of K8s namespaces everytime
the kubeadm image is run - as this action is performed by the
container itself while deploying k8s. It also updates the playbook
to label the kube-public ns.

Change-Id: Icfaabe54d263e0bbc52f2ac11835cb5d92ad32a4
2018-02-11 13:59:15 -05:00
Zuul
3b130197e7 Merge "Fix namespace label" 2018-02-09 16:30:26 +00:00
Zuul
4297f786b0 Merge "Add elasticsearch exporter" 2018-02-07 23:30:04 +00:00
Steve Wilkerson
094e0103a9 Add elasticsearch exporter
This adds a chart for an elasticsearch exporter to expose metrics
for prometheus. This also moves the exporter to be included as
part of the chart it's meant to target as opposed to its own
separate chart

Change-Id: I491f4d1efba633827d8a6255218daeb9d427f922
2018-02-07 10:59:27 -06:00
Steve Wilkerson
6af03cd6d9 Update prometheus metrics gathering in post-job
This updates the prometheus metrics gathering role to dynamically
detect deployed namespaces instead of using hardcoded tasks for
each namespace. This allows the use of this job in openstack-helm
without needing to manually add additional namespaces

Change-Id: I2304aceab8dcda5471af708f57924193f03ee8f3
2018-02-05 18:21:49 -06:00
Tin Lam
ae54ad7cd0 Fix namespace label
This patch set fixes the namespace labels and adds in a new log file to
describe all namespaces to troubleshoot gate issues where labels are not
applied properly.

Change-Id: I34c43c345f9a49df8d7fcf2e7824220a22698d46
Signed-off-by: Tin Lam <tin@irrational.io>
2018-02-05 15:43:40 -06:00
portdirect
2d725fd00b Rollback helm version to 2.7.2
The update to helm 2.8.0 resulted in issues with releases not
registering as ready before timing out. This rolls the version back
until those issues are addressed

Change-Id: Id58f85f150054d82c047bd360258ebe9e571360f
2018-01-31 21:28:58 +00:00
portdirect
27a2b2e16d K8s/Helm: Bump versions to current release
This PS bumps the versions of helm and K8s to their current GA
release.

Change-Id: Ia205f47d4f6b89d6d54bb2a71fde28a5730d2a47
2018-01-28 23:34:52 -05:00
Steve Wilkerson
3ec7f5f0ff Gate fix: httpd image, elasticsearch, openstack-exporter
There was a change in the upstream reference httpd image for
apache that changed how modules were built for apache.
This change adds the required fix to accomodate the change.
See isssue here https://github.com/docker-library/httpd/pull/87

The Elasticsearch image tag was updated to accomodate the kernel
versions used in the gate as part of the kernel update playbook
See https://github.com/elastic/elasticsearch/issues/28349#issuecomment-360233779

The openstack-exporter binary was changed to reflect changes made
to the openstack-exporter image

Change-Id: I1deb9e7cde794421dd33fade566c2a9fdb5007e6
2018-01-28 15:07:24 -06:00
Zuul
b380b68bba Merge "Gate: collect host level info" 2018-01-20 21:29:05 +00:00
Zuul
08a6266654 Merge "Add label to namespaces" 2018-01-19 14:50:08 +00:00