141 Commits

Author SHA1 Message Date
Steve Wilkerson
80c1ff4071 Gate: Fix version of ansible deployed via dev-deploy
This pins the version of ansible deployed via the makefile
dev-deploy directives to the version used in zuul.  This was
causing issues with docker, as make dev-deploy setup-host was
deploying ansible 2.6. Ansible 2.6 introduces a new flag to the
docker_container module (init) that is incompatible with our
current roles, which resulted in observed failures in osh-infra
and osh

Change-Id: Ibc885b53bce77eb36817024b21efb0e99865f690
2018-06-29 15:39:58 +00:00
chenlx
49da0d0bb3 Remove dupliate osh-infra-docker.yaml file
We only need keep one of osh-infra-deploy-docker.yaml and
osh-infra-docker.yaml, because the content is almost the same.

Change-Id: I27854c0b9492853f7c4edf130b6533c33292dc89
2018-06-28 14:18:07 +08:00
Zuul
e46b1b0c2b Merge "Add proxy environment" 2018-06-26 02:40:13 +00:00
Pete Birley
ce21f6e96d Gate: Add support for testing fqdn over-rides in zuul
This PS adds support for testing fqdn over-rides in zuul gates.
When enabled it will direct requests to a configurable domain to
the default ip of the primary node.

Change-Id: I3d9a4a0bf06532caf0f544d44027493622f4ae5b
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-25 02:42:09 +00:00
Tin Lam
bb7842f39f Kubernetes: Bump version to 1.10.5
Upgrades the kubernetes version to v1.10.5 from v1.10.4.

Change-Id: Ic2a1f73c935136135e587945180e67ac928f8178
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-22 17:00:12 +00:00
Tin Lam
cef6dd5a19 Add proxy environment
This patch set loads the proxy environment variable when executing helm
init as it attempts to reach out to an external address to load the
stable repo. If this is executed with in a corporate environment that
requires a proxy, this would fail without the needed envvars.

Change-Id: I8b1b1efb15352934eb8f2a0b0214e486eea80d46
Signed-off-by: Tin Lam <tin@irrational.io>
2018-06-22 13:12:17 +00:00
Pete Birley
b6ee0e3da3 Kubernetes: Bump version to 1.10.4
This PS bumps the k8s version to v1.10.4

Change-Id: I1f07653a6f26a4796f30ce1f0df9937fb32c2b43
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-10 02:59:09 +00:00
Pete Birley
39d93dbe23 Kube: Update to kubernetes 1.10.3
This PS updates the version of kubernetes deployed in the gates/dev
env to 1.10.3.

Change-Id: I4916a669ab0cb58760c0497b2264d4a7d0a9bffe
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-04 09:35:26 -05:00
Zuul
ea89a3ef06 Merge "Update policy" 2018-06-02 00:07:11 +00:00
Tin Lam
cb1c376ad2 Fix pip package version
The python "cmd2" package installs version 0.9+ on Python 2.7, which only
support Python 3.4+. This causes a dependency error in the gate due to
issue outlined in [0].  We will pre-install a capped version of "cmd2"
that would work with Python 2.7.

This patch set also temporarily make the keystone webhook non-voting as
this bug is causing a circular dependencies with patch [1]. Once this is
fixed, a new patch will be submitted to make this voting again.

[0] https://github.com/python-cmd2/cmd2/issues/421
[1] https://review.openstack.org/#/c/571093/

Change-Id: I34cbde65b74efc2805bd7785f84878783d2badbf
2018-05-30 01:50:22 -05:00
Tin Lam
91fa516951 Update policy
This patch set updates the k8s-keystone-auth policy.

Change-Id: Ia08d393f363ecb49007dc4d4801c61e569b89981
Signed-off-by: Tin Lam <tin@irrational.io>
2018-05-25 19:46:42 -05:00
Tin Lam
b80d9146d1 Update helm to v2.9.1
This patchset updates helm version to v2.9.1.

Change-Id: I438142cd9649749933fbe7153d149e7d0b0a5537
Signed-off-by: Tin Lam <tin@irrational.io>
2018-05-19 14:56:20 +00:00
Pete Birley
ec58d6e133 Keystone-Webhook: fix gate boolean
This PS fixes the conditional for the keystone webhook deployment
in the gate.

Change-Id: I7a2c00d467df98903578123a089a934a8f68cd01
2018-05-18 16:39:56 -05:00
Pete Birley
39e1f7f9f3 KubeADM: Keystone Kubernetes Webhook
This PS adds the ability to deploy the Keystone Kubernetes Webhook
chart via kubeadm-aio

Change-Id: I18b0477a775de942f940e9c0984559089dca1cdb
Co-Authored-By: Tin Lam <tin@irrational.io>
Co-Authored-By: Gage Hugo <gagehugo@gmail.com>
Signed-off-by: Pete Birley <pete@port.direct>
2018-05-18 00:53:58 -05:00
Steve Wilkerson
287b14933e Update nfs-provisioner and ldap deployment scripts
This updates the lma-nfs-provisioner deployment script to run make
on the nfs-provisioner chart. Previously, it relied on the local
image registry deployment step being run to lint and package the
nfs-provisioner chart. This change allows the nfs-provisioner to
be deployed without the local image registry if desired.

This also updates the ldap deployment script to only run make on
the ldap chart instead of pulling the default images with the
make-pull directive

Change-Id: I3d8f321d7a8af50fd80ffbd6a337fa17675f5700
2018-05-15 20:55:31 +00:00
Zuul
fbf2464042 Merge "Add ldap support to grafana, update version, add helm tests" 2018-05-15 07:41:37 +00:00
Zuul
956fa604d3 Merge "Add ldap support in elasticsearch/kibana apache proxies" 2018-05-15 03:53:15 +00:00
Zuul
36c2c9754a Merge "LDAP: Move ldap chart to openstack-helm-infra" 2018-05-15 03:53:14 +00:00
Steve Wilkerson
e081c19fe8 Add ldap support to grafana, update version, add helm tests
This adds ldap support to the grafana chart. This required updating
the version of Grafana to 5.0, as this version allows for using
configuration files to bootstrap the datasources and dashboards
instead of using the grafana http api. This was a necessary change
as using ldap for grafana presented issues trying to create the
datasource via the http api

This also adds a basic helm test for grafana. This test simply
verifies whether the prometheus datasource configured exists and
whether the number of dashboards reported by the admin api matches
the number of dashboards expected

Change-Id: I2e987cb425adba9f909722ffdb25b83f82710c4d
2018-05-15 01:42:04 +00:00
Steve Wilkerson
3c692abd6e Add ldap support in elasticsearch/kibana apache proxies
This adds required configuration for enabling LDAP through
the apache proxy in the elasticsearch and kibana charts by
default

Change-Id: Iaff8f328ff50944ddad94ec86b1134ca73750176
2018-05-14 13:53:30 +00:00
Steve Wilkerson
85208fe98a LDAP: Move ldap chart to openstack-helm-infra
This moves the ldap chart to openstack-helm-infra from
openstack-helm, allowing for ldap to provide an authentication
mechanism for components of the LMA stack, and can still be used for
keystone in openstack-helm, as openstack-helm-infra is a required
project

Change-Id: I211bc47c7a3ae875614102c8f64daa1099f702e8
2018-05-14 08:53:00 -05:00
Pete Birley
be3f300623 Gate: place role default vars within the role
This PS places the role default vars within the appropriate role,
in addition it exposes kubeadm's selfhosted param and deploys the
kubeadm binary to master nodes.

This PS exposes the selfhosted param, and deploys kubeadm to master
nodes.

Change-Id: I5ad1b593a711ffe353b012394d54044dede0691d
2018-05-14 03:28:31 +00:00
Pete Birley
80db87033b Gate: stop pulling default images
This PS stops pulling the charts default images, as the make file
target cannot target over-rides - resulting in longer gate runs with
twice as many images pulled than required in some cases.

Change-Id: I04c1d43d6ac9d2f509604709139583b085b406e3
See: https://review.openstack.org/#/c/566738/
2018-05-13 09:40:05 -05:00
Pete Birley
dd92edfb58 Gate: use infra mirror when in infra for kubeadm aio image
This PS uses the infra mirrors in the kubeadm aio build when
running the gate in openstack-infra.

Change-Id: Id9a4bf2b13051dfcf5aea688511da24cd245de9c
2018-05-11 16:43:22 -05:00
Steve Wilkerson
b492ee54c3 OSH-infra multinode gate rework
This moves to using bash scripts for deploying the charts for the
multinode gates in osh-infra as opposed to using the ansible
chart builder

Change-Id: I2951ccf57250a5e6e272872f2d6f7a81bd11f184
2018-05-10 00:06:04 +00:00
Steve Wilkerson
db643c1cdd Single node dev deploy gate for osh-infra
This adds a gate for a single node development deployment for
all charts in openstack-helm-infra

Change-Id: I42e8daf41a7eec428ec3d269adbb5c416d092818
2018-05-09 21:56:06 +00:00
portdirect
0d969910af Kube: Kubernetes v1.10.2 support
This Ps adds support for kubernetes v1.10.2

Change-Id: Ic1db020cc86fa9db78f3f3cfcda92e3291a889a8
2018-05-09 14:22:45 -05:00
Pete Birley
b9edac6148 Kubernetes: enable mount propagation
This PS enables the mount propogation feature gate.

Change-Id: I7a37f45ff6061b144c6f04233712cd84fccb3e83
2018-04-22 15:35:40 -05:00
Pete Birley
39ab1c3b5d Gate: Improve centos support
This PS updates the CentOS Gate.

Change-Id: Ic29b9e5949fb3fb3433802f7933208f3cabfef72
2018-04-20 11:28:36 -05:00
Pete Birley
5750d2a01f Gate: update Ansible conventions
Using tests as filters is deprecated, and will be removed in 2.9.

Change-Id: I2bc31177cdb3d59319c4cb04f77db573f3217479
2018-04-18 23:32:35 -05:00
Zuul
6dd5f87a3d Merge "Helm: update helm version to v2.8.2" 2018-04-19 00:22:26 +00:00
Pete Birley
a7da953e39 Helm: update helm version to v2.8.2
This PS updates the helm version in the gate to helm 2.8.2

Change-Id: Ied757f6d653255f198de524f41111cd2928a03dc
2018-04-18 21:55:00 +00:00
Pete Birley
37d836c8c7 Gate/Dev: RPM and structure improvements
This PS restores the use of the distro provided docker for RPM based
distros. It also removes the roles subdirectory from the playbooks
and replaces it with a symlink for local dev use.

Change-Id: Ic11adb85813e92488f5ebbe6714ad7da8d3938e2
2018-04-18 13:56:47 -05:00
Pete Birley
6921006103 Gate: update paths for pip 10 installation
Pip>=10 moves the entrypoint to /usr/local/bin from /usr/bin, this
ps forces the shell to forget all locations following upgrade
to allow it to adapt to the new location.

Change-Id: I1ed92b75f689e982397cd4fc87ac262256e161e8
2018-04-15 16:54:56 +00:00
Steve Wilkerson
9dd81954fd Move roles and playbooks to top level
This proposes moving the playbooks and roles to the top level of
osh-infra to be consumed by osh

Change-Id: I7e3516da8e516060f94b8b9c8875918504de7446
2018-04-09 20:52:18 -05:00
portdirect
59d4141d6a Update to F27 and update docker packages
This PS moves the fedora gates to use F27. It also updates
the docker packages used for both fedora and centos

Change-Id: Ic5ab5793d7176a81a8ea70c82b1d53a1fdf5f740
2018-04-06 17:21:41 +00:00
Steve Wilkerson
99befc2484 Nagios Chart
This adds the nagios chart to osh-infra to provide additional
monitoring functionality. It uses helper functions to consume
yaml definitions for services, commands, hosts and hostgroups
to generate the required configurations for those entities in
nagios's configuration

Change-Id: I6238bb8cb1e5c8dc48594ddea50693f3e7b0a176
2018-03-23 13:45:40 +00:00
Zuul
f461e53e52 Merge "Provide ability to specify proxy" 2018-03-14 14:10:57 +00:00
Paul Carver
e01268bb50 Correcting a spelling error
perfoming -> performing

Change-Id: I639d8a4d0021dbdcd66ff711f86c25f1313a823f
2018-03-12 20:26:30 -04:00
Tin Lam
391bbf69d7 Provide ability to specify proxy
This patch set provides ability to configure the proxy setting in
the ansible playbook used to run the gate.

Change-Id: I7ae66cb16fa6db7d46a0a3f23c289cc625e583c4
Signed-off-by: Tin Lam <tin@irrational.io>
2018-03-12 04:15:30 +00:00
Pete Birley
21a6217c58 Gate: get full process list from host
This PS adds the ps command to the gate log collection task.

Change-Id: Ife1710854547b28a6dfa6b3e4d527ebf4d04179b
2018-03-09 12:45:44 +00:00
Zuul
3a552b4200 Merge "KubeADM: force calico interface to match to same as kubelet" 2018-03-09 00:32:34 +00:00
Pete Birley
c9ffaea770 KubeADM: force calico interface to match to same as kubelet
This PS forces calico to use the same interface as the kubelet
for inter-node communication.

Change-Id: I7d03beec46cccba4a57e092bf108695e8e88996f
2018-03-08 22:20:56 +00:00
Hemanth Nakkina
5392ac810b Remove Api version requirement for CronJob Curator
Curator job in Elasticsearch helm chart has a condition on
api version batch/v2alpha1. Cronjob resource is deprecated
in batch/v2alpha1 from k8s 1.8 and batch/v1beta1 is enabled
by default.

Remove the condition on API version as it is no more required.

Closes-Bug: #1753524
Change-Id: Ia296b3742e655fae508e5d4402e7f3881db31688
2018-03-06 08:51:08 +05:30
Pete Birley
ca3929025b Gate: collect more host level logs
This PS collects more host level logs in the gate scripts.

Change-Id: I0ec13f45fd4561fec59d08b08eb78390a3866156
2018-02-26 07:20:25 +00:00
Pete Birley
1bf13af26c Node-Labels: Add linuxbridge node label to nodes
This PS adds the linxubridge node label to nodes to simplify
deployment and testing of the neutron linuxbridge backend.

Change-Id: I3095c21a75ad3057539f4fed431cb18c68e49a9b
2018-02-26 03:57:49 +00:00
Pete Birley
e0c688d7ee dependencies: move static dependencies under a 'static' key
This PS moves static dependencies unser a 'static' key to allow
expansion to cover dynamic dependencies.

Change-Id: Ia0e853564955e0fbbe5a9e91a8b8924c703b1b02
2018-02-24 17:39:55 -05:00
Steve Wilkerson
4f1f180e8e Add prometheus annotations to tiller-deploy service
This adds the prometheus annotations to the tiller chart, allowing
for the scraping of metrics from tiller.  currently, tiller exports
metrics specific to the grpc calls being made against it

Change-Id: Ibe10098689cc37a9de6306af86f4d63d8aab318b
2018-02-20 10:05:05 -06:00
portdirect
3713266f4c K8s: udpate KubeADM-AIO to use K8s v1.9.3
This PS updates the version of K8s used in the gate to v1.9.3

Change-Id: I284083e0cdf828701c439c44edfd3a975dcd69c3
2018-02-17 15:21:06 -05:00
Steve Wilkerson
5d95b0e2cb Add fluentd prometheus exporter for logging metrics
This adds templates for a prometheus exporter for fluentd to
adequately capture log metrics and fluentd service metrics for
consumption by prometheus

Change-Id: I6d6a8c2be07af819dc6d99b8ce5f1d4b635a69f0
2018-02-13 19:09:35 +00:00