678 Commits

Author SHA1 Message Date
Steve Wilkerson
7ea9623662 Fluent-logging: Update default fluentbit configuration
As of 0.12.14, fluentbit exposes a flag for setting the db_sync
behavior for writing the location of the tail input to its sqlite
database. The default setting is Full, which introduces additional
synchronizations before and after a transaction. This has the
potential to negatively affect disk performance with the extra
synchronizations. This moves the setting in the chart to Normal,
which performs fewer synchronizations and still maintains a high
level of safety with status writes

Change-Id: I3b437edd6bd7501ef37ce06f0a561bd1747eb290
2018-07-13 09:36:11 -05:00
Steve Wilkerson
5271d246fe Fluent-logging: Update tests and template job
This updates the helm tests and the elasticsearch template job.
This changes the tests to conditionally check whether the
template job is enabled and the templates key is not empty, and
uses the result to determine whether to test for the existence
of those templates (to account for situations where the job is
disabled).

This updates the job to also check whether there are templates
defined in additional to checking whether the job itself is
enabled.

Change-Id: I14cedeb8d8a4444a73ea974426c3b0f136d1b698
2018-07-13 09:31:46 -05:00
Zuul
eba82effdb Merge "Nagios: Update image reference to include discovery fix" 2018-07-11 22:34:48 +00:00
Zuul
dd027838bd Merge "Helm-Toolkit: Add basic documentation for the metadata labels function" 2018-07-11 14:52:00 +00:00
Steve Wilkerson
7ea9a075ba Nagios: Update image reference to include discovery fix
This updates the Nagios image tag to include a version that fixes
the service discovery bug that resulted in duplicate host group
entries. The duplicate host group entries would prevent Nagios
from restarting, resulting in the service never coming back up
when duplicate host groups were identified and added

Change-Id: I555c525e47deffd95eeb5a7276c00cf044e61e3a
2018-07-10 14:40:55 -05:00
Zuul
a168e02f01 Merge "Add missing labels to helm test pods" 2018-07-10 16:57:00 +00:00
Steve Wilkerson
dc16a897d7 Add missing labels to helm test pods
This adds missing labels to the helm test pods in osh-infra

Change-Id: I618d9089bfde2d847411f5f876f0ff6afd9cce7f
2018-07-10 08:55:40 -05:00
Zuul
6200401f24 Merge "Image: Add basic documentation for the image function" 2018-07-10 02:47:17 +00:00
Zuul
6d52b7ded7 Merge "Helm-Toolkit: Add basic documentation for the tls secret macro" 2018-07-10 02:41:57 +00:00
Zuul
9e378800c8 Merge "Helm-Toolkit: Add basic documentation for ingress macro" 2018-07-10 02:35:25 +00:00
Matt McEuen
99f405aa03 Remove obsolete calico version notes
This removes some obsolete calico version information that
was leftover from the original manifest after which this chart
was modeled.

Change-Id: Ic592923484c498216025bb5a7b0bda1f2be9e871
2018-07-10 01:58:57 +00:00
Pete Birley
07d90db1d7 Helm-Toolkit: Move template render to correct location
This PS moves the template renderer function to its correct
location in helm-toolkit.

Thanks to Sai Battina for noticing this.

Change-Id: I614ee33bc8c39007955a0e32cd34e881bd1cb3fe
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-09 17:09:47 -05:00
Pete Birley
87b3b5b907 Helm-Toolkit: Add basic documentation for the metadata labels function
This PS adds basic documentation for the metadata labels function.

Change-Id: I8ef3093aafabb64c61396a721b6c6b66dc5de9e8
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-09 20:57:32 +00:00
Pete Birley
fd242d2656 Image: Add basic documentation for the image function
This PS adds basic documentation for the image function.

Change-Id: I3ee6f44efc7252facb329bc6dae5be571de338bd
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-09 14:18:50 -05:00
Pete Birley
69d310d000 Helm-Toolkit: Add basic documentation for the tls secret macro
This PS adds basic documentation for the tls secret macro.

Change-Id: I36a6b171cb5bce2d4bf6dc22c22f0a630d677497
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-09 14:01:09 -05:00
Pete Birley
a957ff6c05 Helm-Toolkit: Add basic documentation for ingress macro
This PS adds basic documentation for the ingress macro.

Change-Id: Iabfa76eae6bb79f914a3fce0047a82ab1e915c76
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-09 13:52:47 -05:00
Zhangfei Gao
2481767744 Separate kubelet support packages
Debian has no libxtables11 package
Libxtables11 only for ubuntu while libxtables12 for debian

Change-Id: I258bea9869d2126295d080ef9d00800b83161cc3
2018-07-09 02:22:06 +00:00
Ruslan Khanbikov
5ae782ff52 Helm-Toolkit: adds import additional rabbitmq configuration
It adds an ability to specify the auxiliary configuraiton for rabbitmq
like policies, permissions loading json formatted data

Change-Id: I85240a50fb64a4d74454768034fe3bdcf25f3019
Signed-off-by: Ruslan Khanbikov <rk760n@att.com>
2018-07-05 10:29:31 -07:00
Zuul
5d622a806e Merge "Enable systemd service helm-serve" 2018-07-03 06:45:40 +00:00
Zuul
e038b2503c Merge "Add curl to install script for ubuntu" 2018-07-02 20:50:59 +00:00
Nicholas Jones
4932e6ce50 Add curl to install script for ubuntu
Missing curl dependency can cause unclear errors

Change-Id: I8f86a51c9947b460a5003a7a4713dedeaca19837
2018-07-02 12:36:18 -05:00
Zuul
524823c249 Merge "Rename deploy jq role name" 2018-07-02 16:44:15 +00:00
Pete Birley
6ef940b776 Helm-Toolkit: add doc comments to many util functions
This PS adds documentation comments to may of the utility functions
in helm-toolkit.

Change-Id: Id0481284058678ea2834edf462fa7666e429bd79
Signed-off-by: Pete Birley <pete@port.direct>
2018-07-02 10:44:29 +00:00
chenlx
c46f2c9c98 Rename deploy jq role name
Change role name from deploy-yq to deploy-jq for better understand

Change-Id: If853bad049f97367b60e2c7c061af558457a88a5
2018-07-02 04:11:14 +00:00
Zuul
3cee5970a0 Merge "Helm-Toolkit: Simplify and refactor endpoint functions" 2018-07-01 19:01:11 +00:00
Pete Birley
9a25d20712 Helm-Toolkit: Simplify and refactor endpoint functions
This PS refactors the endpoint functions to reduce code repetition
and improve readability.

Change-Id: I4a280d0645206ca74794fc4e69ec374bde4c4633
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-30 10:45:17 +01:00
Steve Wilkerson
80c1ff4071 Gate: Fix version of ansible deployed via dev-deploy
This pins the version of ansible deployed via the makefile
dev-deploy directives to the version used in zuul.  This was
causing issues with docker, as make dev-deploy setup-host was
deploying ansible 2.6. Ansible 2.6 introduces a new flag to the
docker_container module (init) that is incompatible with our
current roles, which resulted in observed failures in osh-infra
and osh

Change-Id: Ibc885b53bce77eb36817024b21efb0e99865f690
2018-06-29 15:39:58 +00:00
Zuul
92f024ba56 Merge "Remove dupliate osh-infra-docker.yaml file" 2018-06-29 01:30:38 +00:00
Pete Birley
17cfa8740e (fix) Helm-Toolkit: Public ingress reverse compatibility
This PS updates Helm-Toolkit to accept both a simple string (previous
operation) and a dict containing host and potentially tls params for
public endpoints.

Change-Id: Ia95e9f008098ef3eb110d651fd06141774ceb8b7
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-28 16:02:19 -05:00
Mark Burnett
59d74756ef Fix: rename tls.ca to ca.crt in secret snippet
Change-Id: Ia2029bb1d2aef6f708fe5ff32daf8ccaf18d8e34
2018-06-28 10:48:54 -05:00
chenlx
49da0d0bb3 Remove dupliate osh-infra-docker.yaml file
We only need keep one of osh-infra-deploy-docker.yaml and
osh-infra-docker.yaml, because the content is almost the same.

Change-Id: I27854c0b9492853f7c4edf130b6533c33292dc89
2018-06-28 14:18:07 +08:00
Zuul
9071a03417 Merge "Update TLS secret templates, remove nagios readiness probe" 2018-06-28 02:42:40 +00:00
Steve Wilkerson
c26a1b53f6 Update TLS secret templates, remove nagios readiness probe
This updates the TLS secret templates to include the backend
service in the dict supplied to the manifest template, as it is
required for the TLS secret to render correctly.

This also removes the readiness probe from the nagios container in
the deployment for the nagios chart, as it wasn't functioning as
intended due to the port not being available for the probe

Change-Id: Iabcfd40c74938e0497d08ffeeebc98ab722fa660
2018-06-27 18:56:45 -05:00
Pete Birley
98f5276e16 Helm-Toolkit: update comments for endpoint lookup functions
This PS updates the comments for endpoint lookup functions

Change-Id: Ifdc96acaac6972c10f6a580eaf37629910a955a5
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-27 10:36:25 +00:00
tp6510
50b480935a This PS updates the comments for bootstrap job
Story: 2002690
Task: 22516

Change-Id: I4487636546ae49502cad357f540cec43d834659b
2018-06-27 03:18:51 -05:00
Zuul
0624466a9f Merge "Move k8s keystone webhook check to voting after manifest changes" 2018-06-27 03:47:57 +00:00
Zuul
714bc3e6da Merge "Ingress: Add initial TLS Support for osh-infra public endpoints" 2018-06-26 23:07:28 +00:00
Steve Wilkerson
b823954787 Ingress: Add initial TLS Support for osh-infra public endpoints
Adds support for TLS on overriden fqdns for public endpoints for
the services that have them in openstack-helm-infra. Currently this
implementation is limited, in that it does not provide support for
dynamically loading CAs into the containers, or specifying them manually
via configuration. As a result only well known or CA's added manually
to containers will be recognised.

Change-Id: I4ab4bbe24b6544b64cd365467e8efb2a421ac3f4
2018-06-26 14:47:19 -05:00
Steve Wilkerson
68fa1d6fbe Grafana: Provision data sources via dynamic template in values
This moves to define the datasources provisioned by grafana via
a template defined in the values.yaml. This allows us to define
multiple datasource types that can be mapped directly to the
corresponding entries in endpoints, which enables us to generate
the data source urls via endpoint lookups rather than hardcoding
this. This is the first step to support multiple data sources in
a singular grafana deployment

Change-Id: Iac7f4b1e07aaf83ae4d2a0c923cd06817f0d8c0d
2018-06-26 13:57:46 -05:00
Zuul
82aab87442 Merge "Add missing readiness probes to openstack-helm-infra charts" 2018-06-26 16:52:29 +00:00
Zuul
6adfc932d8 Merge "Grafana: Update LDAP configuration, update volume mounts" 2018-06-26 16:30:01 +00:00
Zuul
8cfe215514 Merge "Helm-toolkit: Updates manifests to support openstack logging.conf" 2018-06-26 14:16:27 +00:00
Steve Wilkerson
497959371d Grafana: Update LDAP configuration, update volume mounts
This updates the LDAP configuration for grafana, using a template
defined in the values.yaml file. Using the template allows us to
dynamically define LDAP configuration values, such as the bind dn,
search base and group search base paths, the password, and the
LDAP fqdn.  This also updates the volume mount for the
provisioning directory to be defined by the configuration value in
the values.yaml file

Change-Id: I1e4866d1189cf40b08b3443dc725646a1b76094c
2018-06-26 07:36:15 -05:00
Steve Wilkerson
cb7bf2c0b3 Add missing readiness probes to openstack-helm-infra charts
This adds missing readiness probes to the following charts in
openstack-helm-infra: elasticsearch, fluent-logging, kibana,
nagios, prometheus-kube-state-metrics, prometheus-node-exporter,
and prometheus-openstack-exporter

Change-Id: I6a2635b08667c31eadb1b05ba848c658935a17e5
2018-06-26 12:25:36 +00:00
Pete Birley
326303702d Ingress: make tls functions gotpl yaml safe
This PS updates the tls functions to be yaml safe for the service
name.

Change-Id: I535f38a8d92c01280d79926a1f0acd06984aabbf
Signed-off-by: Pete Birley <pete@port.direct>
2018-06-26 02:03:19 -05:00
Zuul
469fe37c3e Merge "Update toolkit to support ingress TLS" 2018-06-26 05:58:59 +00:00
Zuul
e46b1b0c2b Merge "Add proxy environment" 2018-06-26 02:40:13 +00:00
Zuul
048f53cf1c Merge "Update ordering of auth providers in apache reverse proxy" 2018-06-25 20:09:49 +00:00
Steve Wilkerson
2dd5bf0594 Update ordering of auth providers in apache reverse proxy
This updates the ordering of the basic auth providers in the
elasticsearch and nagios chart to check the file provider first
before going out to check the configured ldap server.

Change-Id: I47ff8a1c7b2cefa8425914c5d4d7a76aa8d43216
Signed-off-by: Steve Wilkerson <wilkers.steve@gmail.com>
2018-06-25 12:43:06 -05:00
Steve Wilkerson
8fc69dd369 Move k8s keystone webhook check to voting after manifest changes
This changes the keystone webhook check back to voting once the
helm-toolkit manifest changes are merged in, and depends on the
openstack-helm patchset that introduces the changes the manifest
change required for this check to pass

Depends-On: https://review.openstack.org/576001

Change-Id: I337fe6d57a978e5b92d5bb5ae844e16bb8082609
Signed-off-by: Steve Wilkerson <wilkers.steve@gmail.com>
2018-06-25 08:26:19 -05:00