605 Commits

Author SHA1 Message Date
Steve Wilkerson
8037bf4ca9 Add Ceph to osh-infra gates
This adds a ceph developer gate to openstack-helm-infra, which
depends on ceph moving to openstack-helm-infra. This also replaces
the NFS backed storage for the multinode gate with ceph instead

Change-Id: I11268463aa037a2e037217a2dbc89c7432c0d277
2018-08-28 15:39:03 -05:00
Steve Wilkerson
25bc83b580 Ceph: Move Ceph charts to openstack-helm-infra
This continues the work of moving infrastructure related services
out of openstack-helm, by moving the ceph charts to openstack
helm infra instead.

Change-Id: I306ccd9d494f72a7946a7850f96d5c22f36eb8a0
2018-08-28 15:03:35 -05:00
Zuul
b6fc24b996 Merge "Revert "Update OSH Author copyrights to OSF"" 2018-08-28 19:33:45 +00:00
Jean-Philippe Evrard
bf069b2311 Revert "Update OSH Author copyrights to OSF"
This reverts commit 178aa271a44956e86f4e962bf815fa827d93c9af.

Change-Id: I38a52d866527dfff2689b618e055f439bc248c13
2018-08-28 17:25:54 +00:00
Zuul
1a33c34cbd Merge "Update OSH Author copyrights to OSF" 2018-08-28 15:23:49 +00:00
Zuul
880fb954de Merge "K8S: Update to current 1.10.x release" 2018-08-27 17:37:25 +00:00
Matt McEuen
178aa271a4 Update OSH Author copyrights to OSF
This PS updates the "Openstack-Helm Authors" copyright attribution
to be the "OpenStack Foundation", as decided in the 2018-03-20
team meeting:
http://eavesdrop.openstack.org/meetings/openstack_helm/2018/openstack_helm.2018-03-20-15.00.log.html

No other copyright attributions were changed.

Change-Id: I1137dee2ae5728771835f4b33fcaff60fcc22ca9
2018-08-26 17:17:06 -05:00
Zuul
ce163043ec Merge "Helm: dont update the default stable repo on install" 2018-08-24 17:21:54 +00:00
Zuul
fa7a25ab23 Merge "Gate: Restore voting to keystone webhook gate" 2018-08-23 23:48:53 +00:00
Pete Birley
2f7d12f61d Helm: dont update the default stable repo on install
Helm now tries to update the stable repo when running helm init
by default. This ps adds the flag to prevent this, which is required
when running in airgapped, and some corporate, environments.

This PS adds a previously misssed instance.

Change-Id: I9095863d46e320b6ea486d3837e6aa3c4298046e
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-23 15:04:24 -05:00
Zuul
fbf957e5b1 Merge "Helm-Toolkit: Move sensitive config data to secrets." 2018-08-23 17:55:15 +00:00
Pete Birley
c5feca82a3 K8S: Update to current 1.10.x release
This PS bumps the k8s version to that of the current release.

Change-Id: Ife6edac83f6e7639d6142d64aff458450a2e58ff
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-23 12:28:22 -05:00
Pete Birley
de0dada580 Gate: Restore voting to keystone webhook gate
This PS restores voting to the keystone gate.

Depends-On: https://review.openstack.org/#/c/590018

Change-Id: I62eab2629ca1ff1ae906368dd0556dc0f5235a32
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-23 10:55:32 -05:00
Pete Birley
6186fb6675 Helm-Toolkit: Move sensitive config data to secrets.
This PS updates helm toolkit, and effected charts in
openstack-helm-infra to use Secrets rather than configmaps for
application configuration, as they in many cases contain sensitive data.

Change-Id: Idd17812437465368e92c9fec0d5b634bbf6dc23a
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-23 10:55:07 -05:00
Pete Birley
e74dce4307 Helm: dont update the default stable repo on install
Helm now tries to update the stable repo when running helm init
by default. This ps adds the flag to prevent this, which is required
when running in airgapped, and some corporate, environments.

Change-Id: I38c487f88d17e9429c30cb03bf2d0f3652f1db99
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-22 22:03:47 -05:00
Zuul
a514f76530 Merge "Exclude releasenotes folder from list of charts in Makefile" 2018-08-22 17:00:43 +00:00
Zuul
1e644650a0 Merge "Grafana: Update default refresh intervals, enable gate ingress" 2018-08-22 16:48:11 +00:00
Zuul
239274dffc Merge "Prometheus: Remove block duration flags, update cadvisor job" 2018-08-22 16:47:30 +00:00
Zuul
2bbf188cbd Merge "Fluentd: Change default image" 2018-08-22 16:47:30 +00:00
Zuul
dbd3841c6e Merge "Fluentd: Filter out fluentd's logs" 2018-08-22 16:47:29 +00:00
Zuul
b1fdcfa497 Merge "Running agents on all nodes." 2018-08-22 15:51:13 +00:00
Zuul
ba93bc11c4 Merge "Helm: Move to use 2.10 release" 2018-08-22 04:19:33 +00:00
Pete Birley
c62c5dcf88 Helm: Move to use 2.10 release
This PS moves to use the Helm 2.10 release, which brings in a version
of sprig that supports TLS certificate creation from defined CAs.

Change-Id: I80233f8f31727c80bcd667cfa0d851488da39588
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-21 15:52:20 +00:00
Steve Wilkerson
d5dc97a431 Prometheus: Remove block duration flags, update cadvisor job
This removes the min_block_duration and max_block_duration flags
from the Prometheus chart, as the suggested best practice is to
use the defaults (2h min, 10% of retention time as max).

This also updates the scrape target configuration for cadvisor to
match the upstream example endpoint for kubernetes versions 1.7.3
and later

Change-Id: I200969d6c4da9d17d0a7d3a34a114ccc5f5ee70f
2018-08-20 13:26:40 -05:00
Felipe Monteiro
62e2901d2d Exclude releasenotes folder from list of charts in Makefile
This PS adds releasenotes to EXCLUDES in the Makefile so that
it is not treated as a chart. This change is a part of [0],
required to make that patchset run in the gates.

[0] Ib9253611df08257f2b418a0d9e5e817a232c011b

Change-Id: I335a08a0add647b17d9438b0c561f556b6130e66
Needed-By: Ib9253611df08257f2b418a0d9e5e817a232c011b
2018-08-20 17:24:49 +00:00
Steve Wilkerson
9ee7561521 Grafana: Update default refresh intervals, enable gate ingress
This updates the grafana dashboards to use a default refresh
value of 5m to prevent dashboards with intensive queries (like the
container dashboard) from submitting frequent, expensive requests
to Prometheus

This also removes the override to disable the ingress service for
grafana in the developer deployment script, as it was overlooked
when enabling ingresses after the ingress chart was introduced

Change-Id: I0958a3978cec25a1350172cbe75996f1346858c5
2018-08-20 10:59:53 -05:00
Steve Wilkerson
dd986ed764 Fluentd: Change default image
This updates Fluentd to use the stable v1.2 debian fluentd
image instead of the kolla image. This images comes bundled
with the elasticsearch plugin, and provides more
flexibility in configuring the buffer behavior of the output
plugins

Change-Id: Id446ef1e050f5d9c005c94dae661cf9ae88fffea
2018-08-16 12:10:49 -05:00
Steve Wilkerson
faef231b0b Prometheus: Update version to 2.3.2
This updates the Prometheus version to 2.3.2, which includes a fix
for memory leak issues with the kubernetes client and also adds a
dashboard for evaluating prometheus rule evaluation performance

Change-Id: I7b9e7bee114fa149db3733c0dacfefae36be7fa8
2018-08-16 16:48:27 +00:00
Steve Wilkerson
a7af54e0c8 Fluentd: Filter out fluentd's logs
This filters out fluentd's logs for collection, as this can result
in infinite loops as fluentd will try to process the events in its
own logs repeatedly

Change-Id: I85cce909b6917901b964cb5cc479403143c4d211
2018-08-16 10:14:18 -05:00
Gupta, Sangeet (sg774j)
61584fdb9d kubernetes-keystone-webhook base64 encoding
Changing the chart to accept plain certificates rather than a base64
encoded string. The chart will handle the base64 encoding internally.

Change-Id: I3cd0710652b1b731fa4bcd9e92dd59ce2c436eb6
2018-08-10 15:54:49 -05:00
Seungkyu Ahn
6b6f277e7d Running agents on all nodes.
Using a node selector can not run the fluent-bit or node-exporter
on the master node. So, This PS changes the scheduling to use
either taint/toleration or the node selector.

Change-Id: I0ca80a6e645b7047469288697387f0f5bf111345
2018-08-10 08:40:52 +00:00
Steve Wilkerson
8652e14acb Add auth for prometheus
This adds authentication to Prometheus with an apache reverse
proxy, similar to elasticsearch, kibana and nagios. This adds an
admin user and password via htpasswd along with adding ldap
support.

This required modifying the grafana chart to configure the
prometheus datasource's basic auth credentials in the data sources
provisioning configuration file by checking whether basic auth is
enabled and injecting the username/password defined in the
corresponding endpoint definition.

This also modifies the nagios chart to use the authenticated
endpoint for prometheus, which is required for nagios to
successfully query the prometheus endpoint for its service
checking mechanism

Change-Id: Ia4ccc3c44a89b2c56594be1f4cc28ac07169bf8c
2018-08-08 18:49:45 +00:00
Zuul
c0c5199fb2 Merge "prometheus process-exporter for monitoring host tools" 2018-08-07 22:04:08 +00:00
Pete Birley
89be3269d6 Keystone: Update endpoints to point to current defaults
This PS updates the keysteone endpoints section used in the
webhook authenticator and the prometheus exporter.

Depends-On: https://review.openstack.org/#/c/588651
Change-Id: Ia2df0ec1b783705f7e2ac164a8729d61962e2bc8
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-04 08:08:51 -05:00
rakesh-patnaik
1f4b76c06f prometheus process-exporter for monitoring host tools
Change-Id: I941688bcb0f919afaf4b6e62d2a10544146257f7
2018-08-04 04:53:34 +00:00
Paul Belanger
f4e80dfb5f Switch to fedora-latest for testing
This bumps testing of fedora to 28, and allows openstack-infra to
delete fedora-27 nodes.

Change-Id: Idd38b1e4721b7f53e20ccbc665cb16762ba6132b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-03 02:58:58 +00:00
Zuul
a65dd0269c Merge "Revert "Openstack Exporter: Use service domain for service user"" 2018-08-03 01:08:05 +00:00
Zuul
15368dbfcd Merge "Grafana: Update Ceph Dashboards" 2018-08-02 23:22:13 +00:00
Steve Wilkerson
c524931707 Grafana: Update Ceph Dashboards
This fixes two issues with the Ceph dashboards in Grafana: the
first fix addresses an incorrect heading for Utilized Capacity in
the ceph cluster dashboard (was reporting utilized as available),
and the second fix addresses the Pool Usage gauge to accurately
reflect the percentage of the pool used (was incorrectly
multiplying the percentage result by 100 a second time, resulting
in large and inaccurate results)

Change-Id: I024a555cdb82ee181eb414337b84e7ad62717c97
2018-08-02 11:10:33 -05:00
Pete Birley
aac1c4e8c0 Helm-Toolkit: Update tls secret manifest for non public endpoints
This PS updates the tls secret manifest to allow non-public endpoints
to be specified.

Change-Id: I47606e5c8db87fac07febb114334ded710f56ed5
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-02 11:04:42 -05:00
Zuul
61829c0d45 Merge "Rabbitmq: Disable bert capabilities in exporter" 2018-08-02 00:08:56 +00:00
Zuul
ed0af8642d Merge "Gate: specify user for tiller image used for bootstrapping cluster" 2018-08-01 22:59:56 +00:00
Steve Wilkerson
580ba12e9d Rabbitmq: Disable bert capabilities in exporter
This disables the bert capabilities in the rabbitmq exporter, as
the go routines for bert in the exporter are raising panics.
This capability should remain disabled until these issues are
resolved in the exporter.

References:
http://logs.openstack.org/25/587825/2/check/openstack-helm-armada-fullstack-deploy/0d5ecb6/primary/pod-logs/openstack/osh-heat-rabbitmq-rabbitmq-exporter-55b4548bb6-tgwjr/rabbitmq-exporter.txt
http://logs.openstack.org/25/587825/2/check/openstack-helm-armada-fullstack-deploy/0d5ecb6/primary/pod-logs/openstack/osh-cinder-rabbitmq-rabbitmq-exporter-664945b7c5-rsrmd/rabbitmq-exporter.txt

Change-Id: I15d03a8893331d043df589f5498aaa965559bacb
2018-08-01 13:45:19 -05:00
Zuul
a464cc85ae Merge "Quoting node_select_value in Ingress Controller" 2018-08-01 16:50:08 +00:00
Pete Birley
ac27096002 Gate: specify user for tiller image used for bootstrapping cluster
This PS updates the ansible roles to update the user used with
the tiller image used for bootstrapping to allow access to approprate
config files used. This is required for use with the current master
tiller image, which no longer deffaults to the root user.

Change-Id: I61f28a2ebeecb22eb66e0394417b0af3a9116483
Signed-off-by: Pete Birley <pete@port.direct>
2018-08-01 11:01:07 -05:00
Seungkyu Ahn
a430533e6a Quoting node_select_value in Ingress Controller
In most cases, the ingress controller's nodeSelector key and value
are "node-role.kubernetes.io/ingress" and "true".
Using quote to treat the nodeSelector value as a string.

Change-Id: Ie1745629b90795e4d888d85f35565e6d6350e09b
2018-08-01 02:39:05 +00:00
Steve Wilkerson
838b6599de Revert "Openstack Exporter: Use service domain for service user"
This reverts commit cc9944f74a18073dcaa5c82dcc18b3d40ffdb7a2.

Change-Id: Ie21beb43d3ac3d5eb6ae6a06d2b665e017ae470a
2018-07-31 21:29:45 +00:00
Zuul
cb3ad183ca Merge "K8s: update to 1.10.6 in OSH gates" 2018-07-31 18:20:33 +00:00
Zuul
91b83aeabb Merge "Fix to configure RABBIT_CAPABILITIES" 2018-07-31 00:10:48 +00:00
Zuul
d75b90f32d Merge "RabbitMQ: move RabbitMQ chart to OSH-Infra" 2018-07-31 00:10:47 +00:00