696 Commits

Author SHA1 Message Date
Steve Wilkerson
ba736d9840 Fluent-logging: Update fluentd configuration
This updates the configuration for fluentd, providing a mechanism
for basic determination of the log level of a logged event via
entries from /var/log/containers. This log level is prepended to
the tag for that event, and also added as a new `level` key in
the resulting event. These two improvements allow for querying
specific log level events via the tag.

This also adds similar functionality to any events captured via
the oslo log fluentd handler/formatter. This allows for
elasticsearch queries akin to `error.openstack.keystone`, which
can be used by nagios or another alerting mechanism to raise
alerts when a particular level event has been captured.

Change-Id: I016ddcfcf7408de7b6511ddf7009e1e6a5f3a1d9
2018-09-19 14:22:27 -05:00
Zuul
e649ad529f Merge "Fluent-logging: Update kubernetes plugin test" 2018-09-19 19:20:33 +00:00
Zuul
333fdc931b Merge "Gate: Trim dev-deploy gates" 2018-09-19 15:52:48 +00:00
Zuul
5500c75e13 Merge "Fluentbit: Update version, config util template" 2018-09-19 15:33:47 +00:00
Steve Wilkerson
3f952be4c1 Fluent-logging: Update kubernetes plugin test
This updates the kubernetes plugin test for fluent-logging to
search across all indices instead of the default logstash-* index
to account for custom indexes created for the events tagged with
the kubernetes plugin.

This also makes the search pattern for the tag more flexible to
account for any arbitrary number of prefixes and/or suffixes
added to the 'kube' tag as a result of any processing done in
fluentd.

Change-Id: Ib1a431cc8b2ca2cc143a8c8337b87f54f56d1029
2018-09-19 08:20:18 -05:00
Zuul
a98b14d541 Merge "Elasticsearch: Add ingress, remove node ports" 2018-09-19 02:57:09 +00:00
Zuul
a3c2571d3c Merge "Revert "Make it possible to secure pool during deployment"" 2018-09-19 02:57:08 +00:00
Pete Birley
c80e65cadb Revert "Make it possible to secure pool during deployment"
This reverts commit 14247c334b6fe8a20caba47efba99ef24298106f.

As it blocks the Airship projects genesis process.

Change-Id: I3b13f4e8f397ee3bc59f85e9a38d8581306deb2d
2018-09-18 21:01:56 +00:00
Zuul
1f4f1de7d7 Merge "Gate/Dev: Fix perms for upstream-resolv.conf" 2018-09-18 21:00:21 +00:00
Pete Birley
101f58ae4b Gate/Dev: Fix perms for upstream-resolv.conf
This PS fixes the permissions for the upstream resolv.conf used by the
dns redirector.

Change-Id: Ieef113a6e7b72767318516c63cf48dcac202cf4d
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-18 11:55:20 -05:00
Zuul
1c6a33d979 Merge "Prometheus: Prune large unused time series metrics" 2018-09-18 05:30:39 +00:00
Zuul
ef37b095b4 Merge "Helm-Toolkit: Add doc comments for keystone env snippets" 2018-09-17 17:11:29 +00:00
Zuul
5ec85a5d70 Merge "Prometheus: Fix Prometheus endpoints in apache config" 2018-09-17 15:19:03 +00:00
Steve Wilkerson
bc6e22f392 Gate: Trim dev-deploy gates
This attempts to trim down the dev-deploy gates until further
gate refactoring is complete. This disables the elasticsearch and
fluentd exporters and removes the openstack exporter from the
single node deployment gates to ease the load on nodepool vms

Change-Id: If211511e8f52fe39d293966abbd7e62b45b65970
2018-09-17 13:56:51 +00:00
Zuul
d208d55a46 Merge "Gate: only restart network manager if required" 2018-09-17 13:49:01 +00:00
Steve Wilkerson
8e2d3a5b4c Fluentbit: Update version, config util template
This updates fluentbit to version v0.14.2, which includes
the Modify plugin (required for trimming underscores from
systemd log fields, necessary for kibana visualization). This also
updates the fluentbit configuration util to allow for renaming
multiple entries in an event. This is required because the values
definition for a configuration section is defined as a map, and
does not supported multiple Rename directives

Change-Id: I05172e8236282a438587887f4a806cf35c4b6c68
2018-09-17 07:45:45 -05:00
Zuul
0f2dace4e8 Merge "Gate/Dev: Allow custom upstream dns servers to be preserved" 2018-09-15 16:59:22 +00:00
Pete Birley
620d374730 Gate: only restart network manager if required
We only need to restart network manager if disabling dns management.

Change-Id: Idfdf68678a68c2808527de4226ff91e9ea5f8d67
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-15 14:39:17 +00:00
Pete Birley
79d11e4044 Gate/Dev: Allow custom upstream dns servers to be preserved
This PS updates the dns redirect pod deployment to support a persistant
set of customised upstream nameservers to be used.

Change-Id: Ib163f8ed9ceadca69b56cd5f146ffd194d98cdc3
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-15 13:13:29 +00:00
Jean-Charles Lopez
14247c334b Make it possible to secure pool during deployment
Change-Id: If5e19720f538b506dbe8a551b79a972b4bf25020
2018-09-14 23:02:42 +00:00
Zuul
2fce7e8212 Merge "Correct the task name for tiller installed" 2018-09-14 21:03:16 +00:00
Zuul
a46d006fd3 Merge "Add release uuid to pods and rc objects" 2018-09-14 00:42:23 +00:00
Zuul
c42d595ede Merge "Simplify zuul.yaml" 2018-09-13 23:14:03 +00:00
Zuul
d04e1dc7b2 Merge "add "*.pyc" in helmignore" 2018-09-13 19:50:00 +00:00
Zuul
accaf8aabf Merge "Update the env usage of docker_container module" 2018-09-13 13:53:54 +00:00
Pete Birley
26fd6bc04c Helm-Toolkit: Add doc comments for keystone env snippets
This PS adds doc comments for the keystone env snippets

Change-Id: Ia18b3101e639a713b7cc1c88146a2f91bbcb3984
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-13 13:53:25 +00:00
Pete Birley
78ba9a4b6f Simplify zuul.yaml
This relies on inheritence to reduce the parameters of the jobs
and make sure things are easier to read.

Change-Id: If95e82202551612dc4ff9f1411c32e34399f51dd
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-13 06:36:57 -05:00
Pete Birley
bb3ff98d53 Add release uuid to pods and rc objects
This PS adds the ability to attach a release uuid to pods and rc
objects as desired. A follow up ps will add the ability to add arbitary
annotations to the same objects.

Change-Id: Iceedba457a03387f6fc44eb763a00fd57f9d84a5
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-13 05:35:35 +00:00
Zuul
274b230dcc Merge "TLS: Ensure CN is included in list of DNS alt names" 2018-09-12 23:19:26 +00:00
Pete Birley
cb20c317ae TLS: Ensure CN is included in list of DNS alt names
This PS udpates the TLS cert gen function to ensure the CN is
included in the list of DNS alt names within the cert.

Change-Id: Iaec9207e61884972d49dee84af24d4827d914afb
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-12 20:29:25 +00:00
Steve Wilkerson
4047f7231e Gnocchi: Move chart to openstack-helm-infra
This moves the gnocchi chart to openstack-helm-infra as part of
the effort to move charts to appropriate repositories

Change-Id: I7b8f35a6a140995902304c402a077cf99be6190a
2018-09-12 09:34:14 -06:00
Zuul
201c0a6d21 Merge "Ceph-rgw: Update s3 default admin keys" 2018-09-11 21:16:19 +00:00
Zuul
e6966ffdaf Merge "Gate: Update gate permit running on ubuntu 18.04" 2018-09-11 19:19:27 +00:00
Zuul
bfbdefbe4d Merge "Grafana: Disable LDAP signup by default" 2018-09-11 17:24:24 +00:00
Pete Birley
e67f7bafd5 Gate: Update gate permit running on ubuntu 18.04
This PS updates the gate to permit running on the current LTS ubuntu
release.

Change-Id: I7e32a4ab0dc79e4b5f7a16f8a8cb5e9ee182ee08
Signed-off-by: Pete Birley <pete@port.direct>
2018-09-11 15:20:48 +00:00
Steve Wilkerson
8c75dc7924 Grafana: Disable LDAP signup by default
This removes the configuration value for enabling LDAP signup by
default in the Grafana chart, which restricts the ability for a
user to sign up for Grafana access via the login page.

Change-Id: Ifed1dbf7eda022541d7a1ab179788c92763bc310
2018-09-10 18:10:22 +00:00
Steve Wilkerson
7865667e35 Ceph-rgw: Update s3 default admin keys
This updates the ceph-rgw s3 admin access and secret keys to more
generic default values to avoid the possibility of a user assuming
the default keys are acceptable to use

Change-Id: I618ec16059e12c8ce74513da7580a9853af707df
2018-09-10 10:56:45 -06:00
Steve Wilkerson
6b944f557b Libvirt: Move chart to openstack-helm-infra
This moves the libvirt chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Change-Id: I02ce197f8d100da74c086d84e2f9d2b902a69e97
Story: 2002204
Task: 21723
2018-09-10 09:45:55 -06:00
Zuul
c581bbcbf8 Merge "Ceph-RGW: Fix configmap-bin template" 2018-09-10 06:32:37 +00:00
Zuul
f379678266 Merge "Upgrade etcd to 3.2.24" 2018-09-10 04:46:33 +00:00
Zuul
62de6b144b Merge "MongoDB: Move chart to openstack-helm-infra" 2018-09-10 04:46:31 +00:00
Steve Wilkerson
9017cc5f28 MongoDB: Move chart to openstack-helm-infra
This moves the mongodb chart to openstack-helm-infra as part of
the effort to move charts to the appropriate repositories

Change-Id: I4c93957ec6f2ccf2650bcce48702eb29d5f51fd6
Story: 2002204
Task: 21728
2018-09-09 10:22:47 -06:00
Steve Wilkerson
8bbd80e197 Postgresql: Move chart to openstack-helm-infra
This moves the postgresql chart to openstack-helm-infra as part of
the effort to move charts to the appropriate repositories

Change-Id: I25c026e5d4c4abe4dd0805047051281911632739
Story: 2002204
Task: 21729
2018-09-09 10:20:08 -06:00
Tin Lam
ab6d15441c Upgrade etcd to 3.2.24
This patch upgrades the default etcd version to 3.2.24.  Migration from
2.x to 3.x is required to address:

* Kubernetes is deprecating etcd 2.x support later this year. See [0].
* Recommended etcd minimum versions are: 3.1.11+, 3.2.10+, 3.3.0+ to
  address a data corruption bug. See [1].

[0] https://groups.google.com/forum/#!msg/kubernetes-dev/DoOl77xjpDA/uZFun65oBwAJ
[1] https://discuss.kubernetes.io/t/recommended-etcd-minimum-versions-3-1-11-3-2-10-3-3-0/2637

Change-Id: I221e0ff06557c3b107567180628a2c7bf1301bf0
Signed-off-by: Tin Lam <tin@irrational.io>
2018-09-08 08:11:32 +00:00
Zuul
31ca66b3ce Merge "Monitor Cinder API and Scheduler" 2018-09-07 22:31:18 +00:00
Zuul
f52b0ffedc Merge "Gate: Move dev-deploy jobs to nonvoting temporarily" 2018-09-07 17:47:04 +00:00
Scott Huang
bc54e72fd3 Monitor Cinder API and Scheduler
Change-Id: I159facb491d9a722d8c067ead25c470f00b83939
2018-09-07 15:12:32 +00:00
Steve Wilkerson
fe437272b4 Ceph-RGW: Fix configmap-bin template
This changes the conditional check for including the configmap-bin
template in the ceph-rgw chart to their original state, and also
adds the rgw-s3-admin.sh script that was removed unintentionally

Change-Id: I60c3660a5bca37199effcf74f3060059345a327b
2018-09-07 13:35:14 +00:00
Steve Wilkerson
06a58f9bd4 Gate: Move dev-deploy jobs to nonvoting temporarily
This changes the dev-deploy-ceph and dev-deploy-nfs jobs to
nonvoting jobs, until we can revisit the services being deployed
as part of these jobs. Currently, these jobs are pushing the
limits of a single nodepool VM which results in random failures in
the jobs themselves or the postrun jobs.

Change-Id: I9a6e68dc472b81b9c13b95520f4bef4cdb091beb
2018-09-07 08:29:34 -05:00
Steve Wilkerson
3dcbfae101 Openvswitch: Move chart to openstack-helm-infra
This moves the openvswitch chart to openstack-helm-infra as part of
the effort to move charts to their appropriate repositories

Change-Id: I6e00231b8de54c01bc9bb31e0433753a9f281542
Story: 2002204
Task: 21730
2018-09-07 12:35:40 +00:00