798 Commits

Author SHA1 Message Date
Zuul
51bab02b24 Merge "Rename mandatory access control annotation func" 2018-10-17 04:24:40 +00:00
Zuul
21f46d294b Merge "[Open vSwitch] Remove auto_bridge_add support" 2018-10-17 04:23:52 +00:00
Zuul
23fba51fbb Merge "[MariaDB] Bump to version 10.2.18 to avoid shutdown hangs" 2018-10-17 04:23:51 +00:00
Zuul
570355b1d9 Merge "Initialize OSDs with a crush weight of 0 to prevent automatic rebalancing." 2018-10-17 02:45:45 +00:00
Cliff Parsons
c5b10d155f Rename mandatory access control annotation func
This patch set renames the existing apparmor annotation
function to a more generic MAC (Mandatory Access Control)
name to be flexible enough to handle other MAC annotations
in the future.

Change-Id: I98a34484cebc2b420ad8f2664e4aaa84cfb9dca1
2018-10-17 01:35:49 +00:00
Matthew Heler
5efac315f7 Initialize OSDs with a crush weight of 0 to prevent automatic rebalancing.
Weight the OSDs based on reported disk size when ceph-client chart runs.

Change-Id: I9f4080a9843f1a63564cf71154841b351382bfe2
2018-10-16 21:33:49 +00:00
Steve Wilkerson
f3d8bda9d6 Grafana: Support multiple Ceph clusters with dashboards
This updates the Grafana Ceph dashboards to use templating to
determine which ceph-mgr to use for displaying ceph related
metrics.  This required setting the appropriate labels on the
ceph-mgr service to be able to distinguish between releases

Change-Id: Id2eceacadc5b6366d7bc6668bc16ccf5ba878e4a
2018-10-16 21:32:13 +00:00
Chris Wedgwood
8dad346f3f [MariaDB] Bump to version 10.2.18 to avoid shutdown hangs
We see sporadic shutdown hangs that look to be the issue described at
https://jira.mariadb.org/browse/MDEV-15554

Upgrade minor version to address this.

Change-Id: Idf8403b44e871b5a32173bd153a8367519b239ec
2018-10-16 21:30:22 +00:00
Pete Birley
a4111037b0 Gate: Fix kubeadm-aio image
This PS resores the kubeadm-aio image to a functioning state, by
updating the requests package.

Change-Id: I706a8ca5661a8e773386c8d82c049e2a9a04e94e
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-16 16:09:49 -05:00
Zuul
6e092c908c Merge "Externalize some repo URL vars to allow runtime modification" 2018-10-16 00:04:06 +00:00
Zuul
580522c42a Merge "Ceph-client: make pool creation depedent on ceph-mgr service" 2018-10-15 22:05:40 +00:00
Zuul
1f9c8d7f42 Merge "Nagios: Update image with Elasticsearch plugin headers" 2018-10-15 17:58:17 +00:00
Zuul
b3e777c596 Merge "Add network policy toolkit function" 2018-10-15 17:45:35 +00:00
Roman Gorshunov
da31cacafd Externalize some repo URL vars to allow runtime modification
This is to be able to use local mirror of certain packages.

Change-Id: Ia06c6df0628ce5a44ed072c875eaa65d1343c65d
2018-10-15 17:10:10 +00:00
Chinasubbareddy M
616aecd80a Ceph-client: make pool creation depedent on ceph-mgr service
This is to add dependency for pool creation untill ceph-mgr fully up.

Change-Id: Id3111810a855bedff62970091b225358c269cecd
2018-10-15 10:00:27 -05:00
Steve Wilkerson
19248c11e9 Nagios: Update image with Elasticsearch plugin headers
This updates the Nagios image to include an update to the
Elasticsearch plugin that adds the appropriate headers to the
request sent to Elasticsearch. As Elasticsearch >=6.0 no longer
tries to determine the request data type, we need to explicitly
tell Elasticsearch the request body is JSON. Since we use
Elasticsearch 5.6.4 as default, this change will make the
deprecation warnings for the 6.0 breaking change go away.

Change-Id: I0dbd8859ca8d0bd0893832b4edd92742e575598b
2018-10-15 14:20:22 +00:00
Tin Lam
92e68d33ea Add network policy toolkit function
This patch set implements the helm toolkit function to generate a
kubernetes network policy manifest based on overrideable values.
This also adds a chart that shuts down all the ingress and egress
traffics in the namespace. This can be used to ensure the
whitelisted network policy works as intended.

Additionally, implementation is done for some infrastructure charts.

Change-Id: I78e87ef3276e948ae4dd2eb462b4b8012251c8c8
Co-Authored-By: Mike Pham <tp6510@att.com>
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-15 13:50:50 +00:00
Jean-Philippe Evrard
0dcceacf7d Remove dependency to OSH repository for test jobs
Without this patch, there is a dependency between the two
repositories OSH and OSH-infra, which will cause a circular
dependency problem when trying to remove the duplicated jobs
that will appear in OSH.

Change-Id: Ibeee0a853d0c1358519b0391c879137d8a214be2
2018-10-15 13:34:08 +02:00
Zuul
be7dbf6c28 Merge "[MariaDB] Update/remove deprecated configuration" 2018-10-13 21:40:48 +00:00
Zuul
75ea67e591 Merge "Fluent-logging: Update helm tests for checking index entries" 2018-10-13 03:11:39 +00:00
Zuul
c39b29e351 Merge "Fluentd: Update logging interval values" 2018-10-13 03:02:04 +00:00
Zuul
016cc39c9f Merge "Gate: Cleanup scripts for k8s keystone auth gate" 2018-10-12 23:38:52 +00:00
Zuul
bfb1c2a498 Merge "Replace docker-py with docker" 2018-10-12 22:15:15 +00:00
Zuul
cd50e50eb3 Merge "Charts: Update heat image used for jobs and helm tests" 2018-10-12 20:35:14 +00:00
Pete Birley
8bb71f6659 Gate: Cleanup scripts for k8s keystone auth gate
This PS cleans up the scripts for the k8s k8s keystone auth gate.

Change-Id: I248439f9b8ffa372dfaba5acba0c8c587231d901
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-12 13:43:41 -05:00
Jean-Philippe Evrard
100c900da0 Regroup OpenStack-Helm* gating under a folder
This move definitions of openstack-helm-infra into
a newly created zuul.d folder.

The advantage is to simplify readability of gating, and
makes it easier for contributors to step into the gating
of the openstack-helm-* projects.

- zuul.d/playbooks will contain all the playbooks used for gating
- zuul.d/nodesets.yaml contains all the specific nodesets
  required by OpenStack-Helm* projects
- zuul.d/project.yaml will be defined in each repo, and will
  contain the repo's pipelines information (so this repository's
  project.yaml only contains openstack-helm-infra pipelines)
- zuul.d/jobs.yaml will contain all the openstack-helm-*
  repositories jobs

This patch also introduces a first common 'lint' playbook
and 'openstack-helm-lint' job, showing how a job can be
re-used across repositories without requiring repetition of
job definition/plays in other repositories.

Change-Id: Id055ddac4da4971b1fb13ac075a7659369cd2b24
2018-10-12 15:13:12 +02:00
Steve Wilkerson
c7cbb9f4dd Charts: Update heat image used for jobs and helm tests
This changes the image used for various jobs and helm tests in the
osh-infra charts. This replaces the kolla heat image with the loci
based heat image used for jobs and helm tests in openstack-helm in
order to drive consistency

Change-Id: Ie9deedadb7507282fe62723ec4641dd508040364
2018-10-11 14:47:58 -05:00
Steve Wilkerson
78283495f0 Fluent-logging: Update helm tests for checking index entries
This updates the helm tests for the fluent-logging chart to make
them more robust in being able to check for indexes defined in the
chart.  This is done by calculating the combined flush interval
for both fluentbit and fluentd, and sleeping for at least one
flush cycle to ensure all functional indexes have received logged
events.

Then, the test determines what indexes should exist by checking
all Elasticsearch output configuration entries, determining
whether to use the default logstash-* index or the logstash_prefix
configuration value if it exists.  For each of these indexes, the
test checks whether the indexes have successful hits (ie: there
have been successful entries into these indexes)

Change-Id: I36ed7b707491e92da6ac4b422936a1d65c92e0ac
2018-10-11 13:28:30 -05:00
Chris Wedgwood
8554bdcbef [MariaDB] Update/remove deprecated configuration
Change-Id: I18aa87602b63ecd051c21e007aff8cadccdd0cda
2018-10-11 15:31:31 +00:00
Steve Wilkerson
9b5d4d9f17 Fluentd: Update logging interval values
This updates the logging interval values for the Elasticsearch
outputs to integers (20) vs the previous string value (20s)

Change-Id: I681bdaf807ba0136fef3b6dc1c7ddaa689ae77a3
2018-10-11 09:05:00 -05:00
Zuul
e231a7c5fd Merge "Elasticsearch: Update log4j2 configuration settings" 2018-10-10 19:23:47 +00:00
Zuul
922d7d3d26 Merge "Charts: Update helm test pod templates" 2018-10-10 06:00:44 +00:00
Zuul
c84dfd8122 Merge "Add configMap hash to annotation" 2018-10-09 22:23:10 +00:00
Zuul
9f63330f0b Merge "Add missing labels to cronJobs" 2018-10-09 21:49:41 +00:00
Steve Wilkerson
bfa237d347 Charts: Update helm test pod templates
This updates the helm test pod templates in the charts with helm
tests defined. This change includes the addition of:

- Generate test pod cluster roles and role bindings
- Generate service accounts for test pods
- Add node selectors to the test pods
- Add service accounts to the test pods
- Addition of entrypoint container to the test pods
- Indentation fix for rabbitmq test pod template

Change-Id: I9a0dd8a1a87bfe5eaf1362e92b37bc004f9c2cdb
2018-10-09 21:00:00 +00:00
Zuul
b7a459ae2a Merge "Elasticsearch: Add node selector to Curator cron job" 2018-10-09 20:26:28 +00:00
Mike Pham
0ad481d9c6 Add missing labels to cronJobs
This PS adds the missing labels so it is able to target by the network policy.

Change-Id: I5da7e0a9b17d00a5e98488780d72c77a93af999f
2018-10-09 13:58:17 -04:00
Steve Wilkerson
30f339a080 Elasticsearch: Add node selector to Curator cron job
This adds the node selector key and value configuration to the
Curator cron job for Elasticsearch, as it was previously omitted

Change-Id: Id702007fa827a1e1f90dee9b2a855e4197f4567c
2018-10-09 11:01:41 -05:00
Zuul
c685327406 Merge "Gate: refactor gate script running" 2018-10-09 16:00:28 +00:00
Zuul
bc7593b54c Merge "VBMC: Move and update vbmc image to osh-infra" 2018-10-09 15:49:37 +00:00
Tin Lam
f0f89b9425 Add configMap hash to annotation
This patch set adds in the annotation for the configmap-bin-hash for the
memcached chart.

Change-Id: I8d0e624af18165a1b146680eefa86f1184ddd924
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-09 14:16:17 +00:00
Zuul
2fa40d7603 Merge "[Calico] Update to v3.2.3" 2018-10-09 13:59:22 +00:00
Steve Wilkerson
1f4a890343 Elasticsearch: Update log4j2 configuration settings
This updates the configuration settings used for the log4j2
template for Elasticsearch. The previous settings weren't
compatible with the version of Elasticsearch currently being used
(5.6.4)

Change-Id: Id4b02ad022c46d599ae02ef77bb0f81f7e62c9e4
2018-10-09 08:01:39 -05:00
Tin Lam
1c92644007 Fix indentation
Fix an indentation in gotpl where the things are indented 9 spaces.

Change-Id: Ifa1fd1bb16a262b6f17287f6f9b3746db30486ba
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-08 21:11:18 -05:00
Gage Hugo
650214e149 Replace docker-py with docker
docker-py's last release is outdated[0], last updated Nov 2016 while
the more up-to-date "docker" release[1] is still maintained. This
changes the use of "docker-py" to "docker".

[0] https://pypi.org/project/docker-py/
[1] https://pypi.org/project/docker/

Change-Id: I78fe5e426631c5ea5e0d128dc30fd55c81cca2e0
2018-10-08 21:58:00 +00:00
Pete Birley
7f4a37440f VBMC: Move and update vbmc image to osh-infra
This PS updates and moves the vmbc image to osh infra.

Change-Id: I9f8d21df8974d1484d9f087ee296fede2a87e545
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-08 09:38:24 -05:00
Pete Birley
c7f7091739 Gate: refactor gate script running
This is the 1st in a series of commits to reduce the complexity
of the gate playbooks, follow on work will target gates more
specificly to both reduce infra load and improve coverage.

This PS also removes the unused ldap-deploy playbook.

Change-Id: Ie4ddabe86d71008611c6cc5015a927e32c54fa35
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-08 04:51:59 +00:00
Zuul
7c839c82b2 Merge "Gate: Move to K8s 1.10.8" 2018-10-06 06:30:08 +00:00
Chris Wedgwood
1e82ab4c45 [Calico] Update to v3.2.3
Update everything to v3.2.3 consistently.

Change-Id: I4728faeec1572e6d4921f5118a9baee1cd7422ed
2018-10-06 05:41:29 +00:00
Zuul
8d9c892c69 Merge "fix tox python3 overrides" 2018-10-06 05:16:18 +00:00