403 Commits

Author SHA1 Message Date
Zuul
6ef3f58fb8 Merge "Add pre-fixes to the Selenium jobs and remove "|| true"" 2019-01-31 20:39:40 +00:00
Zuul
b30012a616 Merge "[CEPH] Fixes for the OSD defrag cronjob" 2019-01-31 16:05:14 +00:00
Matthew Heler
fc76091261 [CEPH] Fixes for the OSD defrag cronjob
Fix a naming issue with the cronjob's binary, and schedule the cron
job to run every 15 minutes for the gates. Additonally check to
to ensure we are only running on block devices. Also update the
script to work with ceph-volume created devices.

Change-Id: I8aedab0ac41c191ef39a08034fff3278027d7520
2019-01-31 06:13:05 -06:00
Chris Wedgwood
b7b7c5ea44 [alertmanager] default to 1 replica, multinode gate uses 3
Change-Id: Ifb1420f8dcf7237349a79f1f97aea5e547bafeab
2019-01-30 08:43:18 +00:00
Meg Heisler
98fbc9a1e2 Add pre-fixes to the Selenium jobs and remove "|| true"
This adds xxx-job name prefixes to the Selenium jobs for consistency

This will also remove the "|| true" suffix that was added temporarily to
ensure the Kibana selenium job did not error. The fix for the issue
was merged so the quick fix is no longer needed and may prevent an
error when an issue actually occurs.
Change-Id: I16881974cbf618b31813964b17c090dbfe33fe51
2019-01-29 20:24:57 -06:00
Chris Wedgwood
a6fa47eea5 [tiller] Disable monitoring by default, enable in gate
Change-Id: Idb7a1f0046e96261a7042d30eedfaea031b27209
2019-01-29 18:57:58 +00:00
Zuul
7b5d6e9237 Merge "OSH-Infra: Update multinode and aio-monitoring/logging jobs" 2019-01-29 17:03:18 +00:00
Drew Walters
fd7add74ac Add proxy support to Minikube gate script
This commit introduces proxy support to the Minikube gate script by
leveraging existing `HTTP_PROXY`, `HTTPS_PROXY`, and `NO_PROXY`
environment variables.  Additionally, this adds the ability to interpret
DNS nameservers when running behind a proxy server and use those in
`/etc/resolv.conf` over the Google DNS servers.

Change-Id: I508dd00fb7df33945e8ee96af250a8eff9db389a
2019-01-28 11:51:12 -06:00
Steve Wilkerson
ea0b94a052 Helm: Update version to 2.12.3
This updates Helm from version 2.12.1 to 2.12.3

Change-Id: Ie85e4ae3b55ce2e9f67a5e67af1e785540a6637e
2019-01-24 09:09:00 -06:00
Steve Wilkerson
9bb603ed0c Update Helm to version 2.12.1
This updates Helm from version 2.11.0 to 2.12.1

Change-Id: I9bc37c330b068388df9840eb84dfb12e2536c173
2019-01-23 16:43:36 -06:00
Steve Wilkerson
1e40765d88 OSH-Infra: Update multinode and aio-monitoring/logging jobs
This proposes moving the multinode job to a periodic job to
match the approach used in the openstack-helm repo.

This also adds the openstack-exporter to the aio monitoring job as
it was previously missing.

This also proposes moving the aio-logging and aio-monitoring jobs
to voting

Change-Id: Idcd4544e03facdcd2430683b66bd80c79e73a372
2019-01-23 08:49:48 -06:00
Stamatis Katsaounis
032740957e Pin pip to 18.1 to allow build of docker images
Task: 29045
Story: 2004843

This patch pins pip to 18.1 as the latest pip 19.0 has a problem with
--no-cache-dir option. This problem is causing the build of docker
images of mariadb and kubeadm-aio to fail when they upgrade the
setuptools package.

Change-Id: If2b76249eeacec519a6a76605607ba6f3f81ac7d
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2019-01-23 11:56:10 +02:00
Zuul
067a37f76f Merge "Add exception handling to Kibana Selenium test" 2019-01-22 17:18:30 +00:00
Meg Heisler
1bf24051c5 Add exception handling to Kibana Selenium test
This adds exception handling to the Kibana Selenium tests
to address the test failures due to TimeoutExceptions when
the dashboard loads slowly. Only TimeoutExceptions are handled
so if there is an issue with the page itself an error will still
cause the gate to fail as intended. When a TimeoutException
occurs an error message is logged and a screenshot is taken
of the current page.

Change-Id: I16cd3a61ffce2e5fdc39bd7731cc068b8a6ec41f
2019-01-21 13:26:43 -06:00
Dmitrii Kabanov
0c5e2c4830 [Calico] Update TLS settings for Calico
PS provides possibility to use TLS in etcd (for Calico).
The ansible scripts were updated as well.

Change-Id: I522a78043a125660153aaa60f13d61ba8e325e75
2019-01-18 19:53:46 +00:00
Zuul
958127477d Merge "Additional Selenium tests for Kibana dashboard" 2019-01-17 23:46:14 +00:00
Meg Heisler
9289cd0987 Additional Selenium tests for Kibana dashboard
This helps verify Kibana is working properly by using
Selenium Webdriver to navigate to different index dashboards
and takes screenshot of each one. It also add the scripts to
the gates for single and multinode deployments.

Change-Id: Ic2c91734d1eaac0ea4e7985bf69082942166715d
2019-01-17 11:24:19 -06:00
Steve Wilkerson
00b40480a3 Nagios: Fix elasticsearch query clause volume mount
This fixes the Nagios volume mount for the Elasticsearch query
file. Previously, the check for adding the volumemount to the
pod definition was incorrect. This fixes the conditional check,
and also adds the same conditional check to the configuration
secret

This adds a simple check to the monitoring and multinode jobs to
validate the resulting json gets mounted into the pod successfully

Change-Id: I2af289ccc4e1cff1669cb5e6e829514781b14dd3
2019-01-15 16:18:01 -06:00
Zuul
1c6d48f4a5 Merge "Selenium Tests for OSH Infra" 2019-01-08 18:03:17 +00:00
Meg Heisler
c3bef9e88f Selenium Tests for OSH Infra
This adds scripts using Selenium Webdriver to verify
the dashboards for Gafana, Nagios, and Prometheus are
reachable and functioning as expected. The scripts
create screenshots of each dashboard as well as
pages that can be navigated to.

It also adds the scripts to the gates for the single
and multinode deployments.

Change-Id: I1699e0ba8ff82ce8f59342cc71aad10cff7d2516
2019-01-07 15:59:42 -06:00
Zuul
0770465962 Merge "Uplift Ceph charts to the Mimic release" 2019-01-05 19:39:57 +00:00
Matthew Heler
c0d028e245 Uplift Ceph charts to the Mimic release
Change the release of Ceph from 12.2.3 (Luminous) to latest 13.2.2
(Mimic). Additionally use supported RHEL/Centos Images rather then
Ubuntu images, which are now considered deprecated by Redhat.

- Uplift all Ceph images to the latest 13.2.2 ceph-container images.
- RadosGW by default will now use the Beast backend.
- RadosGW has relaxed settings enabled for S3 naming conventions.
- Increased RadosGW resource limits due to backend change.
- All Luminous specific tests now test for both Luminous/Mimic.
- Gate scripts will remove all none required ceph packages. This is
required to not conflict with the pid/gid that the Redhat container
uses.

Change-Id: I9c00f3baa6c427e6223596ade95c65c331e763fb
2019-01-05 14:38:38 +00:00
weiyj
f5d1d6938c spelling error
Change-Id: Idd9e6bc6a1459e74703599b94f0b410fdb9f94ef
2019-01-05 04:39:23 +00:00
Pete Birley
0bf3674539 Revert "Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA"
This reverts commit 8d33a2911cda0c9e88406b9eeacbd8dfa70286f2.

Change-Id: Ic861b9bf9b337449b47a3558da8355e7a5bcacee
2018-12-16 04:21:46 +00:00
Mike Pham
8d33a2911c Add Egress Helm-toolkit function & enforce the nework policy at OSH-INFRA
This PS implements the helm toolkit function to generate the
Egress in kubernetes network policy manifest based on overrideable values.
It also enbale the K8s network policy at Osh-infra gate.

Change-Id: Icbe2a18c98dba795d15398dcdcac64228f6a7b4c
2018-12-14 16:32:40 -05:00
Zuul
0a53cad3a4 Merge "k8s-keystone create cluster roles and tests" 2018-12-10 22:06:22 +00:00
Steve Wilkerson
4593854c6c Add tenant ceph deployment as nonvoting check
This adds a nonvoting check that will deploy two ceph clusters
and then deploy two radosgw instances, each one backed by a unique
ceph cluster. This allows us validate whether we can reliably
deploy multiple ceph clusters, as in the case of tenant-ceph outlined
in openstack-helm specs

Change-Id: I76a416eddcdb3ea2416d475ea8c8756925cd9580
Co-Authored-By: Meghan Heisler <mh783g@att.com>
2018-12-07 23:02:52 +00:00
Zuul
5da44ee309 Merge "Gate: minikube single node gate deployment" 2018-12-04 16:32:04 +00:00
Pete Birley
957bcb15a4 Gate: minikube single node gate deployment
This PS moves the single node gate to use a lightwight minikube
based env.

Change-Id: I285c4222795b66f3527f0daaf62a91973da5dca8
Co-authored-by: Krishna Venkata <kvenkata986@gmail.com>
Signed-off-by: Pete Birley <pete@port.direct>
2018-12-03 15:33:44 -06:00
Zuul
2a0b183613 Merge "Helm tests for Ceph-OSD and Ceph-Client charts" 2018-12-03 05:03:31 +00:00
Sangeet Gupta
eac7202774 k8s-keystone create cluster roles and tests
This commit adds roles to kubernetes-keystone-webook policy
which has permissions similar to clusterrols cluster-admin,
edit and view present in kubernetes.

Check.sh script is also modified to test and verify the new
roles.

Change-Id: I43621d2e1036259064c805d97b340589a5b68c93
2018-12-01 19:14:31 +00:00
Jean-Charles Lopez
f7e03d4763 Helm Tests for Ceph-RGW chart
Co-Authored-By: Renis Makadia <renis.makadia@att.com>

Change-Id: I81cc0cb498b2ca911d5b7bfa7c3bd9b8552e0e2b
2018-12-01 08:08:28 +00:00
Renis Makadia
b1005b23b4 Helm tests for Ceph-OSD and Ceph-Client charts
Change-Id: If4a846f0593b8679558662205a8560aa3cbb18ae
2018-12-01 08:08:00 +00:00
Steve Wilkerson
4c18a421ee Add charts for Elastic Beats
This adds basic charts for Elastic metricbeat, filebeat,
packetbeat, and elastic APM server.  This also adds an experimental
job for deploying the elastic beats along with Elasticsearch and
Kibana

Change-Id: Idcdc1bfa75bcdcaa68801dbb8999f0853652af0f
2018-11-26 20:19:57 +00:00
Zuul
2c9ff8bee8 Merge "Fix the checkPGs cronjob" 2018-11-09 22:57:50 +00:00
Zuul
77772547e2 Merge "RGW: Fix multinode deploy for ceph rgw" 2018-11-08 22:54:01 +00:00
Meg Heisler
774e0cb654 RGW: Fix multinode deploy for ceph rgw
Change deployment script for rgw to not use the docker
bridge for public and cluster network overrides. Instead,
calculate network values in same way as other ceph multinodes
deployment steps

Change-Id: I2bacd1af1cc331d76a5d61f3b589ca6ef80b1b2e
2018-11-08 11:39:23 -06:00
Matthew Heler
e1c82f3465 Fix the checkPGs cronjob
Currently the cronjob is broken due to syntax and
permission issues.

Additionally move the cronjob from once a month to
every 15 minutes, and automatically disable the job
unless explicitly enabled.

Change-Id: Id72bdb286c805ccb0ea4e9fcf65fabca94a180dd
2018-11-06 19:39:23 -06:00
Jean-Philippe Evrard
ff1f75fc45 Do not use OSH_INFRA_PATH in osh-infra
If OSH_INFRA_PATH is never used in the openstack-helm-infra repository,
as all the references are using relative paths.

The keystone script is not using a relative path, and relies on
OSH_INFRA_PATH to be defined to work.

This is a problem, because when it is not defined, the expected path
for ldap chart is /ldap, which is an incorrect path.

This fixes the problem by ensuring the path is relative.

Change-Id: I04a8d5c074b7c1e6fa66617bbb907f2ad4dcb3af
2018-11-05 13:36:03 +00:00
Matthew Heler
3e7ba37290 Ensure latest Ceph packages during deployment
Change-Id: Ia5bc0802577e2b72a1de078085f5fe7e60f63604
2018-10-31 02:16:50 -05:00
Tin Lam
5730631ba6 Clean-up script
This patch set cleans up the script to be consistent with other OSH
installation scripts.

Change-Id: I212cd0cf0e818f1fc924b9b690d18f5d107b850b
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-30 16:22:45 +00:00
Chris Wedgwood
b10ebbb63a [gate] Use Kubernetes 1.10.9
Change-Id: I5bb951f455fa6d7d344a264336a2a9b985fd85f4
2018-10-29 15:10:35 +00:00
Jean-Philippe Evrard
52f41c0af0 Define OSH_PATH by default
OSH_PATH is not defined by default outside OpenStack's CI.

This is a problem if a user wants to run scripts manually on its
machine for local testing.

This fixes it by having, by default, the OSH_PATH defined
in the scripts using OSH relatively to current folder.

For user experience, the script returns to the same path after
running.

Change-Id: I915e7d3c945f2002a2008b2b033a2b7725320b17
2018-10-26 01:15:08 +00:00
Pete Birley
f6e84fe15f MariaDB: Galera cluster refactor
This PS updates the MariaDB chart to better support clustering,
using a configmap to track cluster state.

Change-Id: Ifd9c3d63353a9b587384b6f13c0863ecc4fbd956
Signed-off-by: Pete Birley <pete@port.direct>
2018-10-25 06:21:01 +00:00
Tin Lam
653b84a2e1 Fix k8s-auth job
This patch set addresses a cross-repo conflict with the enablement of
network policy in gate script override.

Change-Id: I284d6b04940424a87e5b239ccc9d30ae01075f38
Signed-off-by: Tin Lam <tin@irrational.io>
2018-10-24 20:49:17 -05:00
Zuul
860a897aee Merge "[gate] allow pip caching" 2018-10-23 18:30:20 +00:00
Chris Wedgwood
d4ac063163 [gate] allow pip caching
The pip cache is useful for repeat operations and doesn't seem to have
any real downsides.

Change-Id: Iadb21a118f8d725911a9baa6a9264b8644012af9
2018-10-22 00:11:25 +00:00
Chris Wedgwood
c08c78f1d1 [gate] Put nfs-provisioner in it's own namespace (docker-registry)
Use the 'docker-nfs' namespace to back the docker registry.  This
means we can delete the registry namespace without causing IO lockups.

Change-Id: I1706dd96653598dcfbb81904fde8c0bf92294b06
2018-10-21 23:42:20 +00:00
Chris Wedgwood
8f5aaa3fd0 [gate] Put nfs-provisioner in it's own namespace
Having storage (backend) components in their own namespace means we
can delete the namespaces containing the openstack without causing
system hangs which occur when storage is remove whilst in use.

Change-Id: Ie489709b08929f25cf0e626a8541620a06506b8b
2018-10-21 23:37:56 +00:00
Zuul
23730808d4 Merge "Gates: Update fluent-logging/elasticsearch configurations" 2018-10-21 09:17:19 +00:00