5029 Commits

Author SHA1 Message Date
Radosław Piliszek
1ea029a91d Followup on MariaDB handling fixes
This fixes issues reported by Mark:
- possible failure with 4-node cluster (however unlikely)
- failure to stop all nodes from progressing when conditions are
  not valid (due to: "any_errors_fatal: False")

Change-Id: Ib6995bf4c99202c9813859b3d9e2f420448f0445
2020-02-02 16:39:29 +01:00
Zuul
b07267381b Merge "Enable Glance to use Cinder iSCSI backend" 2020-01-27 18:53:55 +00:00
Zuul
0580d00342 Merge "Adds Docker image pruning command" 2020-01-27 16:11:37 +00:00
Dincer Celik
b7728ea890 Adds Docker image pruning command
This change introduces prune-images command.

Uses docker_prune module of Ansible that comes with version 2.8.

Depends-On: https://review.opendev.org/#/c/699333/

Implements: blueprint docker-image-pruning

Change-Id: Icbf374dd50e1cc1f1604bb4fa779b34279efd50c
2020-01-27 13:44:01 +03:00
Zuul
94ec78eccc Merge "Use include_tasks in the storm role" 2020-01-27 08:47:57 +00:00
Christian Berendt
3e11c18232 Rename main.yaml to main.yml in modules-load role
Change-Id: Ib9c13b69b46cdc3e28be127ccd86df9b59bd60e9
2020-01-25 21:47:04 +01:00
Christian Berendt
483565aa0f Use include_tasks in the storm role
Change-Id: I2cf87b67c4dd46fd5003bf8a330abff83477f9f9
2020-01-25 21:45:38 +01:00
Zuul
13dea3f931 Merge "External Ceph: keys as variables" 2020-01-23 12:43:43 +00:00
Michal Nasiadka
1f929336e3 External Ceph: keys as variables
Introduce user modifiable variables instead of fixed-names
of Ceph keyring files for external Ceph functionality.

Change-Id: I1a33b3f9d6eca5babf53b91187461e43aef865ce
2020-01-22 18:16:38 +00:00
Zuul
aed2c052e2 Merge "Start using docker_image_info" 2020-01-22 14:07:42 +00:00
Zuul
39c09d0b60 Merge "Adds maximum supported version check for Ansible" 2020-01-22 13:36:34 +00:00
Zuul
67a9d289b4 Merge "Fix multiple issues with MariaDB handling" 2020-01-21 09:29:59 +00:00
Zuul
5126087af5 Merge "CentOS 8: Support variable image tag suffix" 2020-01-21 09:29:58 +00:00
Zuul
91c3dfe91c Merge "Ansible lint: disable some checks" 2020-01-18 08:30:57 +00:00
Marcin Juszkiewicz
934fea1aac Ansible lint: disable some checks
204 for very long url which is hard to break safely
306 for "echo | docker" as echo should not fall

Change-Id: I14df39d611d39ad1f6184ab92d628cb010881fbb
2020-01-17 13:51:43 +00:00
Marcin Juszkiewicz
1453474c65 Ansible lint: Variables should have spaces before and after
Change-Id: I70f692f125739b5119c71a554a37b5c21d4164f6
2020-01-16 16:37:20 +01:00
Zuul
2c2eeb8159 Merge "Configure services to use Certificate Authority" 2020-01-15 22:16:30 +00:00
Radosław Piliszek
9f14ad651a Fix multiple issues with MariaDB handling
These affected both deploy (and reconfigure) and upgrade
resulting in WSREP issues, failed deploys or need to
recover the cluster.

This patch makes sure k-a does not abruptly terminate
nodes to break cluster.
This is achieved by cleaner separation between stages
(bootstrap, restart current, deploy new) and 3 phases
for restarts (to keep the quorum).

Upgrade actions, which operate on a healthy cluster,
went to its section.

Service restart was refactored.

We no longer rely on the master/slave distinction as
all nodes are masters in Galera.

Closes-bug: #1857908
Closes-bug: #1859145
Change-Id: I83600c69141714fc412df0976f49019a857655f5
2020-01-15 20:15:09 +01:00
chenxing
fa49b2692d Enable Glance to use Cinder iSCSI backend
To use an iSCSI Cinder backend as its store, glance_api must run
privileged and have /dev and /etc/iscsi properly mounted

Co-authored-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
Change-Id: I988d3c9d0564483440ae17203ad88a8049abbea4
Closes-Bug: #1855695
2020-01-15 17:57:40 +00:00
Zuul
7671384919 Merge "Ansible lint: task names - horizon" 2020-01-15 15:04:53 +00:00
Zuul
e5ba7adc5f Merge "External Ceph: copy also cinder keyring to nova services" 2020-01-15 13:22:05 +00:00
Dincer Celik
99fd67b0d8 Start using docker_image_info
docker_image_facts has been deprecated.

[1] https://docs.ansible.com/ansible/2.8/modules/docker_image_facts_module.html

Depends-On: https://review.opendev.org/#/c/699333/
Change-Id: I4556e603ec501f9bdaab5f20cee754467129c4e9
2020-01-15 00:09:22 +03:00
Michal Nasiadka
71d4c697cd External Ceph: copy also cinder keyring to nova services
Since [1] nova-compute uses rbd python library instead of libvirt to cleanup
volumes and get pool info - so it requires cinder keyring on filesystem.

In external ceph case it is often that nova key does not exist (is simply a copied
cinder key) and the rbd user is set to cinder - therefore the earlier mentioned
operations will fail due to a missing keyring on the filesystem.

[1]: https://review.opendev.org/#/c/668564/

Change-Id: Idef21dc5f7e9ff512bc8920630a3de61a1e69eee
Backport: train
Closes-Bug: #1859408
2020-01-14 15:59:07 +00:00
Michal Nasiadka
9385911398 Ansible lint: task names - horizon
Change-Id: I1f8d80d2c655f15b8591aea95af81263581ebaaf
2020-01-14 14:08:15 +01:00
Zuul
a4e7a13ac7 Merge "Ansible lint: use command module instead of shell" 2020-01-14 10:31:30 +00:00
Zuul
4afb1841cd Merge "Ansible lint: version constraints for pip and docker" 2020-01-14 10:31:29 +00:00
Zuul
b26ddaad17 Merge "Ansible lint: set -o pipefail when shell pipes used" 2020-01-14 10:31:27 +00:00
Zuul
3d40661630 Merge "Ansible lint: task names" 2020-01-14 10:31:13 +00:00
Zuul
2cc4f8325e Merge "Ansible lint: whitespace" 2020-01-14 10:31:12 +00:00
Zuul
3751dce25a Merge "Ansible lint: remove comparison with true or false" 2020-01-14 10:31:11 +00:00
Zuul
61266a63e3 Merge "Fix fernet-node-sync error catching" 2020-01-14 10:31:09 +00:00
James Kirsch
c15dc20341 Configure services to use Certificate Authority
Include a reference to the globally configured Certificate Authority to
all services. Services use the CA to verify HTTPs connections.

Change-Id: I38da931cdd7ff46cce1994763b5c713652b096cc
Partially-Implements: blueprint support-trusted-ca-certificate-file
2020-01-13 11:00:11 -08:00
Zuul
13d668d22c Merge "Fix Zun Docker runtime selection" 2020-01-13 14:14:33 +00:00
Michal Nasiadka
72afbcec4e Fix fernet-node-sync error catching
Backport: train stein rocky
Depends-On: https://review.opendev.org/701779
Related-Bug: #1859047
Change-Id: I09844e0807a93d9edd8d014276b0174d77a993a0
2020-01-13 12:42:56 +00:00
Zuul
734892ea45 Merge "Use distro_python_version in fernet-node-sync" 2020-01-13 11:36:02 +00:00
Mark Goddard
5fb10e08fe Ansible lint: use command module instead of shell
Change-Id: Ibf40216b847f103e383f19fe1ef608a75fcfd452
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2020-01-13 10:45:10 +00:00
Mark Goddard
b0b0bd59cb Ansible lint: version constraints for pip and docker
Change-Id: Iede314c1a93b91bf14f0f8b9b8135f88a44e130c
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2020-01-13 10:43:18 +00:00
Mark Goddard
10c1669364 Ansible lint: set -o pipefail when shell pipes used
Change-Id: I3d0047d24b6daf35f30bd3429428e83b448e6414
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2020-01-13 10:43:18 +00:00
Mark Goddard
a6cb008c54 Ansible lint: task names
Change-Id: Iecbc2fe5fa3391dca5a3cc7e575314b95942114b
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2020-01-13 10:38:12 +00:00
Mark Goddard
fe217e98c0 Ansible lint: whitespace
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>

Change-Id: I65d9604d8522f0a60fbfeea718a63866410768b6
2020-01-13 10:38:04 +00:00
Mark Goddard
9e3c774371 Ansible lint: remove comparison with true or false
Change-Id: I3caa4581ba276082e859f18aaa6638472f5fbe49
Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2020-01-13 10:33:43 +00:00
Radosław Piliszek
5e8431e0cc Fix Zun Docker runtime selection
Per [1] Docker uses API version 1.26 since daemon version 1.13.1.
Kolla Ansible forced a limit on the Docker API version reported
to Zun of 1.24 which was surprising users and preventing
usage of Docker runtime selection via Zun.
The default of Zun is 1.26 [2] which enables runtime selection.
Zun does not use this parameter for anything else atm.

[1] https://docs.docker.com/engine/api/v1.26/#section/Versioning
[2] https://review.opendev.org/490794

Change-Id: Ide6eb4c2b079cf35e633ad6a04db1587e40e7633
Closes-bug: #1859176
2020-01-10 21:06:15 +01:00
Michal Nasiadka
4072a3ebff Use distro_python_version in fernet-node-sync
Since Debian and Ubuntu are already on Python3 only and don't have unversioned
Python binaries (no /usr/bin/python) - we need to call the fetch-fernet-tokens
script using distro_python_version

Backport: train
Related-Bug: #1859047
Change-Id: I42378af9b25f14079fc57b4068ab25d5d4877362
2020-01-10 14:31:00 +00:00
Doug Szumski
1917d1a9f5 Use kolla_logs volume for Elasticsearch
This patch mounts the kolla_logs volume into the Elasticsearch
container so that logs are no longer written to the container
filesystem. It is up to the user to migrate any existing logs
into the kolla_logs volume, if they so desire.

Closes-Bug: #1859162
Change-Id: Ia1743e202e310fc88a61476c80eadf3855256c20
2020-01-10 13:08:09 +00:00
Mark Goddard
9755c924be CentOS 8: Support variable image tag suffix
For the CentOS 7 to 8 transition, we will have a period where both
CentOS 7 and 8 images are available. We differentiate these images via a
tag - the CentOS 8 images will have a tag of train-centos8 (or
master-centos8 temporarily).

To achieve this, and maintain backwards compatibility for the
openstack_release variable, we introduce a new 'openstack_tag' variable.
This variable is based on openstack_release, but has a suffix of
'openstack_tag_suffix', which is empty except on CentOS 8 where it has a
value of '-centos8'.

Change-Id: I12ce4661afb3c255136cdc1aabe7cbd25560d625
Partially-Implements: blueprint centos-rhel-8
2020-01-10 09:56:04 +00:00
Dincer Celik
63ab53195c Adds maximum supported version check for Ansible
Maximum supported version is set to 2.9

Updated the minimum supported version to 2.8

Implements: blueprint ansible-max-version

Change-Id: I97cc95e37f49886e6d74f2d5a789b923b14b5a2d
2020-01-09 09:54:22 +03:00
Zuul
6dde7ce833 Merge "Adds monasca-ui to horizon" 2020-01-08 16:27:10 +00:00
Zuul
03bd2e8fda Merge "Change Manila cephfs driver" 2020-01-08 15:36:41 +00:00
Mark Goddard
350bb171ef Configure Cinder to use lioadm on CentOS/RHEL 8
In CentOS/RHEL 8 there is no scsi-target-utils package, nor is it
available in EPEL. It is removed from kolla in [1]. In RHEL 7 and beyond
the LIO kernel subsystem can be used instead of the tgtd daemon.

This change removes support for the SCSI target daemon on CentOS/RHEL 8.
The 'tgtd' image is no longer available for CentOS/RHEL 8.

[1] https://review.openstack.org/#/c/613815/5

Change-Id: I718fc16cde2dd177b2a1c2f79b932426034897fe
Related: blueprint centos-rhel-8
2020-01-08 10:39:54 +00:00
Michal Nasiadka
d512ba409d Change Manila cephfs driver
Currently used cephfs driver have been deprecated in Pike [1], change to use
the proper one.

[1]: https://opendev.org/openstack/manila/src/branch/master/releasenotes/notes/rename-cephfs-native-driver-3d9b4e3c6c78ee98.yaml

Closes-Bug: #1858773
Change-Id: I33bea1d0049accd48c61f85c1165bee1e1cf0c87
2020-01-08 11:00:20 +01:00