10855 Commits

Author SHA1 Message Date
Zuul
b3c8ff59f1 Merge "Copy CA into containers." 2020-02-07 17:25:01 +00:00
Radosław Piliszek
287adab05e CentOS 8: Add deploy jobs in CI
Adds new CI job definitions for CentOS 8:

- kolla-ansible-centos8-source
- kolla-ansible-centos8-binary
- kolla-ansible-centos8-source-ceph-ansible
- kolla-ansible-centos8-source-cinder-lvm
- kolla-ansible-centos8-source-mariadb
- kolla-ansible-centos8-source-bifrost
- kolla-ansible-centos8-source-zun
- kolla-ansible-centos8-source-swift
- kolla-ansible-centos8-source-scenario-nfv
- kolla-ansible-centos8-source-ironic
- kolla-ansible-centos8-binary-ironic
- kolla-ansible-centos8-source-masakari
- kolla-ansible-centos8-source-cells

The following jobs are added to the check pipeline:

- kolla-ansible-centos8-source
- kolla-ansible-centos8-binary
- kolla-ansible-centos8-source-cinder-lvm
- kolla-ansible-centos8-source-mariadb
- kolla-ansible-centos8-source-zun
- kolla-ansible-centos8-source-swift
- kolla-ansible-centos8-source-scenario-nfv
- kolla-ansible-centos8-source-ironic
- kolla-ansible-centos8-binary-ironic
- kolla-ansible-centos8-source-cells

The following jobs are not yet passing so are not added to the check
pipeline:

- kolla-ansible-centos8-source-ceph-ansible
- kolla-ansible-centos8-source-bifrost
- kolla-ansible-centos8-source-masakari

The kolla-ansible-centos8-source job is added to the gate.

Upgrade jobs will be added when CentOS 8 support exists in Train.

Depends-On: https://review.opendev.org/704337
Depends-On: https://review.opendev.org/704848
Depends-On: https://review.opendev.org/704965

Co-Authored-By: Mark Goddard <mark@stackhpc.com>

Change-Id: Ibd806feee71721b122b77d7eff33228ca1cc2853
Partially-Implements: blueprint centos-rhel-8
2020-02-06 11:43:50 +00:00
Radosław Piliszek
5b0894299e CI: Replace cinder-lvm scenario with zun scenario
As discussed during the meeting. [1]

[1] http://eavesdrop.openstack.org/meetings/kolla/2020/kolla.2020-02-05-15.00.html

Change-Id: I339fc7f01f640a32ff35d19ded54b6f8e2fdec15
2020-02-05 18:25:18 +01:00
Zuul
c5b4ca4f1f Merge "Ceph-Ansible upgrade jobs" 2020-02-05 14:47:42 +00:00
Zuul
1160fa3d1c Merge "doc: external Ceph - add manila ceph caps note" 2020-02-05 11:43:02 +00:00
Zuul
4f83be3281 Merge "CI: build swift images for swift scenario" 2020-02-05 10:38:45 +00:00
Zuul
157acea6d5 Merge "CentOS 8: Deploy CentOS 8 containers" 2020-02-05 10:34:06 +00:00
Zuul
36c2201a3b Merge "Fix keystone fernet bootstrap" 2020-02-05 10:31:52 +00:00
Michal Nasiadka
f9046c2dd9 Ceph-Ansible upgrade jobs
Change-Id: Ifc87adbac6bef0aaab2ad0e80739654b3e3123ad
2020-02-05 08:15:29 +00:00
Zuul
ac876459ba Merge "Remove unused python path calculation from vmtp" 2020-02-04 14:10:40 +00:00
Zuul
14a9ec7916 Merge "Python 3: Use distro_python_version for monasca agent CA file" 2020-02-04 14:07:12 +00:00
Zuul
d3055e683e Merge "Python 3: Use distro_python_version for WSGI python_path" 2020-02-04 13:48:01 +00:00
Zuul
666b58b383 Merge "Python 3: Use distro_python_version for dev mode" 2020-02-04 13:40:31 +00:00
Michal Nasiadka
0799782ce8 Fix keystone fernet bootstrap
There are cases when a multinode deployment ends up in unusable
keystone public wsgi on some nodes.

The root cause is that keystone public wsgi doesn't find fernet
keys on startup - and then persists on sending 500 errors to any
requests - due to a race condition between
fernet_setup/fernet-push.sh and keystone startup.

Depends-On: https://review.opendev.org/703742/
Change-Id: I63709c2e3f6a893db82a05640da78f492bf8440f
Closes-Bug: #1846789
2020-02-03 13:41:11 +01:00
Zuul
7de63ac4ec Merge "Followup on MariaDB handling fixes" 2020-02-03 10:06:20 +00:00
Radosław Piliszek
1ea029a91d Followup on MariaDB handling fixes
This fixes issues reported by Mark:
- possible failure with 4-node cluster (however unlikely)
- failure to stop all nodes from progressing when conditions are
  not valid (due to: "any_errors_fatal: False")

Change-Id: Ib6995bf4c99202c9813859b3d9e2f420448f0445
2020-02-02 16:39:29 +01:00
Zuul
b9b8aaa02a Merge "Fix qemu loading of ceph.conf (permission error)" 2020-02-01 12:00:55 +00:00
Zuul
0eb21bf292 Merge "CI: Reduce unnecessary gate image builds" 2020-01-31 22:11:20 +00:00
Ning Yao
91910d2a45 Fix qemu loading of ceph.conf (permission error)
ceph.conf is loaded by qemu, not libvirt.
Since qemu runs as the nova user, ceph.conf owned by root
causes a permission error. The logs in
/var/log/libvirt/qemu/instance-*.log reveal the error.

This change fixes the issue by changing the ownership of ceph.conf
in nova-libvirt to the nova user.

Closes-Bug: #1861513
Change-Id: I1881f51a6c8508f0f186a5623443343dc1df41d4
Signed-off-by: Ning Yao <yaoning@unitedstack.com>
2020-01-31 17:50:50 +01:00
Mark Goddard
72779d4df4 Remove unused python path calculation from vmtp
Its use was removed in If801f54709114b931677adb605dffb75cfab25cd.

Change-Id: I577d74a5971dbdf7e4c8288d5742e8bd340680b0
2020-01-30 14:14:52 +00:00
Mark Goddard
70008536a3 Python 3: Use distro_python_version for monasca agent CA file
Change-Id: Ia840cd037cd2c2eded429bd0edaede4bb44caa8e
Partially-Implements: blueprint python-3
2020-01-30 14:10:41 +00:00
Mark Goddard
c56d273c93 Python 3: Use distro_python_version for WSGI python_path
Currently the WSGI configuration for binary images uses python2.7
site-packages in some places. This change uses distro_python_version to
select the correct python path.

Change-Id: Id5f3f0ede106498b9264942fa0399d7c7862c122
Partially-Implements: blueprint python-3
2020-01-30 14:08:13 +00:00
Mark Goddard
5a786436be Python 3: Use distro_python_version for dev mode
In dev mode currently the python source is mounted under python2.7
site-packages. This change fixes this to use the distro_python_version
variable to ensure dev mode works with Python 3 images.

Change-Id: Ieae3778a02f1b79023b4f1c20eff27b37f481077
Partially-Implements: blueprint python-3
2020-01-30 14:00:34 +00:00
Zuul
6d95d1a29b Merge "Use listen port for Placement precheck" 2020-01-30 13:17:03 +00:00
Mark Goddard
f303202850 CI: build swift images for swift scenario
Change-Id: I957fcea4ab180dd82d1faaa9a012f83d3647f043
2020-01-30 10:59:38 +00:00
Michal Nasiadka
de27891b46 doc: external Ceph - add manila ceph caps note
Change-Id: Iad7347b6bdd34fc99872e1035e673fe69d6c55ea
2020-01-30 11:23:40 +01:00
Michal Nasiadka
ab797c1ae9 doc: fix bullets in external_ceph.rst
Bullets under Cinder paragraph were not properly formatted.

Change-Id: I0626c93435c989447feb257cd24ddc3af2d05851
2020-01-29 17:14:31 +01:00
Michal Nasiadka
fdf3729f83 External Ceph: add ceph_*_user variables
To make the configuration easier for the user, and to allow non-standard
ceph authentication ids - introduce ceph_*_user variables.

Change-Id: I24e01c43c826b62b6748d93a498f4b7d8ce9e309
2020-01-29 11:06:58 +00:00
Jacob Estelle
49b30a267f Use listen port for Placement precheck
Placement only needs its listen port to be free. During the Placement
split from Nova in commit 2fc6d4cfc5 the wrong variable got moved into
precheck for Placement, this fixes it.

Change-Id: I71e3607c50110763259bfcd70ffb2f4c76e27f62
Closes-Bug: #1861189
2020-01-29 10:47:25 +00:00
James Kirsch
511ba9f6a2 Copy CA into containers.
When kolla_copy_ca_into_containers is set to "yes", the Certificate
Authority in /etc/kolla/certificates will be copied into service
containers to enable trust for that CA. This is especially useful when
the CA is self signed, and would not be trusted by default.

Partially-Implements: blueprint custom-cacerts

Change-Id: I4368f8994147580460ebe7533850cf63a419d0b4
2020-01-28 14:03:32 -08:00
Mark Goddard
3b24e566f6 CentOS 8: Deploy CentOS 8 containers
* HAProxy is now 1.8 in CentOS 8
* Support python3 in baremetal role
* Remove support for environments without python2 installed (this could
  not have worked since we gather facts before this point)

Workarounds:

* Using CentOS 7 yum repo for Docker, with module_hotfixes

Change-Id: I30bd3d58f6224ad4c9575ba66c74deabe6895cc4
Partially-Implements: blueprint centos-rhel-8
2020-01-28 16:46:41 +00:00
Mark Goddard
8b86c8194b CI: Reduce unnecessary gate image builds
Due to regex matching of images, we are currently building quite a few
unnecessary images in CI. Images that can unexpectedly match:

* barbican-keystone-listener
* ironic-neutron-agent
* prometheus-haproxy-exporter
* prometheus-memcached-exporter

This change improves the situation by anchoring matches to the start of
the name. A full solution would be to specify every image required for
each job. This would be quite verbose and require maintenance.

Change-Id: I7387ccd0cb394c54c79bfba8b1c09fce7ee2973e
2020-01-28 16:44:27 +00:00
Zuul
4d0c442b88 Merge "CI: Refactor base jobs" 2020-01-27 19:43:47 +00:00
Zuul
b07267381b Merge "Enable Glance to use Cinder iSCSI backend" 2020-01-27 18:53:55 +00:00
Radosław Piliszek
beed12f354 CI: Refactor base jobs
Since Zuul was restarted after applying [1], we can keep relevant
files listings in the base jobs per scenario without blocking
periodic job runs.
This greatly simplifies the jobs and project definitions.

[1] https://review.opendev.org/678273

Change-Id: If2e4fff6a514e6174709c2fc9f76b103f81a54ae
2020-01-27 17:12:48 +01:00
Zuul
2a88e2446c Merge "Add serial to haproxy in site.yml" 2020-01-27 16:11:38 +00:00
Zuul
0580d00342 Merge "Adds Docker image pruning command" 2020-01-27 16:11:37 +00:00
Dincer Celik
b7728ea890 Adds Docker image pruning command
This change introduces prune-images command.

Uses docker_prune module of Ansible that comes with version 2.8.

Depends-On: https://review.opendev.org/#/c/699333/

Implements: blueprint docker-image-pruning

Change-Id: Icbf374dd50e1cc1f1604bb4fa779b34279efd50c
2020-01-27 13:44:01 +03:00
Zuul
b103989642 Merge "CI: Add Ceph-Ansible jobs" 2020-01-27 09:09:13 +00:00
Zuul
94ec78eccc Merge "Use include_tasks in the storm role" 2020-01-27 08:47:57 +00:00
Christian Berendt
3e11c18232 Rename main.yaml to main.yml in modules-load role
Change-Id: Ib9c13b69b46cdc3e28be127ccd86df9b59bd60e9
2020-01-25 21:47:04 +01:00
Christian Berendt
483565aa0f Use include_tasks in the storm role
Change-Id: I2cf87b67c4dd46fd5003bf8a330abff83477f9f9
2020-01-25 21:45:38 +01:00
Zuul
bcc09ed2b4 Merge "doc: move to train in quickstart" 2020-01-25 10:30:18 +00:00
Michal Nasiadka
d8c15ad4e8 CI: Add Ceph-Ansible jobs
* Adding zuul centos-source/ubuntu-source ceph-ansible jobs
* Jobs will deploy all Ceph integrated OpenStack components, i.e.
  cinder, glance, nova
* Will utilize core openstack testing script

Depends-On: https://review.opendev.org/685032
Depends-On: https://review.opendev.org/698301

Implements: blueprint ceph-ansible
Change-Id: I233082b46785f74014177f579aeac887a25b2ae2
2020-01-24 22:37:03 +01:00
Christian Berendt
130614ab73 Add serial to haproxy in site.yml
Change-Id: I2ddc8ce114ebc9754f53866cefbff50e63ed7c7d
2020-01-24 21:29:15 +01:00
Zuul
bd6157cf42 Merge "CI: Add timestamps to Docker container logs" 2020-01-24 13:38:44 +00:00
Marcin Juszkiewicz
01bc852844 doc: move to train in quickstart
Change-Id: I03ee4020cfb277fd3d6c5f5c70a3a6eeee2cac9e
2020-01-24 12:57:53 +01:00
Pierre Riteau
b3facae5ff Update link to Gnocchi website
Change-Id: Idcdf6e3a4c5a751c848eb240b1896605843f8154
2020-01-24 12:39:31 +01:00
Michal Nasiadka
d597cece85 CI: Add timestamps to Docker container logs
Change-Id: Ie5111b898da980d63e9d90003f823172e7a78bc2
2020-01-24 09:59:01 +01:00
Zuul
13dea3f931 Merge "External Ceph: keys as variables" 2020-01-23 12:43:43 +00:00