688 Commits

Author SHA1 Message Date
Mark Goddard
edc918313d CI: allow Elasticsearch status to be green or yellow
It has been seen to go green, so allow this.

Change-Id: Id86b95dbba3434b16f3d0c11485a0d8601833cbf
2021-05-11 13:17:18 +00:00
Mark Goddard
ec36eb016c CI: Fix nfv job with kolla dependency
Change-Id: Ifb3e51891de33e5d698571b898f7a471cfe89718
2021-05-06 08:46:44 +00:00
Radosław Piliszek
c3afbd3c5e Check config when checking the containers
The proposed approach allows for checking whether config
files are current, e.g. cases when the deployment was aborted after
config files were generated but before they were injected into the
containers which lead to old config staying in containers.

After this patch we can do:
  kolla-ansible genconfig
  kolla-ansible deploy-containers
and it would do what we expected rather than being a noop
in the second part.

We also lose the need to have notifies
and whens in config and handler sections respectively.
This is optimised in a separate patch.

Future work:
- optimise for large files
  - could we get away with comparing timestamps and sizes?
    container's should have a newer timestamp due to copy,
    could also preserve it

Change-Id: I1d26e48e1958f13b854d8afded4bfba5021a2dec
Closes-Bug: #1848775
Depends-On: https://review.opendev.org/c/openstack/kolla/+/773257
Co-Authored-By: Mark Goddard <mark@stackhpc.com>
2021-04-27 17:53:40 +00:00
Zuul
0b5089ed5a Merge "masakari: support host monitor" 2021-04-14 20:02:30 +00:00
Zuul
fd7512b070 Merge "Add HAcluster Ansible role" 2021-04-09 17:59:51 +00:00
Zuul
c15ca43489 Merge "CI: Use 5G loop device for ceph" 2021-04-08 17:37:45 +00:00
Mark Goddard
db517a44e4 masakari: support host monitor
Change-Id: I3f43df7766c57622ab8d01a759fbeeef0a0c2b93
Implements: blueprint masakari-hostmonitor
Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2021-04-08 16:39:47 +00:00
Zuul
ca5cd38738 Merge "CI: pull images before deploy" 2021-04-08 11:27:36 +00:00
Michał Nasiadka
8dcb56f584 CI: pull images before deploy
It will allow us to fail fast when pulling the image
is a problem - instead of failing in the middle of
deployment.

Change-Id: I017cddcfbbc5449e63d807385216b94e74503c9b
2021-04-08 08:52:54 +00:00
Gaëtan Trellu
9f578c85e0 Add HAcluster Ansible role
Adds HAcluster Ansible role. This role contains High Availability
clustering solution composed of Corosync, Pacemaker and Pacemaker Remote.

HAcluster is added as a helper role for Masakari which requires it for
its host monitoring, allowing to provide HA to instances on a failed
compute host.

Kolla hacluster images merged in [1].

[1] https://review.opendev.org/#/c/668765/

Change-Id: I91e5c1840ace8f567daf462c4eb3ec1f0c503823
Implements: blueprint ansible-pacemaker-support
Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
Co-Authored-By: Mark Goddard <mark@stackhpc.com>
2021-04-08 06:39:19 +00:00
Michał Nasiadka
6f38d7036c CI: Use 5G loop device for ceph
Often cephadm jobs fail with:
Mar 30 13:01:21 primary bash[75459]: debug 2021-03-30T13:01:21.844+0000 7fa30431f700 -1 error: monitor data filesystem reached concerning levels of available storage space (available: 4% 1.8 GiB)

Let's check if 5G OSD helps and also print df -h output for reference

Change-Id: I6960fd0f378aea5a14a73d9228edf86fb86cac6c
2021-04-06 16:10:12 +00:00
Zuul
9ccb941a5a Merge "Deprecate and disable chrony by default" 2021-04-06 13:46:41 +00:00
Radosław Piliszek
e548b5969d [CI] Save systemctl info
Change-Id: Ia08b0372110ee366f4c48c5ea3bc95db0edbbe31
2021-04-06 11:20:07 +00:00
Radosław Piliszek
b647cb4128 Deprecate and disable chrony by default
Per [1].

[1] http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020707.html

Change-Id: Id6f3cd158bf5d01750971249b11364b6a8631789
Closes-Bug: #1885689
2021-04-06 09:17:51 +00:00
Radosław Piliszek
9c045aee36 [CI] Use images from quay.io
Based on the discussions from the past 3 Kolla meetings [1][2][3],
we established that, to avoid the DockerHub pull limit issues
in our CI, we will try using quay.io.

The images have already been published via Kolla CI
for master/Wallaby [4] and Victoria [5].

This change applies only to CI.
The user-facing move is yet to be discussed.

[1] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-17-15.00.log.html#l-102
[2] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-24-15.00.log.html#l-137
[3] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-31-15.01.log.html#l-50
[4] https://review.opendev.org/c/openstack/kolla/+/781130
[5] https://review.opendev.org/c/openstack/kolla/+/781899

Change-Id: I22e11a994801447526ac26fc2815a1679876225e
2021-04-02 13:57:24 +00:00
Zuul
968534cf8d Merge "[CI] Drop the workaround in Masakari client calls" 2021-03-26 09:54:17 +00:00
Zuul
d1e7964a8d Merge "Add missing octavia-driver-agent" 2021-03-24 19:12:02 +00:00
Michal Nasiadka
7a066f7154 Add missing octavia-driver-agent
For using 3rd party Octavia providers (such as OVN provider) an
octavia-driver-agent container must be running to expose those providers to
use.

OVN CI job has been extended with deploying Octavia and testing OVN Load
Balancer.

Closes-Bug: #1903506
Depends-On: https://review.opendev.org/c/openstack/kolla/+/771191

Change-Id: Ibafa8b7307981f2a51e630cc113d18af6162171c
2021-03-24 16:36:44 +00:00
Radosław Piliszek
c0ba63adad [CI] Drop the workaround in Masakari client calls
Now that the issue is fixed upstream, let's remove the workaround.

[1] If3943060b5d09bd153b6401d34c7d10d3dc864fe

Change-Id: I9cbeee5a397d736338ff2065001d9d6be20cb66e
2021-03-24 15:51:22 +00:00
Michal Arbet
fa94cfd281 [CI] Fix broken docker registry
This patch fixes CI broken by the following patches:
- https://review.opendev.org/c/openstack/kolla-ansible/+/689870
- https://review.opendev.org/c/openstack/kolla-ansible/+/751795

Co-Authored-By: Vladislav Belogrudov <vladislav.belogrudov@dell.com>
Change-Id: If26a9f9791ce9b7817bcd410ea045d3e3b04b651
2021-03-19 14:37:12 +00:00
Zuul
610dead041 Merge "Upgrade service configuration for ELK 7" 2021-03-17 15:03:58 +00:00
Doug Szumski
c2e08be414 Upgrade service configuration for ELK 7
ELK 7 requires some minor changes from the existing ELK 6 config.

Depends-On: Icfa3db5788b25f70ee75411dbaf20d8d4a6a734b
Change-Id: I9815d202a77da0477aea43d714a5def8a24724fa
2021-03-16 10:03:53 +00:00
Zuul
067a752206 Merge "Bump up supported Ansible version to 2.10" 2021-03-11 12:30:29 +00:00
Michał Nasiadka
191b46ef40 Reduce number of logs and disable ara HTML report
- Remove /var/log/kolla link to omit uploading the same logs twice
- Remove ARA HTML report (usually takes around 120MB) - can be easily
  generated from the sqlite db

Change-Id: I74cd6d1128689ab2c73f00ee08af3778d7d670a4
2021-03-10 15:16:05 +00:00
Michał Nasiadka
eabdf1e9f9 Introduce nova_libvirt_logging_debug
In order to disable libvirt debug in CI (which takes vast amount of storage)
this change introduces nova_libvirt_logging_debug and disables that in CI.

Change-Id: I90bfd1b300ad3202ea4d139fda6d6beb44c5820f
2021-03-10 15:15:29 +00:00
Michał Nasiadka
1ccccbcf0a Bump up supported Ansible version to 2.10
Min version stays as 2.9

Change-Id: I7ec8c5eb36757248c9aa016dc7d4e495ec5bb635
2021-03-08 11:40:31 +00:00
Pierre Riteau
2b723ead05 Remove whitespace around equal signs in zookeeper.cfg
The merge_configs action plugin is updated with an option to control
whether whitespace should be used around equal signs. The default
remains to use whitespace: only zookeeper.cfg doesn't use them.

This is to avoid issues with the zkCleanup.sh script which expects no
whitespace. The ZooKeeper documentation also uses no whitespace in
configuration file examples.

Change-Id: Ia082a1c002cc4e8b04f7696fdee827b747c6d13f
Closes-Bug: #1917490
2021-03-05 15:12:23 +01:00
Zuul
cef8c8b3de Merge "CI: octavia: create and test a load balancer" 2021-03-05 11:00:56 +00:00
Zuul
f325add2e2 Merge "CI: octavia: remove octavia from magnum scenario" 2021-03-05 11:00:14 +00:00
Zuul
c02a223769 Merge "CI: Move from ceph-ansible to cephadm" 2021-03-05 09:11:32 +00:00
wuchunyang
366ba8526e CI: octavia: create and test a load balancer
Co-Authored-By: Mark Goddard <mark@stackhpc.com>
Change-Id: I20c1d9bddee5a046b521b9378bade2ab50612be0
2021-03-04 09:27:38 +08:00
Zuul
21b9b5092f Merge "[CI] Cinder upgrade testing" 2021-03-03 16:47:27 +00:00
Zuul
933d575bd5 Merge "Revert "CI: Temporarily disable rabbitmq internal tls"" 2021-03-03 16:38:22 +00:00
Mark Goddard
3c5ccb915e CI: octavia: remove octavia from magnum scenario
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/755589
Co-Authored-By: wu.chunyang <wuchunyang@yovole.com>

Change-Id: I489c1ca23d8abc350d3204ecc167d5d93bbbd1d9
2021-03-03 10:54:38 +08:00
Michał Nasiadka
65a16a08e2 CI: Move from ceph-ansible to cephadm
Change-Id: I81a4f8f8b8faa7559740531bb16d8aec7fc23f9b
2021-03-02 17:49:12 +01:00
Michał Nasiadka
a8981a79aa CI: Add ssh retries
Change-Id: I77791d504327ace880d0cc2438af2f8ced66d4eb
2021-02-24 16:42:06 +00:00
Mark Goddard
99db669fb6 CI: Reduce neutron RPC service workers to 1
Change-Id: I48e7fe2a5a585a2e1cab885b4d725dec7e175aea
2021-02-23 09:30:11 +00:00
Michal Nasiadka
a00fec8cc6 CI: Initial jinja2 templates syntax checks
Change-Id: If42b7324b58851a4f0beb3a80c70ca2c9dd729af
2021-02-20 09:37:48 +01:00
Zuul
38a2097935 Merge "[CI] Fix the NFV scenario" 2021-02-16 16:46:16 +00:00
Mark Goddard
455f2c3147 Revert "CI: Temporarily disable rabbitmq internal tls"
This reverts commit ff441c1c0ceb8fc06a17f5db8e460ad00e8db365.

Since RabbitMQ TLS is still not functional in Victoria, it is
not enabled for upgrade jobs.

Change-Id: I575942c8d90441145de78dcb16a2b4c1f172773b
2021-02-16 10:20:42 +00:00
Zuul
f0ff9dfc4c Merge "CI: Add monasca scenario" 2021-02-15 16:46:03 +00:00
Mark Goddard
5fc7707938 CI: fix ceph-ansible installation after cryptography 3.4 release
Installing ceph-ansible in the virtualenv on CentOS 8 fails with:

    ModuleNotFoundError: No module named 'setuptools_rust'

This error appeared following the release of cryptography 3.4, which now
includes Rust code. It can be installed without Rust using a Python
wheel, but only with more recent pip than version 9.0.3 available as RPM
on CentOS 8. The cryptography bug report [1] recommends pip>=19.1.1.

This change upgrades pip in the virtualenv before installing
ceph-ansible.

[1] https://github.com/pyca/cryptography/issues/5753

Change-Id: I47473de6f71c422db2238d653c2d8f379c55e79b
2021-02-11 13:11:41 +00:00
Mark Goddard
3dd6834a61 CI: fix kolla-ansible installation after cryptography 3.4 release
Installing kolla-ansible system-wide on CentOS 8 fails with:

    ModuleNotFoundError: No module named 'setuptools_rust'

This error appeared following the release of cryptography 3.4, which now
includes Rust code. It can be installed without Rust using a Python
wheel, but only with more recent pip than version 9.0.3 available as RPM
on CentOS 8. The cryptography bug report [1] recommends pip>=19.1.1.

This change switches to using pip --user when installing kolla-ansible.

Also fixes an issue with ansible-lint which was failing on
etc/kolla/globals.yml due to a missing space before comments.

[1] https://github.com/pyca/cryptography/issues/5753

Change-Id: Ifaf1948ed5d42eebaa62d7bad375bbfc12b134d5
Closes-Bug: #1915141
2021-02-10 22:01:40 +01:00
likui
341a6ed08e remove unicode from code
Change-Id: Id9110a1f536377cea0386dda6814035d73de13b1
Implements: blueprint remove-unicode
2021-01-23 17:17:50 +08:00
Doug Szumski
47fee115eb CI: Add monasca scenario
Adds the following new Zuul job for testing deployment of Monasca and
associated services:

* kolla-ansible-centos8-source-monasca

All core OpenStack services except for Keystone are disabled to ensure
enough memory is available.

A follow up patch will replace the basic tests here with Tempest.

Co-Authored-By: Doug Szumski <doug@stackhpc.com>

Change-Id: I5d33fd3d7b69798ba0aa23509f7b809065f61c19
2021-01-19 09:25:24 +00:00
Radosław Piliszek
62b8c6b684 [CI] Cinder upgrade testing
To gain visibility into how our upgrades affect existing Cinder
volumes, a new testing path is required.
This patch adds it.

Additionally, it refactors the repeated actions and ensures that
we wait for volume deletions as well.

Change-Id: Ic08d461e6fdf91c378a87860765a489c2f86d690
Related-Bug: #1904062
2020-12-23 18:07:15 +01:00
Kendall Nelson
25b9de91a2 Remove Retired Karbor Support
As announced on the openstack-discuss ML[1], Karbor is retiring
this cycle (Wallaby).

Needed-By: https://review.opendev.org/c/openstack/karbor/+/767032

[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018643.html

Change-Id: I222cf302e507f6a9de0347c79ec536aa7be22bb6
2020-12-22 09:50:49 +00:00
Zuul
f30cf26271 Merge "Remove retired Searchlight support" 2020-12-19 03:36:07 +00:00
Zuul
525bbf3962 Merge "Remove retired Qinling support" 2020-12-18 23:21:57 +00:00
Zuul
ea33a9cde0 Merge "Add support to kolla_docker for tmpfs mounts" 2020-12-16 18:51:19 +00:00