12419 Commits

Author SHA1 Message Date
Doug Szumski
82cf40edf2 Remove Monasca Grafana service
In the Xena cycle it was decided to remove the Monasca
Grafana fork due to lack of maintenance. This commit removes
the service and provides a limited workaround using the
Monasca Grafana datasource with vanilla Grafana.

Depends-On: I9db7ec2df050fa20317d84f6cea40d1f5fd42e60
Change-Id: I4917ece1951084f6665722ba9a91d47764d3709a
2021-04-27 11:06:25 +00:00
Doug Szumski
8a1e9e984b Add Monasca Grafana deprecation notice
Change-Id: I04bafaebba44d162adb908839cdad6f5bb6ee8f7
2021-04-27 10:13:00 +01:00
Zuul
4579b76d89 Merge "[doc] fix a typo" 2021-04-26 14:56:59 +00:00
Zuul
a3233552cf Merge "Avoid an Ansible quirk in hacluster role" 2021-04-26 10:36:41 +00:00
wuchunyang
fc406d035d [doc] fix a typo
Trivial Fix

Change-Id: Ie08877e339455bed45ee467a87de9648678e88c5
2021-04-26 17:02:51 +08:00
Zuul
9d0734f99d Merge "docs: Improve policy documentation" 2021-04-26 07:43:51 +00:00
Zuul
2be34edb93 Merge "Add global tag variables for Panko and Skydive" 2021-04-26 07:43:38 +00:00
Michał Nasiadka
d9b21cde93 Bump up python version for Debian Bullseye
Depends-On: https://review.opendev.org/c/openstack/kolla/+/772479
Change-Id: I7ae919875fb9dea756ca26d90dc1af791ac766ce
2021-04-24 21:45:34 +00:00
Radosław Piliszek
f3da3d8e19 Avoid an Ansible quirk in hacluster role
Followup on I91e5c1840ace8f567daf462c4eb3ec1f0c503823

When+run_once do not play nicely. [1]
The general workaround is to use include_tasks. [2]
However, it is very unlikely user wishes to run this role
without having any pacemaker nodes so the simplification that we
use throughout the Kolla Ansible code should be enough.

[1] https://github.com/ansible/ansible/issues/11496
[2] https://github.com/ansible/ansible/issues/11496#issuecomment-412936547

Change-Id: Ifaf64e3d9d89b2ec36a883fb7458556745b64802
2021-04-24 18:34:27 +00:00
51134fb311 Add Python3 xena unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for xena.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I6750cf0f2f6941b6b47bad1246e2eae887ae9ee8
2021-04-23 12:40:53 +00:00
9cfd4f5d05 Update master for stable/wallaby
Add file to the reno documentation build to show release notes for
stable/wallaby.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/wallaby.

Sem-Ver: feature
Change-Id: I34e6b2e1b9411e360994684f62414703f3bb2299
2021-04-23 12:40:49 +00:00
Zuul
058dd6828d Merge "Apply Zun configuration for Docker based on inventory" 2021-04-21 13:09:13 +00:00
Mark Goddard
5c39810de2 Apply Zun configuration for Docker based on inventory
If docker_configure_for_zun is set to true, then Zun-specific
configuration for Docker is applied to all nodes. It should only be
applied based on the relevant inventory groups. In some cases this can
cause Docker to fail to start. See
https://storyboard.openstack.org/#!/story/2008544 for details.

This change applies the configuration based on the zun-compute and
zun-cni-daemon groups. It also modifies the expression to not assume
that these groups exist in the inventory.

Change-Id: I0141abf0dd83e3a567ea6dcca945f86db129becf
Closes-Bug: #1914378
Story: 2008544
Task: 41645
Co-Authored-By: Buddhika Sanjeewa <bsanjeewa@kln.ac.lk>
2021-04-21 10:42:55 +00:00
Zuul
980dd33721 Merge "mariadb: Deprecate wsrep-notify.sh" 2021-04-21 09:50:44 +00:00
Zuul
cddb9f2152 Merge "[doc] introduce octavia tenant management network" 2021-04-20 09:06:26 +00:00
wuchunyang
3ba06b87ea [doc] introduce octavia tenant management network
Change-Id: I713f6fafe328e060a71dbb584e61603e547deaf6
2021-04-19 10:44:27 +00:00
Michał Nasiadka
63405a4728 Tidy up Wallaby renos
Change-Id: Idad2d4f8bf5f54c57d2c5fccbf6eff7d54f040dd
2021-04-19 11:40:15 +01:00
Doug Szumski
d01192c160 Extend support for custom Grafana dashboards
The current behaviour is to support supplying a single
folder of Grafana dashboards which can then be populated
into a single folder in Grafana. Some users may wish
to have sub-folders of Dashboards, and load these into
separate dashboard folders in Grafana via a custom
provisioning file. For example, a user may have a
sub-folder of Ceph dashboards that they wish to keep
separate from OpenStack dashboards. This patch supports
sub-folders whilst not affecting the original mechanism.

Trivial-Fix

Change-Id: I9cd289a1ea79f00cee4d2ef30cbb508ac73f9767
2021-04-19 11:11:43 +01:00
Mark Goddard
030a9a28d7 docs: Improve policy documentation
Change-Id: Iede747ceaafa54a00186761943fe2f4ac13f9559
2021-04-19 09:39:51 +00:00
Michał Nasiadka
451844ac67 mariadb: Deprecate wsrep-notify.sh
Change-Id: I14376dac46809f8bb466ec41f279be8d323d459d
2021-04-15 08:12:31 +00:00
Zuul
0b5089ed5a Merge "masakari: support host monitor" 2021-04-14 20:02:30 +00:00
Michal Arbet
5d17100118 Additional small changes in role/mariadb
- Replace hardcoded haproxy monitor user with variable.
 - Rename mariadb_backup variable to mariadb_backup_possible.
 - Drop creation of monitor user in handlers as this is
   now handled in register.yml for good reason.

Change-Id: I255a79d36ae18ca42d0befd00b235ca509197db3
2021-04-14 16:10:30 +02:00
Michał Nasiadka
d7a9be84d4 mariadb: Disable wsrep-notify script if clustercheck enabled
Change-Id: Id16ec7d7b57630ae20430675c4a196e63ca8d4a5
2021-04-14 09:46:20 +00:00
LinPeiWen
1ddef85973 Use Docker healthchecks for rabbitmq services
This change enables the use of Docker healthchecks for rabbitmq services.

Implements: blueprint container-health-check
Depends-On: https://review.opendev.org/c/openstack/kolla/+/784562

Change-Id: I23a2c2efab858b9ed39c6ce0ec4a82df10e7f93d
2021-04-14 05:47:13 +00:00
Zuul
09fcfe8cd2 Merge "octavia: Add support for disabling amphora provider" 2021-04-13 10:12:27 +00:00
Michał Nasiadka
810c4d9471 octavia: Add support for disabling amphora provider
Change-Id: I1010ee42aaf1c650d9e3b5332ebf828646a6badf
2021-04-12 14:41:00 +00:00
Zuul
fd7512b070 Merge "Add HAcluster Ansible role" 2021-04-09 17:59:51 +00:00
Zuul
d4db69c079 Merge "Refactor mariadb to support shards" 2021-04-09 14:23:54 +00:00
Zuul
2aef63e10a Merge "OVN: Make OVS db entries idempotent" 2021-04-09 13:20:56 +00:00
Zuul
c15ca43489 Merge "CI: Use 5G loop device for ceph" 2021-04-08 17:37:45 +00:00
Mark Goddard
db517a44e4 masakari: support host monitor
Change-Id: I3f43df7766c57622ab8d01a759fbeeef0a0c2b93
Implements: blueprint masakari-hostmonitor
Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2021-04-08 16:39:47 +00:00
Michal Arbet
22a6765f5e Support editable installation in all cases
An editable installation allows changes to be made to the source code
directly, and have those changes applied immediately without having to
reinstall.

    pip install -e /path/to/kolla-ansible

Above is currently working only in virtualenv, but there is no reason to
not allow in all cases. This is usefull for example when user is
building his own docker container with editable kolla-ansible installed
from git without virtualenv.

Change-Id: I185f7c09c3f026fd6926a26001393f066ff1860d
2021-04-08 12:31:00 +00:00
Zuul
ca5cd38738 Merge "CI: pull images before deploy" 2021-04-08 11:27:36 +00:00
Zuul
f49f9909ca Merge "Drop the NTP service precheck" 2021-04-08 09:53:41 +00:00
Michał Nasiadka
8dcb56f584 CI: pull images before deploy
It will allow us to fail fast when pulling the image
is a problem - instead of failing in the middle of
deployment.

Change-Id: I017cddcfbbc5449e63d807385216b94e74503c9b
2021-04-08 08:52:54 +00:00
Zuul
052d57a3c4 Merge "Nit fixes for change 776219" 2021-04-08 08:07:19 +00:00
Gaëtan Trellu
9f578c85e0 Add HAcluster Ansible role
Adds HAcluster Ansible role. This role contains High Availability
clustering solution composed of Corosync, Pacemaker and Pacemaker Remote.

HAcluster is added as a helper role for Masakari which requires it for
its host monitoring, allowing to provide HA to instances on a failed
compute host.

Kolla hacluster images merged in [1].

[1] https://review.opendev.org/#/c/668765/

Change-Id: I91e5c1840ace8f567daf462c4eb3ec1f0c503823
Implements: blueprint ansible-pacemaker-support
Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
Co-Authored-By: Mark Goddard <mark@stackhpc.com>
2021-04-08 06:39:19 +00:00
Michal Arbet
09b3c6ca07 Refactor mariadb to support shards
Kolla-ansible is currently installing mariadb
cluster on hosts defined in group['mariadb']
and render haproxy configuration for this hosts.

This is not enough if user want to have several
service databases in several mariadb clusters (shards).

Spread service databases to multiple clusters (shards)
is usefull especially for databases with high load
(neutron,nova).

How it works ?

It works exactly same as now, but group reference 'mariadb'
is now used as group where all mariadb clusters (shards)
are located, and mariadb clusters are installed to
dynamic groups created by group_by and host variable
'mariadb_shard_id'.

It also adding special user 'shard_X' which will be used
for creating users and databases, but only if haproxy
is not used as load-balance solution.

This patch will not affect user which has all databases
on same db cluster on hosts in group 'mariadb', host
variable 'mariadb_shard_id' is set to 0 if not defined.

Mariadb's task in loadbalancer.yml (haproxy) is configuring
mariadb default shard hosts as haproxy backends. If mariadb
role is used to install several clusters (shards), only
default one is loadbalanced via haproxy.

Mariadb's backup is working only for default shard (cluster)
when using haproxy as mariadb loadbalancer, if proxysql
is used, all shards are backuped.

After this patch will be merged, there will be way for proxysql
patches which will implement L7 SQL balancing based on
users and schemas.

Example of inventory:

[mariadb]
server1
server2
server3 mariadb_shard_id=1
server4 mariadb_shard_id=1
server5 mariadb_shard_id=2
server6 mariadb_shard_id=3

Extra:
wait_for_loadbalancer is removed instead of modified as its role
is served by check already. The relevant refactor is applied as
well.

Change-Id: I933067f22ecabc03247ea42baf04f19100dffd08
Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2021-04-07 23:19:42 +02:00
Doug Szumski
19095475ee Nit fixes for change 776219
Minor corrections to doc and release note.

Change-Id: I8a90cbac0b9a1eaa5f6c02271515f2357547f908
2021-04-07 16:18:11 +00:00
Mark Goddard
0b0dd35837 masakari: fix minor issues with instance monitor
* Don't generate masakari.conf for instance monitor
* Don't generate masakari-monitors.conf for API or engine
* Use a consistent name for dimensions -
  masakari_instancemonitor_dimensions
* Fix source code paths in dev mode

Change-Id: I551f93c9bf1ad6712b53c316074ae1df84e4352b
2021-04-07 13:28:01 +00:00
Zuul
0d153af87f Merge "Fix cyborg api doesn't listen on api interface" 2021-04-07 09:54:15 +00:00
Zuul
06047a36ff Merge "CI: Move to centos-8-stream" 2021-04-06 21:39:42 +00:00
Radosław Piliszek
43f68d948e CI: Move to centos-8-stream
Co-Authored-By: Michal Nasiadka <mnasiadka@gmail.com>

Change-Id: I413f484d60d7cdfa03f3f8d779f07462be15d2dd
2021-04-06 16:13:09 +00:00
Michał Nasiadka
6f38d7036c CI: Use 5G loop device for ceph
Often cephadm jobs fail with:
Mar 30 13:01:21 primary bash[75459]: debug 2021-03-30T13:01:21.844+0000 7fa30431f700 -1 error: monitor data filesystem reached concerning levels of available storage space (available: 4% 1.8 GiB)

Let's check if 5G OSD helps and also print df -h output for reference

Change-Id: I6960fd0f378aea5a14a73d9228edf86fb86cac6c
2021-04-06 16:10:12 +00:00
Zuul
9ccb941a5a Merge "Deprecate and disable chrony by default" 2021-04-06 13:46:41 +00:00
Zuul
01859ade96 Merge "Use Docker healthchecks for vitrage services" 2021-04-06 13:17:39 +00:00
Radosław Piliszek
04315751a4 Drop the NTP service precheck
We can't check this with timedatectl as it is not aware
of any "non-native" NTP daemon.

This could be a warning-level message but we don't have
such messages from the prechecks.

Closes-Bug: #1922721
Change-Id: I6db37576118cf5cff4ba7a63e179f0ab37467d22
2021-04-06 12:24:15 +00:00
Radosław Piliszek
e548b5969d [CI] Save systemctl info
Change-Id: Ia08b0372110ee366f4c48c5ea3bc95db0edbbe31
2021-04-06 11:20:07 +00:00
Radosław Piliszek
b647cb4128 Deprecate and disable chrony by default
Per [1].

[1] http://lists.openstack.org/pipermail/openstack-discuss/2021-February/020707.html

Change-Id: Id6f3cd158bf5d01750971249b11364b6a8631789
Closes-Bug: #1885689
2021-04-06 09:17:51 +00:00
Radosław Piliszek
9c045aee36 [CI] Use images from quay.io
Based on the discussions from the past 3 Kolla meetings [1][2][3],
we established that, to avoid the DockerHub pull limit issues
in our CI, we will try using quay.io.

The images have already been published via Kolla CI
for master/Wallaby [4] and Victoria [5].

This change applies only to CI.
The user-facing move is yet to be discussed.

[1] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-17-15.00.log.html#l-102
[2] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-24-15.00.log.html#l-137
[3] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-31-15.01.log.html#l-50
[4] https://review.opendev.org/c/openstack/kolla/+/781130
[5] https://review.opendev.org/c/openstack/kolla/+/781899

Change-Id: I22e11a994801447526ac26fc2815a1679876225e
2021-04-02 13:57:24 +00:00