12177 Commits

Author SHA1 Message Date
John Garbutt
70f6f8e4c0 Reduce RabbitMQ busy waiting, lowering CPU load
On machines with many cores, we were seeing excessive CPU load on systems
that were not very busy. With the following Erlang VM argument we saw
RabbitMQ CPU usage drop from about 150% to around 20%, on a system with
40 hyperthreads.

    +S 2:2

By default RabbitMQ starts N schedulers where N is the number of CPU
cores, including hyper-threaded cores. This is fine when you assume all
your CPUs are dedicated to RabbitMQ. Its not a good idea in a typical
Kolla Ansible setup. Here we go for two scheduler threads.
More details can be found here:
https://www.rabbitmq.com/runtime.html#scheduling
and here:
https://erlang.org/doc/man/erl.html#emulator-flags

    +sbwt none

This stops busy waiting of the scheduler, for more details see:
https://www.rabbitmq.com/runtime.html#busy-waiting
Newer versions of rabbit may need additional flags:
"+sbwt none +sbwtdcpu none +sbwtdio none"
But this patch should be back portable to older versions of RabbitMQ
used in Train and Stein.

Note that information on this tuning was found by looking at data from:
rabbitmq-diagnostics runtime_thread_stats
More details on that can be found here:
https://www.rabbitmq.com/runtime.html#thread-stats

Related-Bug: #1846467

Change-Id: Iced014acee7e590c10848e73feca166f48b622dc
2021-06-07 13:18:39 +01:00
Zuul
008ada9062 Merge "[CI] Drop Zuul host groups" 2021-06-02 11:09:26 +00:00
Zuul
45712d5e0d Merge "[CI] Move to Debian Bullseye" 2021-06-02 10:58:06 +00:00
Zuul
f2d42d80f4 Merge "Add support for Debian Bullseye (11) as host distro" 2021-06-02 02:52:30 +00:00
Zuul
667d145ae3 Merge "[docker] Add support for setting CgroupnsMode" 2021-06-02 02:49:39 +00:00
Zuul
70ebc91e7e Merge "Make rabbitmq cluster_partition_handling configurable" 2021-05-31 16:08:40 +00:00
Zuul
13f8fd75db Merge "Trivial if conditional fix in keystone.json" 2021-05-31 14:30:39 +00:00
Radosław Piliszek
e48d0a7fab [CI] Drop Zuul host groups
They are not used.

Change-Id: Icea1a5f882e2e032c22d897efbd1f137536ae580
2021-05-31 12:42:36 +00:00
Michał Nasiadka
278b63a0eb docs: Update Freenode to OFTC
Change-Id: Idaae03612dd7feabd2cdc57e510947328524e98b
2021-05-31 09:51:04 +02:00
Marcin Juszkiewicz
d60c5591c1 [CI] Move to Debian Bullseye
Wallaby upgrades run on Buster.
To be amended in Xena.

Change-Id: I8d3a320c9fb19e18d959c555d16b736b85e010cd
2021-05-30 18:44:38 +00:00
Radosław Piliszek
9a77fb1ca0 Add support for Debian Bullseye (11) as host distro
Makes nova-libvirt container always run in 'host' CgroupnsMode
to ensure it works.

Change-Id: I75105baf434977c68bc5c8ca1f5213e602c52c8c
2021-05-30 18:40:12 +00:00
Radosław Piliszek
95520df094 [docker] Add support for setting CgroupnsMode
This is required to support Debian Bullseye (11) - need to set
nova-libvirt to use 'host' CgroupnsMode.

Change-Id: I40213d4092fa325bcf37bb1fb4437ab125fe328b
2021-05-30 18:28:54 +00:00
Pierre Riteau
bb56861cc5 Use mariadb-server image for mariabackup
The mariadb image was removed in Wallaby, leading to database backup
failures.

Change-Id: I90986e7521779997df2782767bb95efcbd8ef232
Closes-Bug: #1928129
2021-05-28 13:24:11 +02:00
Zuul
99e09537f2 Merge "cinder: fix condition to copy backend TLS certs" 2021-05-28 10:56:48 +00:00
Zuul
af861f98bf Merge "CI: Use PATH to find kolla-ansible script" 2021-05-27 19:49:25 +00:00
Zuul
3b9dafdf29 Merge "Indented two spaces to match the other things in this block" 2021-05-27 15:25:45 +00:00
Pierre Riteau
7d1af053b5 Remove [octavia]/base_url option from neutron.conf
This configuration option was only used by neutron-lbaas, which is now
retired. It should have been added to neutron_lbaas.conf.j2 instead.

Change-Id: Iba591473abf4304413eca0d84e0b2be197c527fc
2021-05-26 15:28:09 +02:00
Zuul
5f9c5dab9a Merge "docs: add code reviews to contributor guide" 2021-05-25 12:34:35 +00:00
Zuul
8d806277f2 Merge "docs: Add note about internal VIP when HAProxy is disabled" 2021-05-25 12:34:17 +00:00
Zuul
4e28adbe6e Merge "docs: update supported OS distros" 2021-05-25 12:33:59 +00:00
Zuul
75a9ef4ad5 Merge "Mariadb shards documentation" 2021-05-25 10:29:13 +00:00
Zuul
b2629bf2ee Merge "CI: only run cells job on changes to nova role" 2021-05-25 10:20:16 +00:00
Mark Goddard
1ea99147c1 CI: Use PATH to find kolla-ansible script
This change also updates the CI test scripts to use PATH to find the
kolla-ansible script, rather than relying on the file in the source
checkout.

Using the script in the source checkout was hiding an issue with pip
install --user, although that has now been fixed in
I5b47a146627d06bb3fe4a747c5f20290c726b0f9.

Related-Bug: #1915527

Change-Id: I2827a657c8716a9c40391c6bdb7ff1a2a9c1260e
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/775586
2021-05-25 10:29:12 +01:00
Zuul
fa4f99950a Merge "CI: Configure IP on a linux bridge instead of OVS br-ex" 2021-05-24 16:58:07 +00:00
Zuul
bf6a14a55d Merge "linters: Mock additional variables in validate-all-file.py" 2021-05-24 16:23:08 +00:00
Michał Nasiadka
337771143b CI: Configure IP on a linux bridge instead of OVS br-ex
OVS upgrade jobs failed due to assigning an IP on the br-ex interface
(which is recycled during OVS upgrade). This change introduces a bridge
and veth pair for Neutron to use.

Change-Id: Ib3bee6e810fb8d31552d4c72c2a1ccae382c51f0
2021-05-24 14:40:30 +00:00
Mark Goddard
1da7158021 linters: Mock additional variables in validate-all-file.py
The linters job started failing, due to a dependency change.

Change-Id: Ibab350ecf6d9551da8e9c8b704693122cec11559
2021-05-24 14:38:55 +01:00
Zuul
1f5a3a288b Merge "CI: add grafana to monasca image list" 2021-05-21 18:50:24 +00:00
Mark Goddard
bbc27b59f0 CI: add grafana to monasca image list
Without this patch, if there is a change to kolla in the dependency tree
then the monasca scenario does not build grafana, and therefore fails
when trying to pull it.

Change-Id: Ic0a5b9ff940c4971a74345b8812683b29c5cedbf
2021-05-21 16:38:39 +01:00
Zuul
5c95fa32b7 Merge "[CI] Log dbus services" 2021-05-21 13:36:16 +00:00
Zuul
798249ae92 Merge "[CI] Save systemctl info" 2021-05-21 13:35:48 +00:00
Radosław Piliszek
fca2c5fe04 [CI] Fix testing in cephadm scenario
One missed previous scenario name occurence turned off OpenStack
testing in multinode scenario.
This patch to fix that.

Change-Id: I58275a2fa1490307858d45855255bb8e3a05043c
2021-05-21 10:01:06 +00:00
Zuul
cc5667db01 Merge "Remove Monasca Grafana service" 2021-05-21 09:42:42 +00:00
Zuul
e9490fc747 Merge "Disable usage collection in Kibana" 2021-05-21 09:42:04 +00:00
Michal Arbet
c99841272f Make rabbitmq cluster_partition_handling configurable
Change-Id: If2fdab2ae0f981d9fcbb0fea7a92fcde325804f8
2021-05-21 10:55:24 +02:00
Zuul
a753d54fc0 Merge "Use Docker healthchecks for qdrouterd services" 2021-05-20 02:57:19 +00:00
Zuul
bb3653b966 Merge "baremetal: Install Docker SDK less than 5.0.0" 2021-05-19 13:23:59 +00:00
Zuul
c009bb907a Merge "CI: Fix nfv job with kolla dependency" 2021-05-19 08:58:29 +00:00
Michał Nasiadka
b053bd8ecf baremetal: Install Docker SDK less than 5.0.0
Docker 5.0.0 [1] dropped requirement for six, but still imports it.

[1]: https://github.com/docker/docker-py/issues/2807

Closes-Bug: #1928915
Change-Id: I726541f4b3fdc357387a44c6a2153593a10bf282
2021-05-19 07:33:35 +00:00
likui
9e9293c5ce Indented two spaces to match the other things in this block
Change-Id: I87bd1cba830bd4c1de0136dd1f6b3636e74d12de
2021-05-19 11:50:59 +08:00
Zuul
66e9a6464d Merge "CI: Disable amphora in OVN jobs" 2021-05-18 09:57:13 +00:00
Michal Arbet
f184f94360 Mariadb shards documentation
Change-Id: Id9a24c54db9a70c777e51ea10504159d5090f9a7
2021-05-17 15:36:30 +02:00
Zuul
bf1968689b Merge "CI: Wait for NTP synced status in systemd" 2021-05-17 09:59:54 +00:00
Michał Nasiadka
bd496808c9 CI: Disable amphora in OVN jobs
Change-Id: Ie9e2463a1b405453c8ae7caaee6ad57e0562ee47
2021-05-17 08:49:17 +00:00
Radosław Piliszek
e8c4b2e1b2 [CI] Log dbus services
Change-Id: I1b113d23ca3267a801409383bf39cda5cbcbb4c3
2021-05-14 13:34:34 +00:00
Michał Nasiadka
e83b5869a3 CI: Wait for NTP synced status in systemd
Debian's ntpd often needs more time to settle and we fail on prechecks.

Change-Id: Id23f40ab7ef75d06bb92973042c9af580ddffeb0
2021-05-14 11:18:30 +00:00
Zuul
c61bee3fb4 Merge "baremetal: Don't start Docker after install on Debian/Ubuntu" 2021-05-14 09:40:04 +00:00
Michał Nasiadka
bc96179195 baremetal: Don't start Docker after install on Debian/Ubuntu
docker-ce on Debian/Ubuntu gets started just after installation, before
baremetal role configures daemon.json - which results in iptables rules
being implemented - but not removed on docker engine restart.

Closes-Bug: #1923203

Change-Id: Ib1faa092e0b8f0668d1752490a34d0c2165d58d2
2021-05-14 09:00:01 +02:00
Michal Arbet
d43642ac37 Trivial if conditional fix in keystone.json
Change-Id: I30988176c8d5a59cf61527af1a43c5d33ba6268d
2021-05-13 15:47:00 +02:00
Zuul
9df0098669 Merge "Disable Alertmanager's peer gossip in non-HA deployments" 2021-05-12 10:54:45 +00:00