7018 Commits

Author SHA1 Message Date
Roman Krček
fb3a8f5fa9 Performance: use filters for service dicts
Most roles are not leveraging the jinja filters available.
According to [1] filtering the list of services makes the execution
faster than skipping the tasks.

This patchset also includes some cosmetic changes to genconfig.
Individual services are now also using a jinja filter. This has
no impact on performance, just makes the tasks look cleaner.

Naming of some vars in genconfig was changed to "service" to make
the tasks more uniform as some were previously using
the service name and some were using "service".

Three metrics from the deployment were taken and those were
- overall deployment time [s]
- time spent on the specific role [s]
- CPU usage (measured with perf) [-]
Overall genconfig time went down on avg. from 209s to 195s
Time spent on the loadbalancer role went down on avg. from 27s to 23s
Time spent on the neutron role went down on avg from 102s to 95s
Time spent on the nova-cell role went down on avg. from 54s to 52s
Also the average CPUs utilized reported by perf went down
from 3.31 to 3.15.
For details of how this was measured see the comments in gerrit.

[1] - https://github.com/stackhpc/ansible-scaling/blob/master/doc/skip.md

Change-Id: Ib0f00aadb6c7022de6e8b455ac4b9b8cd6be5b1b
Signed-off-by: Roman Krček <roman.krcek@tietoevry.com>
2024-06-28 09:04:43 +02:00
Zuul
e4d578a390 Merge "Adds option to add extra scrape targets for node exporter" 2024-06-26 21:05:42 +00:00
Zuul
4223c5bf0d Merge "Masakari: Fix incorrect reference to dictionary key." 2024-06-26 19:03:07 +00:00
Will Szumski
582e2490ca Adds option to add extra scrape targets for node exporter
This enables you to scrape external targets more easily.

Change-Id: I55b612d2f5f5a3fc8d21c6d2f71d6c58d89d4e31
2024-06-26 17:44:02 +00:00
Andrew Babbitt
cb90041a98 Skyline: Fix incorrect keystone port
Change the skyline nginx config to point to the internal port.

Closes-Bug: #2069855
Change-Id: Ia29d89b2594a604c687469850a67f7fe29d0eb5d
2024-06-19 14:26:41 -06:00
Zuul
a7311034d2 Merge "Use the running MariaDB server image for backups" 2024-06-18 11:11:42 +00:00
Zuul
99dc1cac8f Merge "RMQ: enable all stable feature flags at once" 2024-06-11 11:05:47 +00:00
jayjahns
52729e6855 Set node to a valid rabbitmq host
If rabbitmq is not on the same host as the nova-controller,
then this task will fail. This change ensures that the
task references an actual rabbitmq host vs the host the
task runs on.

Closes-Bug: 2020805
Change-Id: I1b58f4aeda8c9fe8db1770c63c17bf1c465f3d2a
2024-06-10 15:30:01 -05:00
Zuul
43636d7f34 Merge "Fix trove module imports" 2024-06-05 22:23:33 +00:00
Zuul
3dc261b386 Merge "Fix: Update Skyline stop task" 2024-06-05 15:03:36 +00:00
Zuul
4ab17364e4 Merge "ceilometer: use template for custom pipeline.yaml" 2024-05-16 12:13:16 +00:00
Mark Goddard
667d153ef1 Use the running MariaDB server image for backups
If the container image used by Mariabackup is different than the
one used by MariaDB server, it's possible that mariabackup and mariadb
are incompatible. This may cause backup operations to fail.

This change queries the running MariaDB server container's image and
uses it when taking a backup. If MariaDB server isn't running on the
host it falls back to the image defined in configuration.

The separate mariabackup_image, mariabackup_tag and
mariabackup_image_full variables are no longer required and have been
removed.

Closes-Bug: #2058644
Change-Id: I45f3f90ec1973dae92131ea16a7b248ab7a8ae69
2024-05-16 11:22:36 +01:00
Christian Berendt
bdf60961f0 ceilometer: use template for custom pipeline.yaml
Also rename task to "Copying over custom pipeline.yaml file" for
clarity.

Change-Id: I04e3eb9620830a15781f9bab2549b557a9d1d9cb
2024-05-16 08:11:01 +00:00
Roman Krček
6e06bee66f Fix: Update Skyline stop task
Update Sykline stop task to use the
service-stop role to symplify the task
and make sure it is using kolla_container.

Authored-By: Roman Krček <roman.krcek@tietoevry.com>
Change-Id: I7b11359cee931273a058364160b64fe1fb606b5e
2024-05-15 10:32:48 +02:00
Michal Nasiadka
5aac09c9a2 openvswitch: Stop using intermediate scripts
This will fix exit codes - details in bug.

Basically openvswitch treats TERM as something fatal (exits
with 143) and the only solution for graceful exit is using
ovs-appctl and sending exit command, just like ovs-ctl utility
does.

Depends-On: https://review.opendev.org/c/openstack/kolla/+/905189

Partial-Bug: #2048130
Change-Id: I523018cb98944de60d7b95404deb7cebd641f33a
2024-05-14 10:56:44 +00:00
Michal Nasiadka
4f031961a3 mariadb-clustercheck: Use socat wrapper
Depends-On: https://review.opendev.org/c/openstack/kolla/+/904981

Partial-Bug: #2048130
Change-Id: Ib971b694c12ccb51e0893978dd5962040f2fbd22
2024-05-14 10:56:39 +00:00
Michal Nasiadka
f1331fa887 haproxy: Use -f configdir instead of for and xargs
-f configdir has been supported in HaProxy since 1.7

Partial-Bug: #2048130
Change-Id: Icb95cb072cb3eb5c27ffd79a127069bfcf21a61a
2024-05-14 10:56:31 +00:00
Zuul
cff75f6eac Merge "ironic: mount metrics in conductor only when exporter is enabled" 2024-05-13 13:50:22 +00:00
Matt Crees
223556e4e2 RMQ: enable all stable feature flags at once
Also enable these after an upgrade.

Partial-Bug: #2058512
Change-Id: Ib9bdae2e25c2b6cce30e4c8024015ab5875bc1ff
2024-05-13 13:26:10 +01:00
Michal Nasiadka
031859764a neutron: add service role
After Neutron policy changes - Octavia jobs started
to fail on cascade LB deletion due to Neutron user
not having service role.

Closes-Bug: #2065337

Change-Id: I616bf3a3dbb4d963665b1621a9e5e9d417b13942
2024-05-09 19:22:15 +00:00
Zuul
b382471d02 Merge "loadbalancer: fix upgrade task when podman is used" 2024-05-09 13:31:44 +00:00
Zuul
e4d19abbf2 Merge "Configure Blazar with custom CA file" 2024-05-07 11:21:23 +00:00
Zuul
cfb20ce0ff Merge "Re-add the neutron-fwaas" 2024-04-29 14:51:49 +00:00
Zuul
20b79a59a6 Merge "fix swift keystone auth url" 2024-04-29 13:49:32 +00:00
howardlee
e9794721ab Re-add the neutron-fwaas
neutron-fwaas has become active again

Depends-On: https://review.opendev.org/c/openstack/kolla/+/914855

Change-Id: Ie5a7b2da9a351e8f47a1ae830bb2fee0a8e35e38
2024-04-29 07:43:16 +00:00
Michal Wyszkowski
ca90fb8327 loadbalancer: fix upgrade task when podman is used
Closes-Bug: 2063896
Change-Id: Ie0d6a8f458562eb32171b5fe23b8cd0cd375dcfb
2024-04-27 11:48:25 +02:00
Zuul
55cdf7905d Merge "Drop Vitrage" 2024-04-25 14:26:46 +00:00
Zuul
55cfbf04d0 Merge "Drop Murano" 2024-04-25 14:26:03 +00:00
Zuul
0f02c1a25f Merge "Drop Senlin" 2024-04-25 12:48:32 +00:00
Zuul
553c007e49 Merge "CI: Add codespell to pep8" 2024-04-25 12:16:53 +00:00
Zuul
67a666293b Merge "Drop Sahara" 2024-04-25 09:27:36 +00:00
Zuul
5eb08fe395 Merge "Drop Solum" 2024-04-25 09:27:33 +00:00
Zuul
4080868904 Merge "Drop Freezer" 2024-04-25 09:27:30 +00:00
Michal Nasiadka
ca1fe60fb6 Drop Vitrage
It was deprecated in Antelope cycle.

Change-Id: I499e69ec6db63e4067e49376e2a1f3e01e48fe62
2024-04-25 09:20:51 +00:00
Michal Nasiadka
6c31bb676d Drop Murano
It's inactive and hasn't produced a 2024.1 release [1].
In addition to that, there's a CVE that hasn't really been patched [2].

Also drop outward_rabbitmq that was used only with Murano.

[1]: https://governance.openstack.org/tc/reference/emerging-technology-and-inactive-projects.html#current-inactive-projects
[2]: https://lists.openstack.org/archives/list/openstack-announce@lists.openstack.org/thread/4FYM6GSIM5WZSJQIG4TT5Q3UBKQIHLWX/

Change-Id: I691205730b0e10a42ce61f3340cc39ee51bd1010
2024-04-25 09:20:42 +00:00
Zuul
5e3bfa5462 Merge "Fix 'cinder-backup' service when Swift with TLS enabled" 2024-04-24 17:14:29 +00:00
Zuul
b6fdc983db Merge "Add sysctl role" 2024-04-24 15:24:48 +00:00
Zuul
74b69f6a86 Merge "Update cell0 database connection" 2024-04-24 15:24:46 +00:00
Michal Nasiadka
b3f19f8146 Drop Senlin
It's inactive and hasn't produced a 2024.1 release [1].

[1]: https://governance.openstack.org/tc/reference/emerging-technology-and-inactive-projects.html#current-inactive-projects

Change-Id: I217b3633f07e5b2c657e20b19aaa4fbb46535a97
2024-04-24 16:58:36 +02:00
Michal Nasiadka
d701ae5015 Drop Sahara
It's inactive and hasn't produced a 2024.1 release [1].

[1]: https://governance.openstack.org/tc/reference/emerging-technology-and-inactive-projects.html#current-inactive-projects

Change-Id: I888963751b6e1ed080588297c2889e700431516c
2024-04-24 16:49:14 +02:00
Michal Nasiadka
2edecb82a1 Drop Solum
It's inactive and hasn't produced a 2024.1 release [1].

[1]: https://governance.openstack.org/tc/reference/emerging-technology-and-inactive-projects.html#current-inactive-projects

Change-Id: Ic988295bc5b8acb19df008fe0d52a3bcc6de2135
2024-04-24 16:38:31 +02:00
Michal Nasiadka
d45c632d71 Drop Freezer
It's inactive and hasn't produced a 2024.1 release [1].
There are some efforts to restore Freezer, but let's remove it for now.

[1]: https://governance.openstack.org/tc/reference/emerging-technology-and-inactive-projects.html#current-inactive-projects

Change-Id: Ie42012af9e5c64bca23a6e6826bfc4651fd194bd
2024-04-24 16:17:30 +02:00
Zuul
fadb484185 Merge "Allow overriding of Skyline logos" 2024-04-24 08:18:37 +00:00
Zuul
ab31c6fb3c Merge "Update configuration to enable more services in Skyline Console" 2024-04-23 18:41:40 +00:00
Uwe Jäger
634d54b4b1 Allow overriding of Skyline logos
Change-Id: I3975b5266c8700c81439b4d891d446eba2a52e54
2024-04-23 15:17:32 +02:00
Zuul
5a663aec1d Merge "mariadb: fix cluster recovery" 2024-04-22 13:46:41 +00:00
Michal Nasiadka
448209459d CI: Add codespell to pep8
Fix existing spelling errors

Change-Id: Ie689cf5a344aaa630a4860448b09242333a8e119
2024-04-22 13:19:23 +00:00
Sven Kieske
984cb0a754 mariadb: fix cluster recovery
sometimes cluster recovery didn't work
because we only look for the sequence number in the last 200 lines
of the log file.

fix this by ingesting the complete file and only register the last
sequence number we find.

Closes-Bug: 1821173

Change-Id: Iea2661c9d5d262cf99edd5f5b567f252607a0003
Signed-off-by: Sven Kieske <kieske@osism.tech>
2024-04-22 11:05:11 +02:00
Zuul
756ec498d3 Merge "Update Skyline configuration to enable SSO" 2024-04-19 17:14:36 +00:00
Michal Nasiadka
b391cdcf95 ironic: mount metrics in conductor only when exporter is enabled
Related-Bug: #2062401

Change-Id: I2c058e0fe56b32fce36e1c9f637c12fe5950ff21
2024-04-18 18:35:46 +00:00