688 Commits

Author SHA1 Message Date
wangxiyuan
01ed75acef Add openEuler Distro support
openEuler is the newest open source operating system, which is quite
famous and widely used in China. This patch aims to add the OS support
in kolla-ansible for the host OS.

bp: support-openeuler-os

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/830320

Change-Id: I66dc84f02c324dbc0787ec25d4bd92ada9362e94
2022-03-28 07:54:49 +00:00
Zuul
a460943360 Merge "monasca: Remove monasca-grafana leftovers" 2022-03-23 13:06:49 +00:00
Zuul
c02f8586e7 Merge "[CI] Add Venus scenario" 2022-03-23 12:28:52 +00:00
Michal Nasiadka
8fe9872031 monasca: Remove monasca-grafana leftovers
In Xena [1] we removed Monasca Grafana service, but some components were left
to support cleanup operations.

[1]: https://review.opendev.org/c/openstack/kolla-ansible/+/788228

Change-Id: Iccc7bc3628bb7cbab1ac28f41c7b7dc7695894c6
2022-03-23 07:04:57 +00:00
jinyuanliu
3ccb176f13 ADD venus for kolla-ansible
This project [1] can provide a one-stop solution to log collection,
cleaning, indexing, analysis, alarm, visualization, report generation
and other needs, which involves helping operator or maintainer to
quickly solve retrieve problems, grasp the operational health of the
platform, and improve the level of platform management.

[1] https://wiki.openstack.org/wiki/Venus

Change-Id: If3562bbed6181002b76831bab54f863041c5a885
2022-03-17 20:35:08 +08:00
Radosław Piliszek
74ec1fab2a [CI] Add Venus scenario
Venus is a new service for log processing.
This patch adds a CI scenario which tests Venus deployment.

Depends-On: https://review.opendev.org/c/openstack/kolla/+/793795
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/793897
Co-Authored-By: jinyuanliu <liujinyuan@inspur.com>
Change-Id: I0c7ba9e1ae23623b690a213c91ab3a12524d73f8
2022-03-16 14:57:29 +00:00
Zuul
19b169e139 Merge "[CI] Remove an old override" 2022-03-07 18:34:56 +00:00
Radosław Piliszek
e818d3124d [CI] Remove an old override
Since [1] we are not running keepalived directly on CI network,
and are therefore safeguarded against such collisions.

[1] 8e40629161a329a22022d38b3cb48dea66121b36

Change-Id: Ie25b2d6d48f10c6b295795b3c82c1f8a213f2a8c
2022-03-07 16:58:46 +01:00
Radosław Piliszek
a6145d678d [CI] Ironic: use ipmitool retries
In Ironic jobs with Tenks, we saw issues with IPMI commands
failing, resuling in job failures:

  Error setting Chassis Boot Parameter 5

A metal3.io commit [1] was found that fixes the issue by moving IPMI
retries from ironic to ipmitool, which has a side-effect of increasing
the timeout. This change applies the same configuration.

This change has been adapted from an analogous change in
kayobe-config-dev. [2]

[1] 6bc1499d8b
[2] Ib4fce74cebebe85c31049eafe2eeb6b28dfab041

Co-Authored-By: Mark Goddard <mark@stackhpc.com>
Change-Id: I552417b9da03b8dfc9406e0ff644092579bc7122
2022-03-07 10:21:56 +01:00
Mark Goddard
91778aca76 [CI] Use Tenks in Ironic job
Installs Tenks [1] and uses it to create virtual machines to pose
as bare metal compute nodes.
The nodes are registered in Ironic, and used to provision
instances.

[1] https://docs.openstack.org/tenks/latest/

Depends-On: https://review.opendev.org/c/openstack/tenks/+/830182
Depends-On: https://review.opendev.org/c/openstack/tenks/+/830675
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/831055
Change-Id: Idfb8fbb50dc7442225967b2a2ec38ae7114f3c11
Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2022-03-05 20:03:36 +00:00
Zuul
9a1bd06098 Merge "[CI] Collect info about environment before deploy" 2022-03-03 16:35:34 +00:00
Michal Nasiadka
7080ccfc3d Add Rocky Linux support as Host OS
Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/831642
Change-Id: I70dcd2d0cade52a23b3e219b7e0aaa31193ec938
2022-03-03 09:59:16 +00:00
Zuul
8ff7b51fef Merge "Install openstack.kolla collection" 2022-02-21 21:51:10 +00:00
Zuul
63706667e1 Merge "Add support for deploying Prometheus libvirt exporter" 2022-02-21 21:35:55 +00:00
Mark Goddard
f63f1f3082 Install openstack.kolla collection
This change adds an Ansible Galaxy requirements file including the
openstack.kolla collection. A new 'kolla-ansible install-deps' command
is provided to install the requirements.

With the new collection in place, this change also switches to using the
baremetal role from the openstack.kolla collection, and removes the
baremetal role from this repository.

Depends-On: https://review.opendev.org/c/openstack/ansible-collection-kolla/+/820168

Change-Id: I9708f57b4bb9d64eb4903c253684fe0d9147bd4a
2022-02-21 14:26:48 +00:00
Zuul
da1670241b Merge "[CI] Filter fluentd errors more" 2022-02-11 10:02:16 +00:00
Zuul
599f82ad32 Merge "CI: Bump Ceph to Pacific" 2022-02-10 18:17:42 +00:00
Michal Nasiadka
496a3df95f CI: Bump Ceph to Pacific
Change-Id: I9c736a586a757b49170977c7f9cf2c4890557a33
2022-02-10 12:15:54 +00:00
Radosław Piliszek
58dd72583b [CI] Filter fluentd errors more
Make it less likely to fail on false positives.

Change-Id: I493430e255c76bf2a30818b63913ecabb40c5afc
2022-02-09 18:24:19 +01:00
Radosław Piliszek
654edefca3 [CI] Replace parted with lsblk
parted hangs waiting for user input (see examples below)
on Debian and Ubuntu nodes which have created a cinder
volume on lvm, causing POST_FAILURE of the entire CI job.
Zun (Cinder iSCSI LVM) jobs are affected.
parted seemingly tries to interpret contents of the created
volume and fails miserably.
Since there is no reason why we would need to see the output
of parted specifically, this patch is switching to use
lsblk to simply list visible block devices.
Along with the rest of the commands, this should be just
the right level of detail.
And we avoid having parted interpret internals of otherwise
opaque block devices.

Example issues:

Warning: Not all of the space available to
/dev/mapper/cinder--volumes-cinder--volumes--pool appears to be used, you can
fix the GPT to use all of the space (an extra 9732096 blocks) or continue with
the current setting?
Fix/Ignore?

Warning: Not all of the space available to
/dev/mapper/cinder--volumes-cinder--volumes--pool-tpool appears to be used, you
can fix the GPT to use all of the space (an extra 9732096 blocks) or continue
with the current setting?
Fix/Ignore?

Warning: Not all of the space available to
/dev/mapper/cinder--volumes-cinder--volumes--pool_tdata appears to be used, you
can fix the GPT to use all of the space (an extra 9732096 blocks) or continue
with the current setting?
Fix/Ignore?

Change-Id: I7beecf2dd6c49c8934722cf22efa74e920ecb060
2022-02-04 22:32:23 +01:00
Mark Goddard
b29298ed2a CI: enable libvirt TLS in TLS jobs
Enable libvirt TLS in CI jobs with TLS enabled.

Uses the new functionality of the certificates command to generate
certificates for both libvirt client and server (added in
I1bde9fa018f66037aec82dc74c61ad1f477a7c12).

Change-Id: Ica304685b043f699799ccee6c9c2fbcf968888db
2022-02-03 14:32:49 +00:00
Zuul
e4bfedd731 Merge "[CI] Check fluentd errors" 2022-01-27 11:13:55 +00:00
Zuul
d5dcb66479 Merge "Add Ansible 5 aka core 2.12 support" 2022-01-20 20:53:03 +00:00
Radosław Piliszek
e63bbed18d Clean up chrony cleanup
In the Yoga cycle we no longer need kolla chrony container removal
procedures.

Change-Id: I4dc246cf0fd68838470bf9e9bf749fa9be4d6670
2022-01-18 15:37:51 +00:00
Radosław Piliszek
ea014b203c [CI] Test that Cinder can create volume from image
To catch early issues like [1].

[1] https://bugs.launchpad.net/cinder/+bug/1947518

Change-Id: I8091817939b976fbd5e44a9640b573cc112a0525
2022-01-12 09:41:40 +00:00
Zuul
ae57c39085 Merge "CI: check-logs - add another exception" 2022-01-07 19:19:15 +00:00
Radosław Piliszek
7372911a19 Add Ansible 5 aka core 2.12 support
Also bumps the minimum to 4.

Change-Id: Ia373f9cc3bb69eba0288bbb3e497e8cadb7cc4d3
2022-01-07 18:08:55 +00:00
Zuul
e1297a4943 Merge "Refactor of kolla_docker into module_utils" 2022-01-06 20:01:45 +00:00
Martin
a9fbcb1855 Refactor of kolla_docker into module_utils
Moved the DockerWorker class from module file into its separate file
in module_utils directory for future extension.
Unit tests changed accordingly.

Signed-off-by: Ivan Halomi <ivan.halomi@tietoevry.com>
Co-authored-by: Martin Hiner <martin.hiner@tietoevry.com>
Change-Id: Ia2a471a9a2805e13b2c20dbf8a7297c23231aae3
2022-01-06 11:59:50 +01:00
Doug Szumski
491d418476 Add support for deploying Prometheus libvirt exporter
Add support for deploying the Kolla Prometheus libvirt exporter image to
facilitate gathering metrics from the Nova libvirt service.

Co-Authored-by: Dr. Jens Harbott <harbott@osism.tech>
Change-Id: Ib27e60c39297b86ae674297370f9543ab08cda05
Partially-Implements: blueprint libvirt-exporter
2022-01-05 13:30:45 +01:00
Zuul
2a7823b5cb Merge "CI: future-proof return semantics in check-failure.sh" 2021-12-30 21:49:16 +00:00
Mark Goddard
613b00cccf CI: future-proof return semantics in check-failure.sh
In case we add further check functions, use a return rather than exit.

Change-Id: Ie2a53028802ecde628bc9fe0b4e3236bdb588cf9
2021-12-30 14:42:37 +00:00
Radosław Piliszek
581544a037 [CI] Check fluentd errors
We consider them critical and prefer to fail the jobs.

Change-Id: I3c2475522f8f37e3b608d3c321aee27277fc9dee
2021-12-29 10:15:55 +00:00
Radosław Piliszek
0cbdedd0a3 Drop vmtp
Details in the attached reno.

Change-Id: I438a453ca522493524fdb9760c1edb330916084b
2021-12-21 07:29:32 +00:00
Dmitry Tantsur
10616fb19a Prepare tests for the Ironic combined service
In I51bf7226aea145dc7c8fd93d61caa233ca16c9c9 we are introducing a way to
run Ironic API and conductor in one process. In the Bifrost change
I9faecfe6ece6d3c35396e3378c1e3930a487e130 we are switching Bifrost to
it, which breaks the Kolla job.

This change makes get_logs.sh aware of the new service. Also drop
RabbitMQ since Bifrost hasn't supported it for a while already.

Change-Id: I30ac6bd4332dacbdce1f5e25bd6a97d2982b208e
2021-12-06 11:39:14 +01:00
Zuul
d894d97c5b Merge "Finish removing Monasca Log Transformer" 2021-12-04 21:28:22 +00:00
Zuul
4ebdf54733 Merge "[release] Set previous_release to xena" 2021-12-02 15:42:37 +00:00
Michal Nasiadka
661ca4dc06 CI: check-logs - add another exception
It was seen in [1] and some other occassions, possibly neutron was trying
to fetch token while keystone was being upgraded.

[1]: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ec2/665117/12/check/kolla-ansible-ubuntu-source-upgrade/ec2fc04/primary/logs/kolla/all-CRITICAL.txt

Change-Id: If8c569e1f7815520c84627671e3cbf275bed8ff9
2021-11-26 11:28:24 +01:00
Mark Goddard
999e3dbc97 CI: Test minimum and maximum supported ansible versions
Change-Id: I7b1e36edb1680220c6fe082fbf5eefdd633c8cfa
2021-11-24 17:49:29 +00:00
Doug Szumski
5b06115be8 Finish removing Monasca Log Transformer
This service was disabled in the Wallaby release and all
references to it can now be removed.

Change-Id: I482640dd63959143732d86fcffb320cc94611247
2021-11-15 10:40:21 +00:00
Mark Goddard
feb70547c1 [release] Set previous_release to xena
This defines which release we upgrade from in CI.

Also remove some Wallaby upgrade compatibility code in CI playbooks

Change-Id: I18912178392973337ca4115dec3816f1b3944ad5
2021-11-09 17:37:00 +00:00
Maksim Malchuk
37e4dba879 Add support for Ironic inspection through DHCP-relay
This change updates documentation, examples and tests to support
Ironic inspection through DHCP-relay. The dnsmasq service should be
configured with more specific format set in the variable
``ironic_dnsmasq_dhcp_range``. See the dnsmasq manual page [1].

[1] https://thekelleys.org.uk/dnsmasq/docs/dnsmasq-man.html

Change-Id: I9488a72db588e31289907668f1997596a8ccdec6
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2021-10-12 22:16:04 +03:00
Zuul
351bf158c5 Merge "Docs: Update to opendev.org domain" 2021-10-06 17:08:11 +00:00
Zuul
99a9a03c39 Merge "[CI] Stop adding the DROP workaround" 2021-10-06 14:55:02 +00:00
Piotr Parczewski
62b90af553 Docs: Update to opendev.org domain
Curl would not work without -L on old openstack.org URLs.

TrivialFix

Change-Id: I7ed7bd336f4b874fc6027cb9ad20669b08e4a7e9
2021-10-06 13:26:34 +02:00
Mark Goddard
3b22d334d6 CI: monasca: ignore exited monasca_thresh container
Ignore the monasca_thresh container if it is listed as exited.
The container was recently changed to operate as a 'one shot' container,
submitting a job to storm then exiting. This does not fit with the
usual pattern of Kolla Ansible container usage, but is harmless.

Depends-On: https://review.opendev.org/c/openstack/kolla/+/811977

Change-Id: Id40d2260a67ef604255fb1818d41cdcbc73164d7
2021-10-01 13:08:01 +01:00
wu.chunyang
1f71df1a8b Remove chrony role from kolla
chrony is not supported in Xena cycle, remove it from kolla

Moved tasks from chrony role to chrony-cleanup.yml playbook to avoid a
vestigial chrony role.

Co-Authored-By: Mark Goddard <mark@stackhpc.com>

Change-Id: I5a730d55afb49d517c85aeb9208188c81e2c84cf
2021-09-30 18:56:14 +02:00
Radosław Piliszek
9ef6bb2d96 [CI] Stop adding the DROP workaround
Since Wallaby, we default to disabling Docker's iptables
management, thus making the code being removed here obsolete.

Change-Id: Ieb7774f2380a811070aea27964a39e4c8cb02083
2021-09-30 16:47:22 +00:00
Mark Goddard
8c5012e940 Add support for Ceph RadosGW integration
* Register Swift-compatible endpoints in Keystone
* Load balance across RadosGW API servers using HAProxy

The support is exercised in the cephadm CI jobs, but since RGW is
not currently enabled via cephadm, it is not yet tested.

https://docs.ceph.com/en/latest/radosgw/keystone/

Implements: blueprint ceph-rgw

Change-Id: I891c3ed4ed93512607afe65a42dd99596fd4dbf9
2021-09-30 13:08:13 +00:00
Radosław Piliszek
e6edec78e5 [CI] Collect info about environment before deploy
And also collect lsmod listing.

These both are useful to have a clearer picture of the original
environment and the effect kolla ansible had on it.

Change-Id: I5d87cfd45e4369df40b8195124535e59d24700c3
2021-09-25 20:10:15 +00:00