12419 Commits

Author SHA1 Message Date
Zuul
c17fa464f2 Merge "Revert "cephadm: Set auth_allow_insecure_global_id_reclaim to true"" 2021-07-29 15:27:48 +00:00
Will Szumski
6c72fa8117 Support multiple inventories
Multiple inventories can now be passed to `kolla-ansible`.  This can be
useful to construct a common inventory that is shared between multiple
environments.

Change-Id: I2ac5d7851b310bea2ba362b353f18c592a0a6a2e
2021-07-29 15:25:07 +00:00
Zuul
81a0bb8331 Merge "[CI] Slim down Masakari job" 2021-07-29 09:57:42 +00:00
Radosław Piliszek
d7cdad5325 Use more RMQ flags for less busy wait
As mentioned in the Iced014acee7e590c10848e73feca166f48b622dc
commit message, in Ussuri+ we can use ``+sbwtdcpu none
+sbwtdio none`` as well. This is due to relying on RMQ-provided
erlang in version 23.x.

This change adds the extra arguments by default.
It should be backported down to Ussuri before we do a release with
Iced014acee7e590c10848e73feca166f48b622dc.

Change-Id: I32e247a6cb34d7f6763b544f247fd408dce2b3a2
2021-07-28 19:14:43 +00:00
Zuul
d328265216 Merge "manila: add glance section in manila-share.conf" 2021-07-28 17:28:15 +00:00
Zuul
8e9ad3978a Merge "Delete haproxy_single_service_listen.cfg.j2 template" 2021-07-28 17:16:36 +00:00
LinPeiWen
fca9be3806 Delete haproxy_single_service_listen.cfg.j2 template
Delete the "haproxy_single_service_listen.cfg.j2" template,
which has been replaced by "haproxy_single_service_split.cfg.j2"
and deprecated in the Victoria version

Change-Id: I3599f85afe9d3045820ea1ea70481ea2500e49ac
2021-07-28 13:30:54 +00:00
Zuul
aad331069d Merge "Fix variable names in Octavia documentation" 2021-07-28 11:22:55 +00:00
Mark Goddard
c3f9ba835b nova: Use cinder user for Ceph
In Ussuri, nova stopped using separate Ceph keys for the volumes and vms
pools by default. Instead, we set ceph_nova_keyring to the value of
ceph_cinder_keyring by default, which is ceph.client.cinder.keyring.
This is in line with the Ceph OpenStack integration guide [1]. However,
the user used by nova to access the vms pool (ceph_nova_user) defaults
to nova, meaning that nova will still try to use a
ceph.client.nova.keyring, which probably does not exist. We did not see
this issue in CI, because we set ceph_nova_user to cinder.

This change fixes the issue by setting ceph_nova_user to the value of
ceph_cinder_user by default, which is cinder.

Closes-Bug: #1934145
Related-Bug: #1928690

[1] https://docs.ceph.com/en/latest/rbd/rbd-openstack/

Change-Id: I6aa8db2214e07906f1f3e035411fc80ba911a274
2021-07-28 10:08:27 +00:00
Goutham Pacha Ravi
004cb75407 [manila] Drop tenant_id templating from v2 endpoint
Manila's wallaby release [1] made it possible for
the v2 endpoint to not include a tenant_id
(project_id). This change was made to
accommodate interactions by system scoped users.

System scoped users cannot interact with an
endpoint that needs the "tenant_id" templating,
because system scoped tokens cannot be resolved
to a particular tenant_id by definition. More
information regarding this change is captured
in the release notes for the project [2] and
the API reference [3].

[1] https://review.opendev.org/c/openstack/manila/+/773709
[2] https://docs.openstack.org/releasenotes/manila/wallaby.html#prelude
[3] https://docs.openstack.org/api-ref/shared-file-system/#shared-file-systems-api

Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
Change-Id: Ice359bc31429a5da403598b9b4a0e1a95d71b83f
2021-07-27 23:03:05 -07:00
wu.chunyang
24d08142d2 Fix nova deployment failure when rabbitmq is disabled
Nova always tries to create the rabbitmq user regardless of
whether RabbitMQ is enabled or not.
This ps also adds an external rabbitmq doc.

Change-Id: Iec517226e4c82ea351889b55689a3efceaadcc76
2021-07-27 22:07:08 +08:00
wuchunyang
24950b3894 Fix incorrect config of linuxbridge multiple external networks
multiple external networks are supported by linuxbridge and OVS.
Currently the config template only works for OVS

Closes-Bug: #1863935
Change-Id: I9da331e007c25c4a760839c566831769a68507a9
2021-07-27 17:11:42 +08:00
Mark Goddard
5cb080247b cyborg: add missing become for api-paste.ini
Co-Authored-By: Boris Lukashev

Change-Id: I52eaf823ae84e01a09a6dcfcbffd7221ff8abfac
Closes-Bug: #1937911
2021-07-27 08:53:06 +01:00
Zuul
8f05a309d1 Merge "Fix exit code with bogus command name" 2021-07-26 07:46:36 +00:00
Radosław Piliszek
7dfbcc71cb [CI] Slim down Masakari job
The Masakari job uses 4 nodes and defaulted to a quite bulky
and not really supported config (MariaDB and RMQ on 4 nodes).
This change slims it down so that we test only HA of Masakari
and hacluster. The other services are deployed single-node.

Additionally, simplify the network group (it does not affect any
other job, the logic was simply overdone there).

Change-Id: I74b315443f79d0d7780907fc785e1a29759c1803
2021-07-24 17:51:59 +00:00
Zuul
54eb323b32 Merge "ironic: always enable conductor HTTP server" 2021-07-22 11:57:39 +00:00
Zuul
5d5c3921c7 Merge "Fix ironic_ipxe healthcheck on Debian/Ubuntu" 2021-07-22 11:57:08 +00:00
Mark Goddard
411668ea5a ironic: always enable conductor HTTP server
In the Xena release, Ironic removed the iSCSI driver [1]. The
recommended driver is direct, which uses HTTP to transfer the disk
image. This requires an HTTP server, and the simplest option is to use
the one currently deployed when enable_ironic_ipxe is set to true. For
this reason, this patch always enables the HTTP server running on the
conductor.

iPXE is still enabled separately, since it cannot currently be used at
the same time as PXE.

[1] https://review.opendev.org/c/openstack/ironic/+/789382

Change-Id: I30c2ad2bf2957ac544942aefae8898cdc8a61ec6
2021-07-22 09:46:46 +01:00
Zuul
646be6589d Merge "Fix Masakari host monitor default config" 2021-07-22 02:23:43 +00:00
Pierre Riteau
5e85fe2a07 Fix variable names in Octavia documentation
The variable octavia_amphora_flavor should be octavia_amp_flavor.

The variable for customising network and subnet was only mentioned in
the example.

Change-Id: I3ba5a7ccc2c810fea12bc48584c064738e5aa35e
2021-07-21 15:42:29 +02:00
wu.chunyang
200e36da7d Fix deployment failure when kolla_dev_mod is enabled
trivial fix

Change-Id: I43bc11183c2fa9773811a74a93c37cecceed7454
2021-07-21 21:31:52 +08:00
Mark Goddard
aa28675ca9 Fix ironic_ipxe healthcheck on Debian/Ubuntu
The healthcheck checks for a process called httpd, but these distros
call it apache2.  This results in the ironic_ipxe container being marked
as unhealthy.

This change fixes the issue by making the process name distro dependent.

Change-Id: I0b0126e3071146e7f8593ba970ecbed65b36fcfa
Closes-Bug: #1937037
2021-07-21 10:03:44 +01:00
Kyle Dean
2e4f51f671 manila: add glance section in manila-share.conf
Since the Victoria release, manila-share.conf requires a glance section
for some drivers. This change adds the missing section.

It also uses the correct cinder_keystone_user variable to reference the
cinder user.

Closes-Bug: #1921935

Change-Id: Ib7ce4ed79c28456281087eb4156577f910c072e7
2021-07-20 08:58:26 +01:00
Pierre Riteau
cccae8a654 Fix typos in release note
Backports: Wallaby, Victoria.

Change-Id: Ib9a5058d6290d805670001ac2b5a42630aeec2b2
2021-07-19 17:19:02 +02:00
Zuul
a43b815b34 Merge "Make setup module arguments configurable" 2021-07-19 12:30:29 +00:00
Zuul
37601e2be4 Merge "Fix typo in keystone role" 2021-07-19 12:30:27 +00:00
Zuul
e7c39aa419 Merge "Robustify fluentd output tag matching" 2021-07-19 11:16:46 +00:00
Christian Berendt
220d4fbbce Fix typo in keystone role
Change-Id: I096971a0a69ff0fc29946fbdb70cf26ead922a8c
2021-07-15 15:48:04 +02:00
Zuul
6ea8390a12 Merge "Extend support for custom Grafana dashboards" 2021-07-12 16:00:47 +00:00
Piotr Parczewski
c2ae21fd97 Reduce container metrics cardinality
Adds support for passing extra runtime options to cAdvisor.
By default new options disable exporting rarely useful metrics
and labels by cAdvisor. This helps reducing the load on Prometheus
and cAdvisor itself.

Change-Id: I81f3845d6cd03a70a0c8569f8d0ea421027df083
2021-07-08 16:31:44 +02:00
Mark Goddard
54737cd13f baremetal: use docker_yum_gpgkey to fetch docker GPG key
Currently, if you override docker_yum_url, the repo must contain a GPG
key at {{ docker_yum_url }}/gpg, despite the fact that the GPG key URL
can be overridden separately via docker_yum_gpgkey. This change uses
docker_yum_gpgkey consistently, avoiding the need to keep the key in the
repo.

Closes-Bug: #1934913
Change-Id: If8e6a02ce0760123f7b076c711727ef575965192
2021-07-07 17:22:32 +01:00
Will Szumski
f6c0474afe Fix config action when OVN is enabled
Prior to this change, if you generated the config before deploying any
of the OVN services, it would fail on these tasks as the services will
not have been started.

TrivialFix

Change-Id: Ia85ef26015ff341bff1414da039bed52f34e7cc0
2021-07-07 14:58:49 +01:00
wu.chunyang
5261998467 Remove tempest role
Remove tempest role as planned

Change-Id: If3cf073e88c83f670c867a49afe48845f9e81008
2021-07-07 21:58:39 +08:00
Maksim Malchuk
c454761a4b Blazar: Fix support for external keystone in multiregion deploy
We need to correctly set keystone auth api for all cases.
By default [1] the keystone_internal_fqdn is equal to the
kolla_internal_fqdn, but in multiregion deploy it can be overriden.

1. 3a7440b370/ansible/group_vars/all.yml (L834)

Change-Id: Ib40aafaa9ca360d57e87ffdd81dbc15e603fef99
Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2021-07-05 18:08:50 +03:00
Zuul
2ecf0a8783 Merge "Support storing passwords in Hashicorp Vault" 2021-07-02 20:28:44 +00:00
Rafael Weingärtner
15f2fdcd5d Make setup module arguments configurable
Ansible facts can have a large impact on the performance of the Ansible
control host. This patch introduces some control over which facts are
gathered (kolla_ansible_setup_gather_subset) and which facts are stored
(kolla_ansible_setup_filter). By default we do not change the default
values of these arguments to the setup module. The flexibility of these
arguments is limited, but they do provide enough for a large performance
improvement in a typical moderate to large OpenStack cloud.

In particular, the large complex dict fact for each interface has a
large effect, and on an OpenStack controller or hypervisor there may be
many virtual interfaces. We can use the kolla_ansible_setup_filter
variable to help:

    kolla_ansible_setup_filter: 'ansible_[!qt]*'

This causes Ansible to collect but not store facts matching that
pattern, which includes the virtual interface facts. Currently we are
not referencing other facts matching the pattern within Kolla Ansible.
Note that including the 'ansible_' prefix causes meta facts module_setup
and gather_subset to be filtered, but this seems to be the only way to
get a good match on the interface facts. To work around this, we use
ansible_facts rather than module_setup to detect whether facts exist in
the cache.

The exact improvement will vary, but has been reported to be as large as
18x on systems with many virtual interfaces.

For reference, here are some other tunings tried:

* Increased the number of forks (great speedup depending of the size of
  the deployment)
* Use `strategy = mitogen_linear` (cut processing time in half)
* Ansible caching (little speed up)
* SSH tunning (little speed up)

Co-Authored-By: Mark Goddard <mark@stackhpc.com>
Closes-Bug: #1921538
Change-Id: Iae8ca4aae945892f1dc65e1b10381d2e26e88805
2021-07-02 10:30:35 -03:00
Radosław Piliszek
f71646da18 Fix Masakari host monitor default config
Closes-Bug: #1933209
Change-Id: I644ad475ca88aac0c22b14163d33a30193fe706a
2021-07-01 18:22:10 +00:00
Zuul
e63d985ccb Merge "CI: fix backups Ceph pool name" 2021-07-01 17:57:44 +00:00
Zuul
99c43c2ea1 Merge "Remove rally and panko again" 2021-07-01 11:30:06 +00:00
Zuul
a6f52759b3 Merge "reno: fix typo" 2021-07-01 10:47:29 +00:00
Zuul
e2bbded967 Merge "Update previous_release to Wallaby" 2021-07-01 10:31:44 +00:00
Zuul
ad6dbab260 Merge "magnum: Add CA certificate configuration for internal TLS" 2021-07-01 10:14:33 +00:00
Mark Goddard
6131b68562 Remove rally and panko again
These files got accidentally added back in
I7e9d5c9b8b9164d4aee3abb4e37c8f28d98ff5d1.

Change-Id: If17e5ae1cfe040f33f8309a97b4dcfa87af862a3
2021-07-01 09:55:23 +01:00
Zuul
bc060c2049 Merge "Use ansible_facts to reference facts" 2021-07-01 02:37:09 +00:00
Scott Solkhon
6bf74aa20d Support storing passwords in Hashicorp Vault
This commit adds two new cli commands to allow an operator
to read and write passwords into a configured Hashicorp Vault
KV.

Change-Id: Icf0eaf7544fcbdf7b83f697cc711446f47118a4d
2021-06-30 15:16:12 +01:00
Mark Goddard
6e18495892 CI: Avoid generating a nova key in cephadm scenario
We use the cinder key for Nova by default, so a separate nova key is no
longer used.

Change-Id: I49ce6d36747e6c7d3a389d0afd2d034e8afdf8ed
2021-06-30 09:45:13 +01:00
Radosław Piliszek
a73e89f03f [CI] Do not set ansible_python_interpreter for Zuul
Zuul 4.6.0 does not allow to set ansible_python_interpreter. [1]
Instead, with the current Zuul and Ansible, this should be
automatically set to the proper python.

This patch is required to restore the jobs which are ignored
otherwise. [2] [3]

Additionally, this change avoids the use of Ansible's pip
module because it tries to use setuptools from the
ansible_python_interpreter first even if another executable is
set.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023291.html
[2] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023326.html
[3] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023321.html

Change-Id: I53e666d59d0cce26e38c6f66a39eb204bda502d3
2021-06-27 10:22:43 +00:00
Zuul
283bbc6663 Merge "Use Docker healthchecks for kafka services" 2021-06-25 01:23:34 +00:00
Zuul
f80bc6d998 Merge "Use Docker healthchecks for rabbitmq services" 2021-06-24 13:17:27 +00:00
wu.chunyang
5316047575 reno: fix typo
follow: https://review.opendev.org/c/openstack/kolla-ansible/+/794359
trivial fix

Change-Id: I7bd24dd660939c81f15d46679454a2663137bdde
2021-06-24 09:10:41 +08:00