11074 Commits

Author SHA1 Message Date
John Garbutt
628c27ce9e Fix live migration to use migration int. address
In kolla ansible we typically configure services to communicate via IP
addresses rather than hostnames. One accidental exception to this was
live migration, which used the hostname of the destination even when
not required (i.e. TLS not being used for libvirt).

To make such hostnames work, k-a adds entries to /etc/hosts in the
bootstrap-servers command. Alternatively users may provide DNS.

One problem with using /etc/hosts is that, if a new compute host is
added to the cloud, or an IP address is changed, that will not be
reflected in the /etc/hosts file of other hosts. This would cause live
migration to the new host from an old host to fail, as the name cannot
be resolved.

The workaround for this was to update the /etc/hosts file (perhaps via
bootstrap-servers) on all hosts after adding new compute hosts. Then the
nova_libvirt container had to be restarted to pick up the change.

Similarly, if user has overridden the migration_interface, the used
hostname could point to a wrong address on which libvirt would not
listen.

This change adds the live_migration_inbound_addr option to nova.conf. If
TLS is not in use for libvirt, this will be set to the IP address of the
host on the migration network. If TLS is enabled for libvirt,
live_migration_inbound_addr will be set to migration_hostname, since
certificates will typically reference the hostname rather than the
host's IP. With libvirt TLS enabled, DNS is recommended to avoid the
/etc/hosts issue which is likely the case in production deployments.

Change-Id: I0201b46a9fbab21433a9f53685131aeb461543a8
Closes-Bug: #1729566
2020-04-09 18:17:07 +00:00
linpeiwen
5659177026 keystone roles container name variable
keystone and keystone_fernet container name variable is fixed
in some places, but in the defaults directory, keystone
and keystone_fernet container_name variable is variable.
If the keystone and keystone_fernet container_name variable is
changed during deployment, it will not be assigned to keystone
and keystone_fernet, but a fixed 'keystone' and 'keystone_fernet' name.

Change-Id: Ifc8ac69e6abc4586f0e4fd820b9022aea9f76396
2020-03-26 23:38:34 -04:00
Zuul
c9ca7e5529 Merge "Fix kolla-ansible stop with heterogeneous hosts" 2020-03-25 15:09:30 +00:00
Zuul
6af7efe349 Merge "Fix telegraf with zookeeper (wrong port variable reference)" 2020-03-25 12:55:33 +00:00
LinPeiWen
8a206699d4 mariadb container name variable
mariadb container name variable is fixed in some places,
but in the defaults directory, mariadb container_name variable
is variable. If the mariadb container_name variable is changed
during deployment, it will not be assigned to container_name,
but a fixed 'mariadb' name.

Change-Id: Ie8efa509953d5efa5c3073c9b550be051a7f4f9b
2020-03-25 01:17:29 -04:00
Mark Goddard
89df07e8ef Fix kolla-ansible stop with heterogeneous hosts
The 'kolla-ansible stop' command can be used to stop the services
running on hosts. However, if you run this command in an environment
with heterogeneous nodes (most real world scenarios have at least
control/compute), then it fails. This is because it only checks
whether a container is enabled, and not whether the host is in the
correct group. For example, it fails with nova-libvirt:

    No such container: nova_libvirt to stop.

This change fixes the issue by only attempting to stop containers on
hosts to which they are mapped.

Change-Id: Ibecac60d1417269bbe25a280996ca9de6e6d018f
Closes-Bug: #1868596
2020-03-23 17:21:53 +00:00
Marcin Juszkiewicz
9bde29a30b cirros: upgrade to 0.5.1
We released CirrOS 0.5.1. Time to move then.

Change-Id: Ibca24836f19b3cbf6166fa39a3702883938feda8
2020-03-21 15:40:10 +00:00
Zuul
becc4cda09 Merge "Support disabling Prometheus server" 2020-03-20 20:28:08 +00:00
Zuul
8593909b91 Merge "Fix service_mapped_to_host filter" 2020-03-20 20:22:18 +00:00
Doug Szumski
505cded29b Support disabling Prometheus server
This is useful to people who manage their Prometheus Server
externally to Kolla Ansible, or want to use the exporters with
another framework such as Monasca.

Change-Id: Ie3f61e2e186c8e77e21a7b53d2bd7d2a27eee18e
2020-03-20 17:18:39 +00:00
Mark Goddard
35966c9186 Fix service_mapped_to_host filter
The service_mapped_to_host filter is used to check if a service is
mapped to a host, based on the group for the service or its
host_in_groups attribute if one exists. We check if the service's group
is in the 'groups' list. However, to get the list of groups to which a
host belongs, we should use the 'group_names' list.

This filter is currently only used in neutron IPv6 module loading, so
the effects are minimal.

Change-Id: I37409ca8d273b0426df0a648db222dc5432e738a
Closes-Bug: #1868285
2020-03-20 17:03:14 +00:00
Radosław Piliszek
e03f06c081 Do not enforce vxlan in init-runonce
The affected command was meant to create a tenant network, so let
us really test it this way.

Not marking CI, because someone may be using this script.

Change-Id: I5abe46948992121a11a36f941d4f8fac1caa92b1
2020-03-20 14:51:02 +01:00
Zuul
9643dd54e2 Merge "CI: CentOS 8: Enable Masakari job and periodics" 2020-03-19 18:55:38 +00:00
Zuul
0718a1a90c Merge "CI: Enable fluentd in MariaDB jobs" 2020-03-19 17:19:06 +00:00
Zuul
1740463987 Merge "Fix deployment of fluentd without any enabled OpenStack services" 2020-03-19 17:07:14 +00:00
Zuul
7e94e2f3d6 Merge "CI: Add instance console log to test-core-openstack.sh" 2020-03-19 14:50:32 +00:00
Zuul
270fb4cf0b Merge "CentOS 8: Use master image tag by default" 2020-03-19 12:55:34 +00:00
Michal Nasiadka
b2d45e5b87 CI: Add instance console log to test-core-openstack.sh
Sometimes ping & ssh to the instance are failing - outputting instance console
log can help in the case when there are metadata access issues (or other
issues).

Change-Id: I8437300d621448782e964d877b2614ca606f5849
2020-03-19 12:24:59 +01:00
Marcin Juszkiewicz
ed4607ec56 CI: add Debian/source upgrade job
Change-Id: If3f95e0bfc779879ca7d2cf45188fb76b4b772da
2020-03-19 10:03:01 +01:00
Michal Nasiadka
866a6ba16a CI: Enable fluentd in MariaDB jobs
Since fluentd is disabled in MariaDB jobs - haproxy logs are not getting
populated.

Change-Id: I56b3fc1be6940d97905cdb2c4452b846f106c071
Depends-on: https://review.opendev.org/713704
2020-03-19 09:01:23 +00:00
Radosław Piliszek
561b33cbb2 Fix deployment of fluentd without any enabled OpenStack services
Fluentd cannot accept empty 'path' parameter.

I refactored the service list following the general pattern
we have.

Change-Id: I83d820efcc7e86bac9f8bda26a8f8bece72159e6
Closes-bug: #1867953
2020-03-18 21:17:54 +01:00
Zuul
31fe3c0651 Merge "Fix invalid JSON body in Elasticsearch API requests" 2020-03-18 10:47:57 +00:00
Zuul
71a058d2f8 Merge "CI: install tox" 2020-03-17 21:14:21 +00:00
Zuul
c5afb1bbd3 Merge "Disable Fluentd Monasca plugin retry limit" 2020-03-17 18:47:12 +00:00
Zuul
5046463b10 Merge "Make Fluentd config folders readable" 2020-03-17 18:41:32 +00:00
Zuul
4d9d366ee1 Merge "CI: Bump up ceph-ansible to 4.0.16" 2020-03-17 16:50:42 +00:00
Doug Szumski
c92378d788 Make Fluentd config folders readable
Currently, config folders lack the execute bit so Fluentd
cannot read the config and just does nothing when it starts up. This
change explicitly sets the execute bit on folders which need it,
rather than doing it in a more generic way which is more risky from
a security perspective.

Change-Id: Ia840f4b67043df4eaa654f47673dcdc973f13d9c
Closes-Bug: #1867754
2020-03-17 12:06:50 +00:00
Michal Nasiadka
71a8eb7485 CI: Bump up ceph-ansible to 4.0.16
Depends-On: https://review.opendev.org/713396

Change-Id: Idb1b6c85fb1fd85129957d4b79bf87d5b28081c0
2020-03-17 10:22:38 +00:00
Michal Nasiadka
81ebae8fd1 CI: Change ceph-ansible docker tag to latest-nautilus
ceph-ansible by default uses "latest" tag for ceph Docker Hub images,
but recently latest tag has been upgraded to be Octopus release,
not Nautilus.

Change-Id: I5247c10079ab91cce130cd5ba403f25ccaf7c1fb
2020-03-17 11:20:36 +01:00
Mark Goddard
dd1ebf20ca CI: install tox
tox will be removed from the base image. Install it before that happens.

This change is made in a simple way that can be easily backported.

Depends-On: https://review.opendev.org/713386

Change-Id: I4181654c88554c81940f0d079cf1d64326cdec79
2020-03-17 09:51:00 +00:00
Radosław Piliszek
cf918fbc29 Fix native openvswitch firewall driver in neutron-openvswitch-agent
ovs-ofctl is still being run by neutron-openvswitch-agent.
Potential removal is scheduled for Victoria.
Until then, we have to mount /run/openvswitch in there.

Change-Id: Ia73b5665cece523bb822f6a223335f6fae94fb6a
Closes-bug: #1867506
2020-03-16 19:36:40 +00:00
Mark Goddard
bab770a88b CentOS 8: Use master image tag by default
While supporting both CentOS 7 and 8, we used the tag 'master-centos8'
for CentOS 8 images. We are now ready to drop CentOS 7 support, and
Kolla is switching to publish CentOS 8 images using the master tag on
the master branch, so we should use this.

Depends-On: https://review.opendev.org/713265

Partially-Implements: blueprint centos-rhel-8

Change-Id: I07d2c285e3214a6dc827a8e8eacf263048ee099b
2020-03-16 15:58:55 +00:00
Zuul
c63722f32a Merge "CI: Ignore neutron-server CRITICAL about WSREP" 2020-03-16 13:22:04 +00:00
Zuul
af3fe8f176 Merge "Use proper es schema in fluentd when use internal tls" 2020-03-16 11:55:42 +00:00
Radosław Piliszek
16ade28d5f CI: Ignore neutron-server CRITICAL about WSREP
We are getting this randomly on neutron-server shutdown
for upgrade.
As it does not affect real operations (and if it did,
we would definitely see it now), let's ignore it.

Change-Id: Ibe561517d44a1108e8223442a71fab36b69c2258
Related-bug: #1863579
2020-03-16 10:00:46 +00:00
Zuul
5a11f14b1b Merge "CI: Debug init-runonce" 2020-03-15 20:18:18 +00:00
Jeffrey Zhang
6aceaee4ad Use proper es schema in fluentd when use internal tls
Fix elasticsearch schema in fluentd when kolla_enable_tls_internal is
true.

Change-Id: I51286d2def7a762d569740c1abc5b924b682ad9d
Closes-Bug: #1867481
2020-03-15 08:47:07 +08:00
Zuul
fd2a5b2cf2 Merge "CI: Use network mode = host for builds" 2020-03-13 20:26:32 +00:00
Mark Goddard
368ad387d0 CI: CentOS 8: Enable Masakari job and periodics
Depends-On: https://review.opendev.org/702706

Change-Id: I5344abe93f682418a0f61c894d64b360bc129592
Partially-Implements: blueprint centos-rhel-8
2020-03-13 10:17:49 +00:00
Zuul
dd55cf6ed0 Merge "Copy ca certificates also to horizon container" 2020-03-12 21:11:35 +00:00
Radosław Piliszek
939b6f7958 Fix telegraf with zookeeper (wrong port variable reference)
Change-Id: I29f65c83b9bd45e463d868cf9a55611f33fe3177
Closes-bug: #1867179
2020-03-12 19:15:56 +01:00
yj.bai
ed2df25ebc Copy ca certificates also to horizon container
Add copy ca file to horizon container.
because:
Could not find a suitable TLS CA certificate bundle,
invalid path: /etc/pki/ca-trust/source/anchors/kolla-customca-haproxy-internal.crt

Closes-Bug: #1867121

Change-Id: I64d4dbeebd53048705005b61eb3c5b2104e8f2ed
Signed-off-by: yj.bai <bai.yongjun@99cloud.net>
2020-03-12 16:59:53 +00:00
Mark Goddard
96151a35d0 Host OS prechecks follow up
We only log the release in the 'Checking host OS release or version'
precheck, but we allow either the release or version to be included in
the list. For example, on CentOS 7:

    CentOS release Core is not supported. Supported releases are: 8

Include the version in the failure message too.

Change-Id: I0302cd4fc94a0c3a6aa1dbac7b9fedf37c11b81e
Related: blueprint improve-prechecks
2020-03-11 17:08:17 +00:00
Zuul
cced7e04e5 Merge "Check supported host OS distributions in prechecks" 2020-03-11 11:19:54 +00:00
Zuul
e49448439b Merge "Fix HAProxy monitor VIP precheck" 2020-03-11 02:43:00 +00:00
Zuul
f867373a73 Merge "support ipv6 for grafana.ini.j2" 2020-03-11 02:29:54 +00:00
Zuul
011ef713f4 Merge "CI: CentOS 8: Enable Ceph Ansible upgrade check job" 2020-03-10 18:52:49 +00:00
yj.bai
3e582a05fa support ipv6 for grafana.ini.j2
grafana not support ipv6 in grafana.ini.j2.

Closes-Bug: #1866141

Change-Id: Ia89a9283e70c10a624f25108b487528dbb370ee4
Signed-off-by: yj.bai <bai.yongjun@99cloud.net>
2020-03-10 17:47:34 +00:00
Will Szumski
a1c51b73c7 Use macro to avoid repetition
I didn't use a for loop as the logic for omitting the
comma for the final element dirties the logic.

Change-Id: Id29d5deebcc5126d69a1bd8395e0df989f2081f0
2020-03-10 13:00:34 +00:00
Zuul
2a2ce059dc Merge "Add notify restart container when cert changed" 2020-03-10 12:12:55 +00:00