11442 Commits

Author SHA1 Message Date
Mark Goddard
7ff27de7ac Performance: remove unnecessary conditions from includes
There are a number of tasks where we conditionally use include_tasks
with a condition, and the condition is always true. This change removes
these conditions, in preparation for switching unconditional task
includes to task imports.

Partially-Implements: blueprint performance-improvements

Change-Id: I3804c440fe3552950d9d434ef5409f685c39bbcf
2020-07-07 15:50:58 +01:00
Zuul
904f1c9bd9 Merge "Remove monasca log api upgrade task (planned)" 2020-07-06 18:56:44 +00:00
wu.chunyang
3e0f4f2bd0 Remove monasca log api upgrade task (planned)
Change-Id: I51054561af93f03e09fa86eeec7c579aca103cdf
2020-07-06 15:01:04 +00:00
Zuul
532599520a Merge "Add support for the Neutron service plugin "trunk"" 2020-07-06 12:32:51 +00:00
Zuul
b42278cb77 Merge "Use the children group for site.yml" 2020-07-05 17:54:16 +00:00
Zuul
94ddaad34e Merge "Remove policy file from nova-conductor config.json template" 2020-07-05 16:02:28 +00:00
Zuul
aac4b5a167 Merge "Remove the neutron-fwaas roles since it retired" 2020-07-05 16:02:26 +00:00
gugug
dc56401b42 Use the children group for site.yml
1. Use the children group for site.yml
2. Add some missing groups

Change-Id: I01d686368b11a105a8965cf987d23772ecbf97de
2020-07-05 22:56:17 +08:00
Zuul
f9e7235697 Merge "make barbican notification driver configurable" 2020-07-05 11:56:04 +00:00
Pierre Riteau
c40e806587 Remove policy file from nova-conductor config.json template
Change I810aad7d49db3f5a7fd9a2f0f746fd912fe03917 for supporting multiple
Nova cells updated the list of containers that require a policy file to
only include nova-api, nova-compute, and nova-compute-ironic.

The nova-conductor config.json template was left unchanged and fails to
copy the nova policy file into its container. This can be seen on a
fresh deployment, but might be missed on an upgrade if an older policy
file is still available in /etc/kolla/nova-conductor.

This commit removes the nova_policy_file block from the nova-conductor
config.json template, as it shouldn't be required.

Backport: ussuri, train
Change-Id: I17256b182d207aeba3f92c65a6d7cf3611180558
Closes-Bug: #1886170
2020-07-03 12:52:57 +02:00
Zuul
75e1a87ef5 Merge "Fix Fluentd date format for MariaDB xinetd" 2020-07-02 20:23:17 +00:00
wu.chunyang
051038621f make barbican notification driver configurable
barbican alway use default notification driver (defalt '')
so we should change this value according to whether enable
notification

Change-Id: Ia17a64fe9bf31042369dec19f1f76b1ab8592288
2020-07-02 22:48:31 +08:00
Zuul
2a2a62000e Merge "Set a chunk size for Fluentd bulk log upload to Monasca" 2020-07-02 11:29:02 +00:00
Justinas Balciunas
dda5269ce7 Fix Fluentd date format for MariaDB xinetd
Time format in Ruby Time.strptime is not accepting padding flags,
therefore we need to remove them for the Fluentd to be able
to parse MariaDB xinetd logs properly.

Change-Id: Iabfa9afdcad505106a5580eb2d058273ee5f7c1f
Closes-Bug: #1886002
2020-07-02 08:45:44 +00:00
Stig Telfer
2c919bc61c Set a chunk size for Fluentd bulk log upload to Monasca
In Fluentd v0.12, both the in memory and file buffer chunk size default
to 8MB. In v1.0 the file buffer defaults to 256MB. This can exceed the
Monasca Log or Unified API maximum chunk size which is set to 10MB.
This can result in logs being rejected and filling the local buffer
on disk.

Change-Id: I9c495773db726a3c5cd94b819dff4141737a1d6e
Closes-Bug: #1885885
Co-Authored-By: Sebastian Luna Valero <sebastian.luna.valero@gmail.com>
2020-07-02 08:39:51 +01:00
Zuul
788191c8f2 Merge "Syntax error in Fluentd Monasca output config" 2020-07-01 17:00:29 +00:00
Zuul
11dc4d858e Merge "Make ES Curator schedule multinode-friendly" 2020-07-01 16:18:52 +00:00
Zuul
ab3d343794 Merge "Use public interface for Magnum client and trustee Keystone interface" 2020-07-01 15:39:46 +00:00
Radosław Piliszek
b82eb1b393 Make ES Curator schedule multinode-friendly
In the spirit of Kolla-Ansible, we generally try to provide
workable defaults.
The default for Elasticsearch curator schedule was fine except for
multinode deploys where it would cause all nodes to run at the
same time producing broken runs (race condition in the get-delete
cycle).
It is easy to improve this situation by embracing poor-man's
reimplementation of keystone's fernet key rotation schedule.
ES Curator does not need all the complexity of the former so it
can be handled very well by shifting by as many hours as the
instance's index dictates. It should rarely if ever need more time
(most likely still in minutes range rather than hours).

Change-Id: I9d6758c8550308d13d936de1a14afbe4124e593b
2020-07-01 11:55:51 +02:00
Stig Telfer
6c1ce76bb8 Syntax error in Fluentd Monasca output config
Resolve trivial syntax error in Fluentd output config for Monasca.

Change-Id: I20b37bb83a76bfabb1126925a1b4f1f59767b7a3
Co-Authored-By: Sebastian Luna Valero <sebastian.luna.valero@gmail.com>
Closes-Bug: #1885873
2020-07-01 10:55:15 +02:00
Bharat Kunwar
78bb594264 Use public interface for Magnum client and trustee Keystone interface
While all other clients should use internalURL, the Magnum client itself
and Keystone interface for trustee credentials should be publicly
accessible (upstream default when no config is specified) since
instances need to be able to reach them.

Closes-Bug: #1885420
Change-Id: I74359cec7147a80db24eb4aa4156c35d31a026bf
2020-07-01 08:45:12 +00:00
Radosław Piliszek
852c7a32c3 Fix the Elasticsearch Curator cron schedule run
There were two issues with it. Lack of /usr/local/bin in PATH
for CentOS and wrong crontab path for Ubuntu/Debian.
This patch mirrors how it is handled in keystone.

Change-Id: Ib54b261e12c409d66b792648807646015826e83c
Closes-Bug: #1885732
2020-06-30 16:39:55 +02:00
Zuul
cdd7a8a1c7 Merge "[docs] Update quickstart for Ussuri+" 2020-06-30 12:02:05 +00:00
Zuul
6839cf5315 Merge "Fix unexpected message without globals.d" 2020-06-30 12:02:04 +00:00
Zuul
74014428c3 Merge "Fix Zun configuration for TLS" 2020-06-30 12:02:00 +00:00
Radosław Piliszek
271df7befc [docs] Update quickstart for Ussuri+
Mostly due to move to Python3-only.

Also fix the other venv docs to avoid virtualenv. :-)

Change-Id: Id89c4ec6ff8b80feace01a3dee7dd30dd4cc5ec5
2020-06-30 12:29:45 +02:00
James Kirsch
9bd89b28cf Fix Zun configuration for TLS
The Zun configuration file does not set the CA for the clients the Zun
service uses: zun_client, glance_client, neutron_client, cinder_client,
and placement_client. This will cause the Zun service to fail when
TLS is enabled in the OpenStack deployment.

Depends-On: https://review.opendev.org/#/c/736809
Change-Id: Ieed843c890210608699c1a63deed66c9bb63986c
2020-06-29 08:48:32 -07:00
Mark Goddard
4d8d678240 Fix unexpected message without globals.d
Recently a feature was merged to support pulling in multiple
configuration files from a globals.d directory. However, if this
directory does not exist, we get the following error when executing
kolla-ansible:

    find: '/etc/kolla/globals.d': No such file or directory

This change addresses this by redirecting find command stderr to
/dev/null.

TrivialFix

Change-Id: Ie5aa511a5ebf3355817a7c3bb65b09ac5dcf2b67
2020-06-29 14:11:05 +01:00
Zuul
e7329a7619 Merge "Remove mox3 from lower-constraints.txt" 2020-06-29 11:20:29 +00:00
Zuul
6b582eae98 Merge "Fix etcd protocol configuration" 2020-06-29 11:20:27 +00:00
Christian Berendt
3ff15a8ee7 Add support for the Neutron service plugin "trunk"
Change-Id: Ia22f286e85be90983ca79291b3a54596bba30d6c
2020-06-29 11:18:03 +02:00
James Kirsch
a158432223 Fix etcd protocol configuration
The etcd service protocol is currently configured with internal_protocol.
The etcd service is not load balanced by a HAProxy container, so
there is no proxy layer to do TLS termination when internal_protocol
is configured to be "https".

Until the etcd service is configured to deploy with native TLS
termination, the etcd uses should be independent of
internal_protocol, and "http" by default.

Change-Id: I730c02331514244e44004aa06e9399c01264c65d
Closes-Bug: 1884137
2020-06-27 07:37:36 +00:00
Zuul
0673e98539 Merge "Verify TLS by default for Kibana to Elasticsearch" 2020-06-26 21:34:31 +00:00
Zuul
943c8670da Merge "Support CA certificate for fluentd & Elasticsearch" 2020-06-26 21:34:29 +00:00
Zuul
214a24f4b2 Merge "Skip storm play when not enabled" 2020-06-26 17:07:57 +00:00
Zuul
b47c912a3a Merge "Fix Magnum trust operations in multi-region clouds" 2020-06-26 17:07:32 +00:00
Zuul
74b4afdccc Merge "Use internalURL endpoint_type for all clients used by Magnum" 2020-06-26 16:48:44 +00:00
Mark Goddard
76c3f05680 Skip storm play when not enabled
Minor scalability improvement, not currently applied to storm.

Change-Id: I928d362067c52c3113bc0fbd3ae4b9be1810b7e5
TrivialFix
2020-06-26 14:42:54 +01:00
Zuul
6f26907a0a Merge "openvswitch: Use ansible_hostname for system-id" 2020-06-26 08:46:14 +00:00
Zuul
a1c47c9aa3 Merge "Change neutron-ovs-agent deploy only with manila generic backend" 2020-06-25 13:49:14 +00:00
Michal Nasiadka
cecdb6a175 openvswitch: Use ansible_hostname for system-id
Currently openvswitch sets system-id based on inventory_hostname, but when
Ansible inventory contains ip addresses - then it will only take first ip
octet - resulting in multiple OVN chassis being named i.e. "10".
Then Neutron and OVN have problems functioning, because a chassis named "10"
will be created and deleted multiple times per second - this ends up in
ovsdb and neutron-server processes using up to 100% CPU.

Adding openvswitch role to ovn CI job triggers.

Change-Id: Id22eb3e74867230da02543abd93234a5fb12b31d
Closes-Bug: #1884734
2020-06-25 14:20:08 +02:00
Zuul
4b2d443e1f Merge "Improve error reporting in password utilities" 2020-06-25 10:36:14 +00:00
Zuul
3225a85053 Merge "octavia: Add documentation" 2020-06-25 10:36:13 +00:00
Mark Goddard
e91fd969ac Verify TLS by default for Kibana to Elasticsearch
Currently, if internal TLS communication is enabled, Kibana to
Elasticsearch communication is unverified. This is because we set
elasticsearch.ssl.verificationMode to 'none' by default (via
kibana_elasticsearch_ssl_verify). This is poor a security
posture.

This change changes the default value of
'kibana_elasticsearch_ssl_verify' to 'true'.

Change-Id: Ie4fa8e3a60d69cf5c4bdd975030c92be8113ffb1
Closes-Bug: #1885110
2020-06-25 10:35:18 +01:00
Mark Goddard
31f3f84859 Support CA certificate for fluentd & Elasticsearch
Currently there is no way to configure a CA certificate bundle file for
fluentd to Elasticsearch communication. This change adds a new variable,
'fluentd_elasticsearch_cacert' with a default value set to the value of
'openstack_cacert.

Closes-Bug: #1885109

Change-Id: I5bbf55a4dd4ccce9fa2635cee720139c088268e3
2020-06-25 10:35:14 +01:00
Michal Nasiadka
c4c3ceca31 Change neutron-ovs-agent deploy only with manila generic backend
Change openvswitch & neutron-openvswitch-agent to deploy only
with manila generic backend - which uses ovs-vsctl functionality
when configuring share servers.

Change-Id: I124108cda62b38ea498612ff9ddb07d6122a330c
Closes-Bug: #1884939
2020-06-25 09:10:53 +00:00
Bharat Kunwar
eb24945d75 Use internalURL endpoint_type for all clients used by Magnum
Magnum, Cinder and Octavia clients in Magnum now use endpoint_type of
internalURL by default consistent with other clients also used by the
conductor. Additionally, they also use the globally defined
`openstack_region_name` for region_name.

Closes-Bug: #1885096

Change-Id: Ibec511013760cc4f681a2ec1b769b532be3daf2d
2020-06-25 09:36:06 +01:00
Pierre Riteau
dda9a1465a Fix Magnum trust operations in multi-region clouds
Change-Id: I7214ef38ea529f7585d7a0c75b8b0498ea4c58a2
Closes-Bug: #1885078
2020-06-25 08:23:30 +02:00
Zuul
475901d9f6 Merge "Enable ZooKeeper when Storm is enabled" 2020-06-24 16:45:24 +00:00
Pierre Riteau
866784c77a Enable ZooKeeper when Storm is enabled
ZooKeeper is a dependency of Apache Storm.

TrivialFix

Change-Id: Icf952be2e0b53f2e82e8ce18a48bcfa100b41cd9
2020-06-24 14:56:33 +02:00