10334 Commits

Author SHA1 Message Date
Zuul
01bc357d0b Merge "Don't drop unmatched Kolla service logs" 2019-06-27 12:25:11 +00:00
Zuul
067e40ad32 Merge "Increase log coverage for Monasca" 2019-06-27 12:22:20 +00:00
Zuul
e7c19b7413 Merge "Enable InfluxDB TSI by default" 2019-06-27 11:44:51 +00:00
Zuul
e5ad12c429 Merge "doc: Start using openstackdoctheme's extlink extension" 2019-06-27 11:33:48 +00:00
ZijianGuo
e610a73e98 Add extra volumes support for services that were not previously supported
We don't add extra volumes support for all services in patch [1].
In order to unify the management of the volume, so we need add extra volumes
support for these services.

[1] 12ff28a693

Change-Id: Ie148accdd8e6c60df6b521d55bda12b850c0d255
Partially-Implements: blueprint support-extra-volumes
Signed-off-by: ZijianGuo <guozijn@gmail.com>
2019-06-27 18:32:15 +08:00
Christian Berendt
a3f1ded357 Add support for neutron custom dnsmasq.conf
Change-Id: Ia7041be384ac07d0a790c2c5c68b1b31ff0e567a
2019-06-27 12:20:12 +02:00
Mark Goddard
e6d2b92200 Restart all nova services after upgrade
During an upgrade, nova pins the version of RPC calls to the minimum
seen across all services. This ensures that old services do not receive
data they cannot handle. After the upgrade is complete, all nova
services are supposed to be reloaded via SIGHUP to cause them to check
again the RPC versions of services and use the new latest version which
should now be supported by all running services.

Due to a bug [1] in oslo.service, sending services SIGHUP is currently
broken. We replaced the HUP with a restart for the nova_compute
container for bug 1821362, but not other nova services. It seems we need
to restart all nova services to allow the RPC version pin to be removed.

Testing in a Queens to Rocky upgrade, we find the following in the logs:

Automatically selected compute RPC version 5.0 from minimum service
version 30

However, the service version in Rocky is 35.

There is a second issue in that it takes some time for the upgraded
services to update the nova services database table with their new
version. We need to wait until all nova-compute services have done this
before the restart is performed, otherwise the RPC version cap will
remain in place. There is currently no interface in nova available for
checking these versions [2], so as a workaround we use a configurable
delay with a default duration of 30 seconds. Testing showed it takes
about 10 seconds for the version to be updated, so this gives us some
headroom.

This change restarts all nova services after an upgrade, after a 30
second delay.

[1] https://bugs.launchpad.net/oslo.service/+bug/1715374
[2] https://bugs.launchpad.net/nova/+bug/1833542

Change-Id: Ia6fc9011ee6f5461f40a1307b72709d769814a79
Closes-Bug: #1833069
Related-Bug: #1833542
2019-06-27 09:36:20 +00:00
Mark Goddard
3b218fd0db Fix conditionals in CI playbook
These were not templated, so always evaluated to true. This shouldn't be
causing any issues.

Change-Id: I7b8e407e688ba201c4f7d1a94bbd41af0918e7df
2019-06-27 10:32:22 +01:00
Mark Goddard
09e29d0db9 Don't rotate keystone fernet keys during deploy
When running deploy or reconfigure for Keystone,
ansible/roles/keystone/tasks/deploy.yml calls init_fernet.yml,
which runs /usr/bin/fernet-rotate.sh, which calls keystone-manage
fernet_rotate.

This means that a token can become invalid if the operator runs
deploy or reconfigure too often.

This change splits out fernet-push.sh from the fernet-rotate.sh
script, then calls fernet-push.sh after the fernet bootstrap
performed in deploy.

Change-Id: I824857ddfb1dd026f93994a4ac8db8f80e64072e
Closes-Bug: #1833729
2019-06-27 08:41:27 +00:00
Radosław Piliszek
cc058f4586 Make nova external ceph key extraction tasks non-changing
They are used only to obtain keys for the next task.

Change-Id: I2fac22af4710b70e4df8e3a272bcfb6cc8b8532e
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-26 14:21:20 +02:00
Zuul
f9ca973869 Merge "Do not run Zuul kolla-ansible-base jobs when modifying globals.yml" 2019-06-26 09:27:09 +00:00
Zuul
100a20769f Merge "Add gnocchi extra volumes" 2019-06-25 18:38:37 +00:00
Zuul
6db1db57df Merge "Add missing docker_registry_insecure in globals.yml" 2019-06-24 15:29:54 +00:00
Zuul
693a30275f Merge "Add CI job for ironic" 2019-06-24 15:15:41 +00:00
Zuul
b32ddaa901 Merge "link kolla_logs volume to docker_runtime_directory if docker_runtime_directory variable exists" 2019-06-24 13:35:45 +00:00
Zuul
2ef50535fe Merge "Use'openstack_region_name' in cloudkitty collectors and fetchers" 2019-06-24 13:08:30 +00:00
Zuul
7cfab57cb9 Merge "Method to override the default ceilometer meters.yaml via Kolla-ansible" 2019-06-24 13:08:28 +00:00
Zuul
417fa831bc Merge "Use 'openstack_service_workers' as the nb of Cloudkitty workers" 2019-06-24 13:08:26 +00:00
Zuul
a956c53181 Merge "Remove `hnas_iscsi` from the supported storage backends list of Cinder" 2019-06-24 13:08:24 +00:00
Zuul
03976399f0 Merge "Avoid parallel discover_hosts (nova-related race condition)" 2019-06-24 13:08:23 +00:00
Zuul
0cbebc4786 Merge "Fix the redis_connection_string for osprofiler and make it generic" 2019-06-24 13:08:21 +00:00
Zuul
4fb6c2d90f Merge "Add some notes for users Migrating to Kolla Monasca" 2019-06-24 13:08:20 +00:00
Zuul
8622d6fcc6 Merge "CI - remove unnecessary logic when building images for upgrade" 2019-06-24 13:08:18 +00:00
Zuul
4303de142c Merge "Implement Apache WSGI for Qinling" 2019-06-24 11:30:59 +00:00
Zuul
d16b68fc1d Merge "Designate - remove obsolete task" 2019-06-24 11:08:44 +00:00
chenxing
b7ca065edf Remove `hnas_iscsi` from the supported storage backends list of Cinder
The Hitachi NAS Platform iSCSI driver was marked as not supported by
Cinder in the Ocata realease[1].

[1] https://review.opendev.org/#/c/444287/

Change-Id: I1a25789374fddaefc57bc59badec06f91ee6a52a
Closes-Bug: #1832821
2019-06-24 09:04:14 +00:00
ZijianGuo
d23a88d7e8 Add gnocchi extra volumes
In some cases, we can mount extra volumes for gnocchi to facilitate
integration.

Change-Id: Ife475ca7d0555562f6e3ef0867835d69d288c8c4
Signed-off-by: ZijianGuo <guozijn@gmail.com>
2019-06-24 16:57:42 +08:00
Radosław Piliszek
957f6dd453 Designate - remove obsolete task
"Check if policies shall be overwritten" already exists in its
newer form. The removed one had no effect on play.

Change-Id: I48ed6c1c71c4162a3ab28ab2b51dc1e02932dfef
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-21 21:21:15 +02:00
Radosław Piliszek
480e575000 CI - remove unused setup scripts
This patch removes old, unused setup scripts.
They belong to kolla anyway.

Change-Id: Ia8dcd39991177153af61c638c7ae05123da08e82
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-21 15:10:34 +00:00
ZijianGuo
d7c4a4f2b9 Replace merge_configs with merge_yaml for merge mongodb.conf
Actually, 'mongodb.conf' is a yaml format configuration file. Do not use
merge_configs to merge it.

Change-Id: Id3c006df00c1e2d66472c2195781e01c640cab22
Signed-off-by: ZijianGuo <guozijn@gmail.com>
2019-06-21 22:40:25 +08:00
Doug Szumski
015ddb6e37 Enable InfluxDB TSI by default
The TSI is recommended for all users. Some of the key benefits are
a reduction in memory requirements and an increase in the maximum
number of time series. For more information see this link:

https://docs.influxdata.com/influxdb/v1.7/concepts/tsi-details/

Change-Id: I4b29eb5a4ae82f6c39059d0b6de41debdfd75508
2019-06-21 14:48:12 +01:00
Gaëtan Trellu
f867c471fb Implement Apache WSGI for Qinling
Since this review[1], Qinling supports WSGI execution.

From a production perspective, Qinling should be deployed
using Apache and mod_wsgi.

"api_worker" option is not needed anymore because processes will
be handle by Apache mod_wsgi.

Qinling Docker image review[2] has ben created.

[1] https://review.opendev.org/661851
[2] https://review.opendev.org/666647

Change-Id: I9aaee4c2932f1e4ea9fe780a64e96a28fa6bccfb
Story: 2005920
Task: 34181
2019-06-21 09:46:02 -04:00
Radosław Piliszek
8ce5ffd0c2 CI - remove unnecessary logic when building images for upgrade
Docker registry being insecure is handled by docker_registry_insecure
which is set to true by default when docker_registry is set.
The removed code had no effect because docker_registry is not changed
anyway for base (pre-upgrade) install.

This change makes config more readable and also prevents a potential
conflict with the zun profile if ever used in upgrade mode.

Change-Id: I9b5ae8c5b534fa6cce9dbaca8af191e2ca79d19f
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-21 11:31:30 +00:00
Radosław Piliszek
a81f18dfe9 Add missing docker_registry_insecure in globals.yml
Change-Id: I99d4ea6ca615bdde83cd55d91672733d9b95372a
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-21 11:25:54 +02:00
Radosław Piliszek
a1b8abcf85 CI - remove unused required-projects
openstack/requirements is not used.
openstack/kolla is used conditionally when Zuul itself adds it
due to dependency.
No need to always clone the two repositories.

Change-Id: Iabfc25e2b4227ae227f06ab196ca544b02e7808f
Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-21 08:29:41 +02:00
Doug Szumski
c4f488adcf Add some notes for users Migrating to Kolla Monasca
This commit should help guide people migrating to Kolla Monasca
through the murky depths of the migration process. Since Kolla
did not support Monasca in Queens, some of these steps which
could be automated are not.

Change-Id: I79051cca27178c3cf1671f5c603e38baf929c55c
2019-06-20 17:30:29 +01:00
Zuul
bc7dea58c2 Merge "Ingest non-standard Monasca logs" 2019-06-20 10:03:11 +00:00
Gaëtan Trellu
b1c28e95b0 Fix Qinling deployment and reconfigure
The "environment" variable set in config.yml and handlers/main.yml
has been removed to fix de deployment and the reconfigure.

Change-Id: I912cadb5113d5572235731863825588b2eb12759
2019-06-19 16:16:19 -04:00
Zuul
8ce545e7b8 Merge "Fix default deployment of freezer, use mariadb." 2019-06-19 13:59:53 +00:00
Zuul
84caa99674 Merge "Add logrotate configuration for horizon" 2019-06-19 12:08:58 +00:00
Zuul
23c27ed8bb Merge "Make Ceph upgrade check Ceph release to avoid EPERM" 2019-06-19 09:56:58 +00:00
Zuul
16186537a6 Merge "Remove heat_watch_server_url configuration option" 2019-06-19 04:39:32 +00:00
Tatsuma Matsuki
1d02ec49f6 Add logrotate configuration for horizon
Change-Id: I97263385372a28204c0ae81373836a2d6292f3bd
Closes-Bug: #1833336
2019-06-19 13:33:34 +09:00
Marek Svensson
10bf6b05fa Fix default deployment of freezer, use mariadb.
This change defaults freezer to use mariadb as default backend for database
and adds elasticsearch as an optional backend due to the requirement of
freezer to use elasticsearch version 2.3.0. The default elasticsearch in
kolla-ansible is 5.6.x and that doesn't work with freezer.

Added needed options to the elasticsearch backend like:
 - protocol
 - address
 - port
 - number of replicas

Change-Id: I88616c285bdb297fd1f738846ddffe1b08a7a827
Signed-off-by: Marek Svensson <marek@marex.st>
2019-06-18 15:12:36 -04:00
Zuul
49c2f48916 Merge "Fix mongo command for supporting other port" 2019-06-18 17:40:02 +00:00
Zuul
0bd468004e Merge "Do not create Keystone domain-specific config directory if useless" 2019-06-18 17:02:08 +00:00
Doug Szumski
d89a89c26b Format internal Fluentd logs
This change formats internal Fluent logs in a similar way to other
logs. It makes it easier for a user to identify issues with Fluent
parsing logs. Any failure to parse a log will be ingested into the
logging framework and can easily be located by searching for
'pattern not match' or by filtering for Fluent log warnings.

Change-Id: Iea6d12c07a2f4152f2038d3de2ef589479b3332b
2019-06-18 15:56:16 +01:00
ZijianGuo
cd836dd39f Fix the redis_connection_string for osprofiler and make it generic
* When using redis as the backend of osprofiler, it cannot connect to
redis because the redis_connection_string is incorrect.

* Let other places that use redis also use this variable.

Change-Id: I14de6597932d05cd7f804a35c6764ba4ae9087cd
Closes-Bug: #1833200
Signed-off-by: ZijianGuo <guozijn@gmail.com>
2019-06-18 21:52:52 +08:00
Zuul
2fd984544d Merge "Comment out all variables in globals.yml" 2019-06-18 12:19:10 +00:00
Zuul
80f7926204 Merge "Make cron jobs generator command task in keystone non-changing" 2019-06-18 12:19:08 +00:00