10068 Commits

Author SHA1 Message Date
Doug Szumski
cfeb9dd9ef Don't drop unmatched Kolla service logs
Kolla service logs which don't match a Fluentd rewriterule get dropped.
This change prevents that by tagging them with 'unmatched'.

Change-Id: I0a2484d878d5c86977fb232a57c52f874ca7a34c
2019-06-18 12:19:09 +01:00
Doug Szumski
cb404743be Increase log coverage for Monasca
Monasca Python service logs prior to this change were being dropped
due to missing entries in the Fluent record_transformer config file.
This change adds support for ingesting those logs, and explicitly
removes support for ingesting Monasca Log API logs to reduce the risk
of feedback, for example if debug logging is turned on in the Monasca
Log API.

Change-Id: I9e3436a8f946873867900eed5ff0643d84584358
2019-06-18 12:17:32 +01:00
Doug Szumski
4b31fdcf35 Ingest non-standard Monasca logs
Presently, errors can appear in Fluentd and Monasca Log API logs due
to log output from some Monasca services, which do not use Oslo log,
being processed alongside other OpenStack logs which do.

This change parses these log files separately to prevent these errors.

Change-Id: Ie3cbb51424989b01727b5ebaaeba032767073462
2019-06-18 12:14:58 +01:00
Zuul
f1deb7467c Merge "Fix placement log perms in config.json" 2019-06-17 17:48:54 +00:00
Zuul
6cae4dedfe Merge "Remove nova-consoleauth" 2019-06-17 16:28:45 +00:00
Jeffrey Zhang
4e032923c0 Remove nova-consoleauth
The nova-consoleauth service was deprecated during the Rocky release [1]
and has not been necessary since unless you're using cells v1. As Kolla
has never supported cells v1, which is finally being removed during
Train [2], we can get ahead of the curve and stop deploying
nova-consoleauth immediately.

[1] https://specs.openstack.org/openstack/nova-specs/specs/rocky/implemented/convert-consoles-to-objects.html
[2] https://blueprints.launchpad.net/nova/+spec/remove-cells-v1/

Change-Id: I099080979f5497537e390f531005a517ab12aa7a
2019-06-16 16:39:07 +08:00
Zuul
cb0cb441c2 Merge "Update service_provider for FWaaS v2" 2019-06-13 19:24:21 +00:00
Zuul
f7c0e3cdbe Merge "Remove obsolete roles middleware" 2019-06-13 19:24:20 +00:00
Zuul
64c31d1552 Merge "Remove ceilometer transformers config" 2019-06-13 19:24:18 +00:00
Zuul
f0e5f76c64 Merge "Elevate privileges for copying gnocchi policy.json" 2019-06-13 19:24:17 +00:00
Zuul
297cade18c Merge "Fixes VMTP deploys." 2019-06-13 19:24:15 +00:00
Zuul
9c342241f7 Merge "Fix mongo command for checking replication status" 2019-06-13 19:24:14 +00:00
Zuul
922a262345 Merge "Fix issues obtaining Keystone token with Monasca Grafana" 2019-06-13 19:15:43 +00:00
Zuul
29b755eb15 Merge "Remove Neutron LBaaS support" 2019-06-13 19:15:42 +00:00
Zuul
bc117137e6 Merge "Add support for idempotent container stop and removal" 2019-06-13 19:15:40 +00:00
Zuul
b24c3d3b54 Merge "Add load monitoring plugin config for Monasca" 2019-06-13 19:15:39 +00:00
Zuul
ede5f41be3 Merge "Supporting monitoring time synchronisation with Monasca" 2019-06-13 18:58:33 +00:00
Zuul
2af1df6c99 Merge "Fix issue finding custom, host specific plugins" 2019-06-13 18:58:32 +00:00
Zuul
ee895413eb Merge "Stop duplicating Nova cells" 2019-06-13 18:56:00 +00:00
Michal Nasiadka
b850eeec9c Fix placement log perms in config.json
Currently placement-api is configured to log to
/var/log/kolla/placement/placement-api.log, but config.json is changing
permissions of /var/log/kolla/placement/placement.log - this patch
changes this.

Change-Id: I7f1591bdbc7c03302befc3ca6ebf1b13c95640c2
2019-06-13 08:22:21 +00:00
Zuul
806e6be181 Merge "Set log message field name in Monasca Fluentd plugin" 2019-06-11 12:43:41 +00:00
Zuul
860f4ea605 Merge "Include cron_generator script in coverage report" 2019-06-11 08:05:40 +00:00
ZijianGuo
08f5c50e74 Fix mongo command for checking replication status
By default, the mongo command connection address is '127.0.0.1:27017'.
If we change mongodb_port, It cause the handle 'Checking current
replication status' always connect to '127.0.0.1:27017'. So we need
add options like '--host' and '--port'.

Change-Id: I172ef3d19ff2bea97db3a5207c1a984cd188ceba
Signed-off-by: ZijianGuo <guozijn@gmail.com>
2019-06-10 10:58:51 +08:00
Zuul
a7d7838689 Merge "fluentd: Configure td-agent only for x86_64" 2019-06-07 22:30:43 +00:00
Doug Szumski
9a402018fc Include cron_generator script in coverage report
Change-Id: Ic011c25c491d7d2e1d1d656d8d1653e14bb2d1f1
2019-06-07 15:01:03 +00:00
Zuul
1151e5802b Merge "Fix the deploy guide build failed" 2019-06-07 13:16:10 +00:00
Doug Szumski
4be219fcb7 Fix issue finding custom, host specific plugins
The results from the find operation need to be registered per host,
because they depend on the host which runs the search. This bug
impacts users specifying custom plugins for specific hosts.

Change-Id: I41b2986b2f4ccd8fdc6553e83737e4106b6a2c07
2019-06-07 14:01:45 +01:00
Carlos Goncalves
f427920daf Remove Neutron LBaaS support
The project has been retired and there will be no Train release [1].
This patch removes Neutron LBaaS support in Kolla.

[1] https://review.opendev.org/#/c/658494/

Change-Id: Ic0d3da02b9556a34d8c27ca21a1ebb3af1f5d34c
2019-06-07 13:50:19 +01:00
Mark Goddard
d2ae42ce6d Add support for idempotent container stop and removal
This is useful when removing a container that is no longer supported.

Change-Id: I08d79ce7dd2f3d11e466930de85412017cd5f747
2019-06-07 13:50:01 +01:00
Zuul
ef9e85470b Merge "Check for 'become' in tasks that use Docker in pep8" 2019-06-07 10:47:24 +00:00
Zuul
888e50f01b Merge "Use become for all docker tasks" 2019-06-07 10:47:23 +00:00
Doug Szumski
5eb58050f1 Add load monitoring plugin config for Monasca
This simple plugin supports gathering load metrics from /proc.

Change-Id: I536aff093a2af3c6d0d69ae6cbe454aee950f358
2019-06-07 10:54:55 +01:00
Doug Szumski
76e98472f4 Supporting monitoring time synchronisation with Monasca
This plugin is useful for monitoring host clock synchronisation with
an NTP reference. If the delta becomes too large, the metrics from
this plugin can be used to trigger an alarm.

Change-Id: Id1fe6d7c823f8404c19c81ccdeb8b311bcb46e47
2019-06-07 10:54:50 +01:00
Zuul
629edf0a1c Merge "Fix the document of external ceph for gnocchi" 2019-06-07 09:08:14 +00:00
Zuul
4eb141e160 Merge "Fix monasca grafana organisation check" 2019-06-07 09:08:12 +00:00
Zuul
cbc09a9131 Merge "Add support for elasticsearch TLS and authentication in fluentd" 2019-06-07 09:08:10 +00:00
Zuul
796980aa3f Merge "Add ansible_nodename (system hostname) to /etc/hosts" 2019-06-07 09:08:08 +00:00
Zuul
a4431930c6 Merge "Remove /%(tenant_id)s suffix from v2.1 endpoints" 2019-06-07 09:08:07 +00:00
Zuul
20e1e639bb Merge "[cloudkitty] Remove unused option from configuration file template" 2019-06-07 09:08:06 +00:00
Zuul
0a1ad98105 Merge "Support multi-region discovery of Nova cells" 2019-06-07 09:08:04 +00:00
Zuul
069bdd0415 Merge "Fix docs - simply run the script instead of sourcing it" 2019-06-07 08:53:44 +00:00
Zuul
68a81d48ec Merge "Fix docs - do not mention the old, deprecated CLI clients" 2019-06-07 08:53:42 +00:00
Zuul
01f0f2387d Merge "Hide logs when looping over passwords" 2019-06-07 08:53:40 +00:00
Zuul
fc5a1b4d71 Merge "[heat] Multi-region support for bootstrap" 2019-06-07 08:53:38 +00:00
Zuul
c9bc1f3ad1 Merge "Add blazar to fluentd aggregation" 2019-06-07 08:53:37 +00:00
Zuul
7d8569354e Merge "Update contributor guide" 2019-06-07 08:53:35 +00:00
Zuul
d71f15412a Merge "Add deploy guide stuff to irrelevant file list of zuul" 2019-06-07 08:19:25 +00:00
Mark Goddard
e474c6ca19 Check for 'become' in tasks that use Docker in pep8
We should use become: true for all tasks that use Docker.

Change-Id: I5ce06cc6f2c7403a1c36aadf9e55068c780f05ac
2019-06-06 19:05:01 +01:00
Mark Goddard
b123bf6621 Use become for all docker tasks
Many tasks that use Docker have become specified already, but
not all. This change ensures all tasks that use the following
modules have become:

* kolla_docker
* kolla_ceph_keyring
* kolla_toolbox
* kolla_container_facts

It also adds become for 'command' tasks that use docker CLI.

Change-Id: I4a5ebcedaccb9261dbc958ec67e8077d7980e496
2019-06-06 19:04:58 +01:00
Pierre Riteau
19b8dbe460 Stop duplicating Nova cells
Check if a base Nova cell already exists before calling `nova-manage
cell_v2 create_cell`, which would otherwise create a duplicate cell when
the transport URL or database connection change.

If a base cell already exists but the connection values have changed, we
now call `nova-manage cell_v2 update_cell` instead. This is only
possible if a duplicate cell has not yet been created. If one already
exists, we print a warning inviting the operator to perform a manual
cleanup. We don't use a hard fail to avoid an abrupt change of behavior
if this is backported to stable branches.

Change-Id: I7841ce0cff08e315fd7761d84e1e681b1a00d43e
Closes-Bug: #1734872
2019-06-06 18:10:06 +01:00