4281 Commits

Author SHA1 Message Date
Christian Berendt
6898d76287 Use kibana instead of Kibana as project_name
All other project names are lowercase.

Change-Id: I7046d3f6b610a46a69504a283c933d83f266a3db
2018-10-24 13:44:40 +02:00
Christian Berendt
c1acb65642 Fix template src of kibana configuration file
Change-Id: I4d409e052c00d83b451a2a13917f89531a88457f
2018-10-24 13:35:59 +02:00
Zuul
64d8dcdebd Merge "Make custom kibana configuration files possible" 2018-10-24 09:50:41 +00:00
Zuul
0fd03fc88d Merge "Fix keystone domains directory permissions" 2018-10-23 20:16:30 +00:00
Christian Berendt
864e589803 nova: add support for a dedicated migration network
Two new parameters (migration_interface, migration_interface_address) to make
the use of a dedicated migration network possible.

Change-Id: I723c9bea9cf1881e02ba39d5318c090960c22c47
2018-10-23 18:37:28 +02:00
Zuul
606a7e0b42 Merge "Allow custom mongodb configurations" 2018-10-23 12:56:14 +00:00
Zuul
998f449c89 Merge "Make the reconfigure action works" 2018-10-23 08:24:29 +00:00
Christian Berendt
1192f93f6b Fix keystone domains directory permissions
Closes-bug: #1799348

Change-Id: I4c43076795d28ea36f9e1d165e56abb110c5b544
2018-10-23 07:24:49 +02:00
Christian Berendt
c96633d454 Make custom kibana configuration files possible
Change-Id: Iedfad564f834504fa1f4bfd935cd735d1d9ee65f
2018-10-23 07:04:14 +02:00
Kien Nguyen
4dd4573759 Allow custom mongodb configurations
Change-Id: I114c582181e0c58fc5b3ce5b1735fb54a0fdd93e
2018-10-23 09:11:46 +07:00
Zuul
e6c5be4b50 Merge "Make the neutron container restart when it changed" 2018-10-22 19:45:33 +00:00
Zuul
278e04fcc9 Merge "Enable setting of ceilometer as a non-root user" 2018-10-22 16:06:35 +00:00
caoyuan
3b13304b52 Make the reconfigure action works
Change-Id: I0412c4d15fea97cf466287a5bed62427b43df7ea
Closes-Bug: #1799243
2018-10-22 23:18:06 +08:00
Hongbin LU
f57c1aec6c Add Zun scenario job for ubuntu
Introduce a job 'kolla-ansible-ubuntu-source-zun' to test kolla
with Zun enabled. To reduce CI resource, this job will be triggered
only if there are changes on the Zun's ansible roles.

Change-Id: I0ba207e1d3761da2d6992c5834d4f59e7e1d6628
2018-10-22 14:24:36 +00:00
Kevin Tibi
35a21b0711 Fernet cron path
Fix the path of fernet cron for centos images

Change-Id: Iedf3a8630bc3c25fd05f580980d499023bf974fa
2018-10-22 10:49:34 +02:00
caoyuan
574b022161 Make the neutron container restart when it changed
Change-Id: I5631fd12d8cd1815ba0045f3fad272066265e3f5
Closes-Bug: #1798971
2018-10-20 22:55:02 +08:00
ZhijunWei
13f8aef9f8 Optimize reconfiguration for multipathd
Change-Id: I288fa5ea202376d481de6966150e7e050e390f03
Partially-implements: blueprint better-reconfigure
Co-Authored-By: caoyuan <cao.yuan@99cloud.net>
Closes-Bug: #1796219
2018-10-20 03:35:17 +00:00
Zuul
a4d9188208 Merge "Add Aodh evaluation_interval" 2018-10-19 06:10:36 +00:00
Zuul
9efd44d937 Merge "[nova] Fix missing blacklist permission." 2018-10-17 16:02:41 +00:00
Zuul
c47ee4fb2a Merge "Constrain the size of Docker logs" 2018-10-16 10:56:54 +00:00
frauniki
4b2d2cc128 Enable setting of ceilometer as a non-root user
By adding 'become' element, you can set ceilometer as non root user.

Change-Id: I146f3aec6b1270d40c02f4f7883c169aaa796239
Closes-Bug: #1798035
2018-10-16 17:48:18 +09:00
Kien Nguyen
224125bf5e Add Aodh evaluation_interval
Alarm service has been moved to Aodh for a long time [1].
Therefore, we should define evaluation_interval in
aodh.conf rather than ceilometer.conf. The interval value
should be configurable as well because we can use a
custom polling config now [2]

[1] https://review.openstack.org/#/c/200593/
[2] https://review.openstack.org/#/c/572013/

Change-Id: I7adeff2dff5d6d6ae4c621e84857347995e9203a
2018-10-16 08:14:22 +07:00
Doug Szumski
58eec5ca12 Forward system logs to Monasca Log API
When Monasca is enabled disable direct logging to ElasticSearch and
send all logs harvested by Fluentd to the Monasca Log API.

This change also cleans up output files which may be left behind when
the various log forwarding options are enabled / disabled.

Partially-Implements: blueprint monasca-roles
Change-Id: I7197966c5117176407d60c86c08d3bcea5e8131a
2018-10-12 08:25:28 +00:00
Kien Nguyen
3cac115595 Remove deprected notification_topics option
notification_topics was deprecated. Now we use
oslo_messaging_notifications.topics option instead [1]

[1] https://docs.openstack.org/oslo.messaging/latest/configuration/opts.html#oslo-messaging-notifications

Change-Id: I9ed3cca6d25d08494e0933a1fb8a9502b07b9775
2018-10-12 10:39:21 +07:00
Doug Szumski
bd54b99132 Constrain the size of Docker logs
Even though Kolla services are configured to log output to file rather than
stdout, some stdout still occurs when for example the container re(starts).
Since the Docker logs are not constrained in size, they can fill up the
docker volumes drive and bring down the host. One example of when this is
particularly problematic is when Fluentd cannot parse a log message. The
warning output is written to the Docker log and in production we have seen
it eat 100GB of disk space in less than a day. We could configure Fluentd
not to do this, but the problem may still occur via another mechanism.

Change-Id: Ia6d3935263a5909c71750b34eb69e72e6e558b7a
Closes-Bug: #1794249
2018-10-11 13:31:47 +01:00
Cédric Jeanneret
778dba94a4 Load known, standard kernel modules from the host, not within containers
Known kernel modules are:
- dm-multipath (for multipathd)
- ip_vs (for keepalived)
- iscsi_tcp (for ironic-conductor)
- openvswitch (for openvswitch-vswitchd)

Change-Id: I1841ec30cde142c8019830ad3190847dfe493eb9
2018-10-11 10:26:34 +02:00
Mark Goddard
242625dff4 Generate Ceph configuration during upgrade
If upgrading the nova, cinder or manila services via 'kolla-ansible
upgrade', the Ceph config files are not generated. Users will expect
that these files are generated, to pull in any changes from their
configuration or the base kolla configuration.

This change moves Ceph tasks inside config.yml to ensure that they are
performed during deploy, reconfigure and upgrade. This has been done for
nova, cinder, gnocchi and manila - glance already does this.

Change-Id: Ic75692c2bcba9b81dee922ff6fbbccd160e7fa19
Closes-Bug: #1794275
2018-10-10 10:48:55 +01:00
Zuul
8045b3fbd0 Merge "Update log metrics config for Logstash downgrade" 2018-10-09 19:36:46 +00:00
Zuul
5a719217e4 Merge "Support using binary Logstash image" 2018-10-09 19:34:35 +00:00
Zuul
a7cf4434d0 Merge "Update Monasca Log Transformer config" 2018-10-09 19:34:33 +00:00
Zuul
50bb4048f9 Merge "Update Monasca Log Persister config" 2018-10-09 19:34:31 +00:00
Zuul
ff51332763 Merge "Increase maximum payload size for Monasca Log API" 2018-10-09 19:31:47 +00:00
Zuul
3e3af0df2c Merge "Prevent Monasca Notification using YAML mode" 2018-10-09 19:29:02 +00:00
Doug Szumski
47136af545 Update log metrics config for Logstash downgrade
The format for the Logstash Kafka output plugin worker count is
integer in Logstash 2 and string in Logstash 5. Since we have downgraded
Logstash we need to switch formats here.

Change-Id: I98113dda05bbb44410916c27d7d3bcd59a034a98
Partially-Implements: blueprint monasca-roles
2018-10-09 16:04:51 +01:00
Doug Szumski
0992c6b55a Support using binary Logstash image
To build the Monasca images, they need to be built from source, however,
this doesn't include Logstash. Logstash does not differentiate between
binary or source install types, so we can just use the default.

Partially-Implements: blueprint monasca-roles
Change-Id: I7eb355f25864f2b993780cd2b000c8bcd13f78e8
2018-10-09 16:04:51 +01:00
Doug Szumski
063518d072 Update Monasca Log Transformer config
* Convert all log levels to lowercase
* Make number of threads configurable
* Improve naming
* Update path and log options for Logstash 2.4
* Change worker count from string to integer for the Kafka output plugin supplied
  with Logstash 2.4.

Partially-Implements: blueprint monasca-roles
Change-Id: I9379969ee639dff0b525d7a1a03df59bcf18b98b
2018-10-09 16:04:51 +01:00
Doug Szumski
380418f351 Update Monasca Log Persister config
* Make number of threads configurable
* Improve naming
* Update path and log options for Logstash 2.4
* Use the correct logs directory

Partially-Implements: blueprint monasca-roles
Change-Id: I09388de4d31740f2786393c957201bd037572226
2018-10-09 16:04:51 +01:00
Doug Szumski
b1dee2d85b Increase maximum payload size for Monasca Log API
Increase the maximum payload size so that it slightly exceeds the default
maximum chunk size (8MB) in Fluentd. This prevents the Monasca Log API
dropping logs when under heavy load.

Partially-Implements: blueprint monasca-roles
Change-Id: I13020abde7de1c92acc07352466b814b4a6ce5bc
2018-10-09 16:04:51 +01:00
Doug Szumski
0cae7d9b34 Prevent Monasca Notification using YAML mode
If the config option is not specified Monasca Notification defaults
to YAML config parsing and fails to load.

Partially-Implements: blueprint monasca-roles
Change-Id: Id85d9765df525b34d43a77a9e4045e0de19aef99
2018-10-09 16:02:47 +01:00
Doug Szumski
1feb6b6aaa Support custom monasca-notification templates
Jira, Slack and possiblly other plugins allow custom templates
for defining the format of notifications. This change lets you
provide these in a templates folder which is copied into the
monasca-notification container.

Partially-Implements: blueprint monasca-roles
Change-Id: Ibc5ba3944d51f6c8ffc8bdc9ed60f43dd91ca7e0
2018-10-09 15:16:17 +01:00
Zuul
1d5a184a96 Merge "Disable InfluxDB reporting" 2018-10-09 11:16:04 +00:00
Zuul
2a1c6349ab Merge "Git checkout version support for several projects" 2018-10-09 03:05:50 +00:00
Doug Szumski
86c279a0ed Disable InfluxDB reporting
Make reporting of InfluxDB statistics opt-in rather than opt-out.

Trivial-Fix
Change-Id: I23342f797d883da1fe4c3ecdda53dd677239dc36
2018-10-08 14:58:38 +01:00
Zuul
6dcb61ef2d Merge "Fix bug in deploying ceilometer using dev mode" 2018-10-08 10:59:31 +00:00
Zuul
b438521172 Merge "Allow configure java params for ODL karaf" 2018-10-08 09:44:19 +00:00
howardlee
9a1c906435 Fix bug in deploying ceilometer using dev mode
Since the configuration file of the panko module was referenced as a
variable during the deployment of the ceilometer module, the
project_name variable of the ceilometer module was overwritten,
resulting in an error when deploying the ceilometer module using the
development mode. This patch will fix this problem.

Change-Id: I90d2380b610d3caa988ee667e7c42511d3bbd937
Closes-Bug: #1795770
2018-10-08 01:51:28 +00:00
Zuul
867fe4c6b3 Merge "Improve registration of Monasca InfluxDB database" 2018-10-05 08:14:43 +00:00
Zuul
1afe02769d Merge "Support Octavia custom policy" 2018-10-05 08:14:41 +00:00
Zuul
8ac8b12752 Merge "Allow fluentd to read barbican-api.log" 2018-10-05 08:14:40 +00:00
Dai Dang Van
22bf7997b9 Support Octavia custom policy
Change-Id: I542b06be75991412f8e2a931ea2e40f0a0c317e4
Closes-Bug: #1758903
2018-10-04 02:34:46 +00:00