4472 Commits

Author SHA1 Message Date
Cédric Jeanneret
778dba94a4 Load known, standard kernel modules from the host, not within containers
Known kernel modules are:
- dm-multipath (for multipathd)
- ip_vs (for keepalived)
- iscsi_tcp (for ironic-conductor)
- openvswitch (for openvswitch-vswitchd)

Change-Id: I1841ec30cde142c8019830ad3190847dfe493eb9
2018-10-11 10:26:34 +02:00
Zuul
8045b3fbd0 Merge "Update log metrics config for Logstash downgrade" 2018-10-09 19:36:46 +00:00
Zuul
5a719217e4 Merge "Support using binary Logstash image" 2018-10-09 19:34:35 +00:00
Zuul
a7cf4434d0 Merge "Update Monasca Log Transformer config" 2018-10-09 19:34:33 +00:00
Zuul
50bb4048f9 Merge "Update Monasca Log Persister config" 2018-10-09 19:34:31 +00:00
Zuul
ff51332763 Merge "Increase maximum payload size for Monasca Log API" 2018-10-09 19:31:47 +00:00
Zuul
3e3af0df2c Merge "Prevent Monasca Notification using YAML mode" 2018-10-09 19:29:02 +00:00
Doug Szumski
47136af545 Update log metrics config for Logstash downgrade
The format for the Logstash Kafka output plugin worker count is
integer in Logstash 2 and string in Logstash 5. Since we have downgraded
Logstash we need to switch formats here.

Change-Id: I98113dda05bbb44410916c27d7d3bcd59a034a98
Partially-Implements: blueprint monasca-roles
2018-10-09 16:04:51 +01:00
Doug Szumski
0992c6b55a Support using binary Logstash image
To build the Monasca images, they need to be built from source, however,
this doesn't include Logstash. Logstash does not differentiate between
binary or source install types, so we can just use the default.

Partially-Implements: blueprint monasca-roles
Change-Id: I7eb355f25864f2b993780cd2b000c8bcd13f78e8
2018-10-09 16:04:51 +01:00
Doug Szumski
063518d072 Update Monasca Log Transformer config
* Convert all log levels to lowercase
* Make number of threads configurable
* Improve naming
* Update path and log options for Logstash 2.4
* Change worker count from string to integer for the Kafka output plugin supplied
  with Logstash 2.4.

Partially-Implements: blueprint monasca-roles
Change-Id: I9379969ee639dff0b525d7a1a03df59bcf18b98b
2018-10-09 16:04:51 +01:00
Doug Szumski
380418f351 Update Monasca Log Persister config
* Make number of threads configurable
* Improve naming
* Update path and log options for Logstash 2.4
* Use the correct logs directory

Partially-Implements: blueprint monasca-roles
Change-Id: I09388de4d31740f2786393c957201bd037572226
2018-10-09 16:04:51 +01:00
Doug Szumski
b1dee2d85b Increase maximum payload size for Monasca Log API
Increase the maximum payload size so that it slightly exceeds the default
maximum chunk size (8MB) in Fluentd. This prevents the Monasca Log API
dropping logs when under heavy load.

Partially-Implements: blueprint monasca-roles
Change-Id: I13020abde7de1c92acc07352466b814b4a6ce5bc
2018-10-09 16:04:51 +01:00
Doug Szumski
0cae7d9b34 Prevent Monasca Notification using YAML mode
If the config option is not specified Monasca Notification defaults
to YAML config parsing and fails to load.

Partially-Implements: blueprint monasca-roles
Change-Id: Id85d9765df525b34d43a77a9e4045e0de19aef99
2018-10-09 16:02:47 +01:00
Zuul
1d5a184a96 Merge "Disable InfluxDB reporting" 2018-10-09 11:16:04 +00:00
Zuul
2a1c6349ab Merge "Git checkout version support for several projects" 2018-10-09 03:05:50 +00:00
Doug Szumski
86c279a0ed Disable InfluxDB reporting
Make reporting of InfluxDB statistics opt-in rather than opt-out.

Trivial-Fix
Change-Id: I23342f797d883da1fe4c3ecdda53dd677239dc36
2018-10-08 14:58:38 +01:00
Zuul
6dcb61ef2d Merge "Fix bug in deploying ceilometer using dev mode" 2018-10-08 10:59:31 +00:00
Zuul
b438521172 Merge "Allow configure java params for ODL karaf" 2018-10-08 09:44:19 +00:00
howardlee
9a1c906435 Fix bug in deploying ceilometer using dev mode
Since the configuration file of the panko module was referenced as a
variable during the deployment of the ceilometer module, the
project_name variable of the ceilometer module was overwritten,
resulting in an error when deploying the ceilometer module using the
development mode. This patch will fix this problem.

Change-Id: I90d2380b610d3caa988ee667e7c42511d3bbd937
Closes-Bug: #1795770
2018-10-08 01:51:28 +00:00
Zuul
867fe4c6b3 Merge "Improve registration of Monasca InfluxDB database" 2018-10-05 08:14:43 +00:00
Zuul
1afe02769d Merge "Support Octavia custom policy" 2018-10-05 08:14:41 +00:00
Zuul
8ac8b12752 Merge "Allow fluentd to read barbican-api.log" 2018-10-05 08:14:40 +00:00
Dai Dang Van
22bf7997b9 Support Octavia custom policy
Change-Id: I542b06be75991412f8e2a931ea2e40f0a0c317e4
Closes-Bug: #1758903
2018-10-04 02:34:46 +00:00
Zuul
476bf15c1c Merge "Add region to Monasca Log API" 2018-10-03 14:22:39 +00:00
Zuul
77d7ab20c2 Merge "Support configuring Monasca Persister performance" 2018-10-03 14:20:06 +00:00
Zuul
180ab50653 Merge "Add missing Monasca persister and notification dimensions" 2018-10-03 14:19:52 +00:00
Zuul
9355f17f2d Merge "Support deploying Monasca Persister" 2018-10-03 14:19:50 +00:00
Zuul
31a64d3543 Merge "Add some missing parameters for Monasca Notification" 2018-10-03 14:10:23 +00:00
Zuul
5d2d270eee Merge "Support deploying Monasca Notification engine" 2018-10-03 14:07:40 +00:00
Zuul
c969dac19d Merge "Support deploying Monasca Thresh" 2018-10-03 14:07:39 +00:00
Zuul
800cbb8b84 Merge "Change the owner of the wsgi-zun.conf to zun" 2018-10-03 12:47:09 +00:00
Zuul
a41bbca824 Merge "Fix non-root reconfiguration with ceph enabled" 2018-10-03 12:47:07 +00:00
Zuul
18fd836a67 Merge "Add become for Cinder configuration tasks" 2018-10-03 12:41:30 +00:00
howardlee
8b292c99bf Git checkout version support for several projects
Kolla-ansible provides support for the dev mode for some projects
of openstack, but there are still some projects that do not yet
support specific release tag. This patch will implement this function
for these project.

Change-Id: I917b27dd61295b542457a21b240afe2cd4e83e58
2018-10-03 15:30:06 +08:00
Mark Goddard
b50917fe2c Fix non-root reconfiguration with ceph enabled
Various ceph-related tasks were missing a 'become' that would allow them
to work as a non-root user. This seems to only cause a problem after an
initial deployment, perhaps due to the recursive ownership & permissions
changes at the end of the ceph.yml and external_ceph.yml files.

This change adds the necessary becomes.

Change-Id: I887c7b3bdef49db1dd1bf9e5bdbf5dc47b7f41af
Closes-Bug: #1795125
2018-10-02 09:16:34 +01:00
Mark Goddard
5beece2503 Fix Cinder backup driver
Cinder has dropped [1] support for legacy backup services. It is now
necessary to specify the full class of the backup driver, rather than
just the module name. This was causing the kolla-ansible ceph jobs to
fail.

[1] https://review.openstack.org/#/c/595372

Change-Id: Icf0ee475ba73f013d4266332d999362651d9475b
2018-10-01 14:43:07 +01:00
Zuul
5e1c4e0150 Merge "Use iptables as section header instead of firewall" 2018-10-01 10:04:03 +00:00
Zuul
29f3f0b146 Merge "openvswitch: always run handler to to ensure OVS bridges are up" 2018-10-01 10:04:01 +00:00
Zuul
d8beb4a225 Merge "Support deploying an Apache Storm cluster" 2018-10-01 09:11:07 +00:00
Mark Goddard
12e644f4f4 Add become for Cinder configuration tasks
This is required to support execution as a non-root user.

Change-Id: I017b44352a33884102fefbacdde0fddc7f0282e3
Closes-Bug: #1795125
2018-09-29 10:19:40 +01:00
Adam Harwell
29cf8baba5 Fix haproxy server config for memcached backends
Change-Id: I22a46b7c61f9ea4f449bc68a244caed2f6705d96
2018-09-28 14:39:06 -07:00
David Rabel
8736817a98 openvswitch: always run handler to to ensure OVS bridges are up
When editing external bridge configuration and running a reconfigure
on openvswitch, handler "Ensuring OVS bridge is properly setup"
needs to run, but doesn't.

This moves the task from handlers to own file and always includes it
after running the handlers.

Change-Id: Iee39cf00b743ab0776354749c6e162814b5584d8
Closes-Bug: #1794504
2018-09-28 11:31:04 +00:00
Will Szumski
58eb07ec22 Use iptables as section header instead of firewall
The firewall section has been renamed in upstream ironic inspector:

7b27585463

Consequently the iptables pxe filter does not work if the actual
dnsmasq interface name differs from the default (br-ctlplane), as can
be seen from this snippet of iptables-save output:

-A INPUT -i br-ctlplane -p udp -m udp --dport 67 -j ironic-inspector

Change-Id: Ic1d08b85e0b5992fbee489f2f9fd174982b5d493
2018-09-28 09:13:48 +01:00
Doug Szumski
2af1d1d95e Improve registration of Monasca InfluxDB database
Monasca is not yet compatible with InfluxDB > 1.1.10, which means
that the official Ansible modules for managing InfluxDB don't work [1].
We therefore fall back to manual commands to register the database
and a default retention policy.

[1] https://github.com/influxdata/influxdb-python
    #influxdb-pre-v110-users

Partially-Implements: blueprint monasca-roles
Change-Id: I59ceda1e7a6e945b13872089011045db04548b94
2018-09-26 10:54:43 +00:00
Doug Szumski
645853bce9 Add region to Monasca Log API
This is required for upcoming log query support and it also
causes an error in the Keystone middleware if it's missing.

Partially-Implements: blueprint monasca-roles
Change-Id: I2bcb32bc0c079c799d2b0e45a97b454d38896986
2018-09-26 10:54:43 +00:00
Doug Szumski
9c2e0b81d5 Support configuring Monasca Persister performance
On a single node deployment, the Monasca persister can
limit the rate at which Monasca can persist metrics to
InfluxDB. Increasing the thread count can remove this
bottle neck.

Partially-Implements: blueprint monasca-roles
Change-Id: I763a5ae6aa8c8ab3bf766ab5b58c386da74a188b
2018-09-26 10:54:43 +00:00
Doug Szumski
6b4cd657ad Add missing Monasca persister and notification dimensions
Partially-Implements: blueprint monasca-roles
Change-Id: I2fb43387bd1bc3b70f5c23d5268a7a7154ec31f0
2018-09-26 10:54:43 +00:00
Doug Szumski
fddbbbbdc4 Support deploying Monasca Persister
The Monasca Persister reads metrics from Kafka and stores them
in a configurable time series database.

Change-Id: I8166b32bfb1583098ab8318a5f38d25bddb81e89
Partially-Implements: blueprint monasca-roles
2018-09-26 10:54:43 +00:00
Doug Szumski
c502e0b17a Add some missing parameters for Monasca Notification
Partially-Implements: blueprint monasca-roles
Change-Id: I21de7748156f8d3689ebfc29f2fc4dc5f7f36ddf
2018-09-26 10:54:42 +00:00
Doug Szumski
da1fa3f578 Support deploying Monasca Notification engine
The Monasca Notification engine generates alerts such as Slack
notifications from alerts.

Change-Id: I84861d5feefe6b6f38acc4dd71e94c386d40b562
Partially-Implements: blueprint monasca-roles
2018-09-26 10:54:42 +00:00