9502 Commits

Author SHA1 Message Date
Mark Goddard
242625dff4 Generate Ceph configuration during upgrade
If upgrading the nova, cinder or manila services via 'kolla-ansible
upgrade', the Ceph config files are not generated. Users will expect
that these files are generated, to pull in any changes from their
configuration or the base kolla configuration.

This change moves Ceph tasks inside config.yml to ensure that they are
performed during deploy, reconfigure and upgrade. This has been done for
nova, cinder, gnocchi and manila - glance already does this.

Change-Id: Ic75692c2bcba9b81dee922ff6fbbccd160e7fa19
Closes-Bug: #1794275
2018-10-10 10:48:55 +01:00
Zuul
8045b3fbd0 Merge "Update log metrics config for Logstash downgrade" 2018-10-09 19:36:46 +00:00
Zuul
5a719217e4 Merge "Support using binary Logstash image" 2018-10-09 19:34:35 +00:00
Zuul
a7cf4434d0 Merge "Update Monasca Log Transformer config" 2018-10-09 19:34:33 +00:00
Zuul
50bb4048f9 Merge "Update Monasca Log Persister config" 2018-10-09 19:34:31 +00:00
Zuul
ff51332763 Merge "Increase maximum payload size for Monasca Log API" 2018-10-09 19:31:47 +00:00
Zuul
3e3af0df2c Merge "Prevent Monasca Notification using YAML mode" 2018-10-09 19:29:02 +00:00
Doug Szumski
47136af545 Update log metrics config for Logstash downgrade
The format for the Logstash Kafka output plugin worker count is
integer in Logstash 2 and string in Logstash 5. Since we have downgraded
Logstash we need to switch formats here.

Change-Id: I98113dda05bbb44410916c27d7d3bcd59a034a98
Partially-Implements: blueprint monasca-roles
2018-10-09 16:04:51 +01:00
Doug Szumski
0992c6b55a Support using binary Logstash image
To build the Monasca images, they need to be built from source, however,
this doesn't include Logstash. Logstash does not differentiate between
binary or source install types, so we can just use the default.

Partially-Implements: blueprint monasca-roles
Change-Id: I7eb355f25864f2b993780cd2b000c8bcd13f78e8
2018-10-09 16:04:51 +01:00
Doug Szumski
063518d072 Update Monasca Log Transformer config
* Convert all log levels to lowercase
* Make number of threads configurable
* Improve naming
* Update path and log options for Logstash 2.4
* Change worker count from string to integer for the Kafka output plugin supplied
  with Logstash 2.4.

Partially-Implements: blueprint monasca-roles
Change-Id: I9379969ee639dff0b525d7a1a03df59bcf18b98b
2018-10-09 16:04:51 +01:00
Doug Szumski
380418f351 Update Monasca Log Persister config
* Make number of threads configurable
* Improve naming
* Update path and log options for Logstash 2.4
* Use the correct logs directory

Partially-Implements: blueprint monasca-roles
Change-Id: I09388de4d31740f2786393c957201bd037572226
2018-10-09 16:04:51 +01:00
Doug Szumski
b1dee2d85b Increase maximum payload size for Monasca Log API
Increase the maximum payload size so that it slightly exceeds the default
maximum chunk size (8MB) in Fluentd. This prevents the Monasca Log API
dropping logs when under heavy load.

Partially-Implements: blueprint monasca-roles
Change-Id: I13020abde7de1c92acc07352466b814b4a6ce5bc
2018-10-09 16:04:51 +01:00
Doug Szumski
0cae7d9b34 Prevent Monasca Notification using YAML mode
If the config option is not specified Monasca Notification defaults
to YAML config parsing and fails to load.

Partially-Implements: blueprint monasca-roles
Change-Id: Id85d9765df525b34d43a77a9e4045e0de19aef99
2018-10-09 16:02:47 +01:00
Zuul
1d5a184a96 Merge "Disable InfluxDB reporting" 2018-10-09 11:16:04 +00:00
Nguyen Van Trung
218cbc228f Don't quote {posargs} in tox.ini
Quotes around {posargs} cause the entire string to be combined into one
arg that gets passed to stestr. This prevents passing multiple args
(e.g. '--concurrency=16 some-regex')

Change-Id: Id7eb248942aff41902dc1e8875530cba49fdf1ee
2018-10-09 10:11:40 +07:00
Zuul
2a1c6349ab Merge "Git checkout version support for several projects" 2018-10-09 03:05:50 +00:00
Doug Szumski
86c279a0ed Disable InfluxDB reporting
Make reporting of InfluxDB statistics opt-in rather than opt-out.

Trivial-Fix
Change-Id: I23342f797d883da1fe4c3ecdda53dd677239dc36
2018-10-08 14:58:38 +01:00
Zuul
6dcb61ef2d Merge "Fix bug in deploying ceilometer using dev mode" 2018-10-08 10:59:31 +00:00
Zuul
b438521172 Merge "Allow configure java params for ODL karaf" 2018-10-08 09:44:19 +00:00
howardlee
9a1c906435 Fix bug in deploying ceilometer using dev mode
Since the configuration file of the panko module was referenced as a
variable during the deployment of the ceilometer module, the
project_name variable of the ceilometer module was overwritten,
resulting in an error when deploying the ceilometer module using the
development mode. This patch will fix this problem.

Change-Id: I90d2380b610d3caa988ee667e7c42511d3bbd937
Closes-Bug: #1795770
2018-10-08 01:51:28 +00:00
Zuul
867fe4c6b3 Merge "Improve registration of Monasca InfluxDB database" 2018-10-05 08:14:43 +00:00
Zuul
1afe02769d Merge "Support Octavia custom policy" 2018-10-05 08:14:41 +00:00
Zuul
8ac8b12752 Merge "Allow fluentd to read barbican-api.log" 2018-10-05 08:14:40 +00:00
zhulingjie
d3d83db0ea Make the aodh support deploy separated
refer to [0]

[0]: https://github.com/openstack/kolla-ansible/blob/master/ansible/inventory/multinode#L557

Change-Id: I17ac982ddcb6c63d5ca30623fc450464a69b9299
Closes-Bug: #1796366
2018-10-04 11:01:05 -04:00
Dai Dang Van
22bf7997b9 Support Octavia custom policy
Change-Id: I542b06be75991412f8e2a931ea2e40f0a0c317e4
Closes-Bug: #1758903
2018-10-04 02:34:46 +00:00
Zuul
476bf15c1c Merge "Add region to Monasca Log API" 2018-10-03 14:22:39 +00:00
Zuul
77d7ab20c2 Merge "Support configuring Monasca Persister performance" 2018-10-03 14:20:06 +00:00
Zuul
180ab50653 Merge "Add missing Monasca persister and notification dimensions" 2018-10-03 14:19:52 +00:00
Zuul
9355f17f2d Merge "Support deploying Monasca Persister" 2018-10-03 14:19:50 +00:00
Zuul
31a64d3543 Merge "Add some missing parameters for Monasca Notification" 2018-10-03 14:10:23 +00:00
Zuul
5d2d270eee Merge "Support deploying Monasca Notification engine" 2018-10-03 14:07:40 +00:00
Zuul
c969dac19d Merge "Support deploying Monasca Thresh" 2018-10-03 14:07:39 +00:00
Zuul
800cbb8b84 Merge "Change the owner of the wsgi-zun.conf to zun" 2018-10-03 12:47:09 +00:00
Zuul
a41bbca824 Merge "Fix non-root reconfiguration with ceph enabled" 2018-10-03 12:47:07 +00:00
Zuul
18fd836a67 Merge "Add become for Cinder configuration tasks" 2018-10-03 12:41:30 +00:00
Zuul
eeacb94f63 Merge "Add Quobyte cinder backend spec" 2018-10-03 11:44:25 +00:00
howardlee
8b292c99bf Git checkout version support for several projects
Kolla-ansible provides support for the dev mode for some projects
of openstack, but there are still some projects that do not yet
support specific release tag. This patch will implement this function
for these project.

Change-Id: I917b27dd61295b542457a21b240afe2cd4e83e58
2018-10-03 15:30:06 +08:00
Jorge Niedbalski
48e9898abd [nova] Fix missing blacklist permission.
The cephx keys are missing a default permission
to allow to see blacklisted clients.

This permission ensures that in the event of a client
crash (kill -9/hard shutdown/power outage) the client
can re-connect and write to any devices after reboot.

Closes-Bug: 1773449

Change-Id: I44d3982233f892d2c0ce3b9964194d8098453978
Signed-off-by: Jorge Niedbalski <jorge.niedbalski@linaro.org>
2018-10-02 18:31:00 -03:00
Patrick O'Neill
6526efe612 Add Quobyte cinder backend spec
Partially-Implements: blueprint cinder-quobyte-backend

Change-Id: I6de535ea4081fe0de52858ae582420617204e914
2018-10-02 15:19:56 +01:00
Mark Goddard
8399fc7813 Don't use 'become' in CI tests
Kolla Ansible now claims [1] to support executing as a user other than
root.  We should ensure that this is tested in CI.

This change removes the 'become' from hosts in the inventory, and sets
the remote user to 'kolla', as configured via the bootstrap-servers
command. The bootstrap-servers command and other ansible commands
executed before it still need to execute as the zuul user and not as
kolla, since kolla does not exist yet.

The autogenerated SSH private key in passwords.yml is now added to the
zuul user's SSH config, such that it can SSH as the kolla user, which
has authorised this key.

[1]
https://blueprints.launchpad.net/kolla-ansible/+spec/ansible-specific-task-become

Change-Id: I8f3587e2908bc5b8889cd6fbc01981a6186d33e6
2018-10-02 09:30:18 +01:00
Mark Goddard
b50917fe2c Fix non-root reconfiguration with ceph enabled
Various ceph-related tasks were missing a 'become' that would allow them
to work as a non-root user. This seems to only cause a problem after an
initial deployment, perhaps due to the recursive ownership & permissions
changes at the end of the ceph.yml and external_ceph.yml files.

This change adds the necessary becomes.

Change-Id: I887c7b3bdef49db1dd1bf9e5bdbf5dc47b7f41af
Closes-Bug: #1795125
2018-10-02 09:16:34 +01:00
Mark Goddard
5beece2503 Fix Cinder backup driver
Cinder has dropped [1] support for legacy backup services. It is now
necessary to specify the full class of the backup driver, rather than
just the module name. This was causing the kolla-ansible ceph jobs to
fail.

[1] https://review.openstack.org/#/c/595372

Change-Id: Icf0ee475ba73f013d4266332d999362651d9475b
2018-10-01 14:43:07 +01:00
Zuul
5e1c4e0150 Merge "Use iptables as section header instead of firewall" 2018-10-01 10:04:03 +00:00
Zuul
225d7c70a1 Merge "ovs-dpdkctl.sh function list_dpdk_nics only grabs the first nic" 2018-10-01 10:04:02 +00:00
Zuul
29f3f0b146 Merge "openvswitch: always run handler to to ensure OVS bridges are up" 2018-10-01 10:04:01 +00:00
Zuul
d8beb4a225 Merge "Support deploying an Apache Storm cluster" 2018-10-01 09:11:07 +00:00
Mark Goddard
12e644f4f4 Add become for Cinder configuration tasks
This is required to support execution as a non-root user.

Change-Id: I017b44352a33884102fefbacdde0fddc7f0282e3
Closes-Bug: #1795125
2018-09-29 10:19:40 +01:00
Adam Harwell
29cf8baba5 Fix haproxy server config for memcached backends
Change-Id: I22a46b7c61f9ea4f449bc68a244caed2f6705d96
2018-09-28 14:39:06 -07:00
David Rabel
8736817a98 openvswitch: always run handler to to ensure OVS bridges are up
When editing external bridge configuration and running a reconfigure
on openvswitch, handler "Ensuring OVS bridge is properly setup"
needs to run, but doesn't.

This moves the task from handlers to own file and always includes it
after running the handlers.

Change-Id: Iee39cf00b743ab0776354749c6e162814b5584d8
Closes-Bug: #1794504
2018-09-28 11:31:04 +00:00
Will Szumski
58eb07ec22 Use iptables as section header instead of firewall
The firewall section has been renamed in upstream ironic inspector:

7b27585463

Consequently the iptables pxe filter does not work if the actual
dnsmasq interface name differs from the default (br-ctlplane), as can
be seen from this snippet of iptables-save output:

-A INPUT -i br-ctlplane -p udp -m udp --dport 67 -j ironic-inspector

Change-Id: Ic1d08b85e0b5992fbee489f2f9fd174982b5d493
2018-09-28 09:13:48 +01:00