9215 Commits

Author SHA1 Message Date
Adam Harwell
54a98c1155 Fix monasca use of "action" -> "kolla_action"
The word "action" is now an Ansible reserved word, and things have
transitioned to "kolla_action", but looks like this was missed.

Change-Id: Ie07a2a7d8b153a6d39b91129256727157f8dfa34
2018-07-19 01:45:07 -07:00
Zuul
b699413aba Merge "Fix glance config copy when a service is disabled" 2018-07-19 03:14:00 +00:00
Adam Harwell
8cc97c60d3 Fix glance config copy when a service is disabled
In this patch, the glance-registry service was disabled:
https://review.openstack.org/#/c/566804/

However, the config task still tries to copy files for it, which will
break due to path errors.

Change-Id: If39bb12bf830e6559342037ae2a2b99a784ee503
2018-07-18 14:08:40 -07:00
Zuul
a350d87b2a Merge "Add NUMBER_OF_MONITOR_NODES for bootstrap" 2018-07-18 17:24:02 +00:00
Zuul
4b6a913653 Merge "Allow passing forks to kolla-ansible script" 2018-07-18 17:24:01 +00:00
Zuul
57c9155004 Merge "Added delay_auth_decision config option for swift" 2018-07-18 17:07:01 +00:00
Zuul
60a4780d94 Merge "Make nova nova_instance_datadir_volume configurable." 2018-07-18 17:07:00 +00:00
Minho Ban
ecc1e4a6eb remove uid, gid from rsyncd.conf for swift user
The rsync prior to v3.1.0 the uid/gid parameter have no effect at
all if it runs as normal(non-root) user.

Since v3.1.0 these parameter are problematic for normal user
because now rsync, regardless of root or non-root, if the
parameters are given then it just tries to call setgroups() which
is not possible for normal user so errors may occur.

    swift-object-replicator: @ERROR: setgroups failed\u0000
    swift-object-replicator: rsync error: error starting
    client-server protocol (code 5) at main.c(1648)
    [sender=3.1.2]\u0000

Either way, these parameters are not needed for swift-rsync
container.

Change-Id: Ia7fe9f06d7a21a55f52b90c2cc1b2498300e6532
Signed-off-by: Minho Ban <mhban@samsung.com>
2018-07-18 09:17:12 +09:00
yuqian
5f3cbd8360 Add support for onos
Co-Authored-By: caowei <cao.wei@99cloud.net>
Co-Authored-By: yuqian <yu.qian@99cloud.net>

Change-Id: If8143b720203fe75cf586248f1fa1d3fde34c750
blueprint: onos-support
2018-07-17 15:20:40 +08:00
Zuul
97dcee4c98 Merge "Support deploying Monasca Log Persister" 2018-07-17 06:58:37 +00:00
Duong Ha-Quang
0152e51d7e Apply Ironic rolling upgrade logic
This patchset apply Ironic rolling upgrade logic [1][2]
[1] https://docs.openstack.org/ironic/latest/contributor/rolling-upgrades.html
[2] https://docs.openstack.org/ironic/latest/admin/upgrade-guide.html#rolling-upgrades

Depends-On: https://review.openstack.org/#/c/575594/

Co-author: Ha Manh Dong <donghm@vn.fujitsu.com>
Change-Id: Id68244951dc66d5c3423ef44324bd72058f4ba67
Implements: blueprint apply-service-upgrade-procedure
2018-07-17 10:04:21 +07:00
Clint Byrum
6781c18134 Allow disabling nova-ssh
This service is only required if you want to support cold migration.
In some instances that is not a needed feature, and avoiding having
another key to manage is an advantage.

Co-Authored-By: Adam Harwell <flux.adam@gmail.com>

Change-Id: I0a55a91673d9178933f134832df4bd849ddf5af4
2018-07-16 17:58:51 +00:00
Clint Byrum
7321fe772d Allow passing forks to kolla-ansible script
For large installations it makes sense to use a higher number of forks
than the default.

Change-Id: I34cdc146a4ed2185fb36fbb34ab72916ec98bee5
2018-07-16 17:40:51 +00:00
Zuul
49903241fe Merge "Provide support for ceilometer dev mode in kolla" 2018-07-16 08:38:13 +00:00
Zuul
479cc01d9d Merge "Provide support for solum dev mode in kolla" 2018-07-16 08:38:12 +00:00
Zuul
0e21a777da Merge "Provide support for manila dev mode in kolla" 2018-07-16 08:38:11 +00:00
Zuul
6a38872a13 Merge "Remove ceilometer collector for cloudkitty-processor" 2018-07-16 07:10:31 +00:00
caoyuan
bc65fa51b2 Enable chrony container by default
Since chrony container is supported by kolla [1], we should enable it by
default.

[1] https://github.com/openstack/kolla-ansible/tree/master/ansible/roles/chrony

Change-Id: I1fd4dcae8da4e807b8eaefa65607671bf7a9a19a
2018-07-16 03:30:22 +00:00
Zuul
b2087ac2b3 Merge "Append to kolla user groups in bootstrap-servers" 2018-07-16 03:10:12 +00:00
Zuul
1a7460be92 Merge "Add the role enabled check for some projects" 2018-07-15 13:27:34 +00:00
Zuul
6b4e370c1f Merge "fix tox python3 overrides" 2018-07-15 12:07:12 +00:00
Zuul
d1ee0620bb Merge "Provide support for cloudkitty dev mode in kolla" 2018-07-15 12:06:33 +00:00
Zuul
4430d26c47 Merge "Add driver into oslo_messaging_notifications section" 2018-07-15 04:49:17 +00:00
Zuul
bf7f9e8dec Merge "Add resource Constraints to Nova containers." 2018-07-13 08:38:21 +00:00
Lakshmi Prasanna Goutham Pratapa
297eb5e88f Add resource Constraints to Nova containers.
This commit will constrain the dimensions of service `Nova`
and sub-containers deployed along with it.

A user can give the dimension values in `/etc/kolla/globals.yml`
the data-types just like stated in this commit.

Reference-Docs:
https://docs.docker.com/config/containers/resource_constraints/

Added Test-cases for the same.

Partially-Implements: blueprint resource-constraints
Change-Id: I6458d8fb7b26a6e7c3a9fd0d674d9cf129b0bf5d
2018-07-12 23:24:05 +05:30
Doug Szumski
5441963c9a Support deploying Monasca Log Persister
This is a Logstash component which reads processed logs from Kafka
and writes them to Elasticsearch (or some other backend supported by
Logstash).

Ingesting the logs from this service with Fluentd will be covered under
a different commit.

Change-Id: I2d722991ab2072c54c4715507b19a4c9279f921b
Partially-Implements: blueprint monasca-roles
2018-07-12 15:15:38 +01:00
Zuul
08cbba52fa Merge "[prometheus] Initial implementation of prometheus-alertmanager" 2018-07-12 12:03:20 +00:00
Mark Duggan
4157f30c5f Extending designate named template to include "forwarders" parameter
To get forwarding to work in the kolla implementaion of designate,
I'm adding parameters to the named.conf.j2 template.  I'm adding
the ability to change the default values for dnssec-validation and
recursion and creating a new paramater for forwarders.

Change-Id: Ideef39034d75a0d99e8a3dc2a5f1a7203ccf51d5
Closes-Bug: #1781196
2018-07-12 12:25:39 +01:00
Zuul
093fef944d Merge "Support check and diff mode for merge_config and merge_yaml module" 2018-07-12 10:23:10 +00:00
Zuul
64ff58899f Merge "Keep timestamp field" 2018-07-12 07:40:16 +00:00
Zuul
e7def36783 Merge "Trigger bifrost CI job on changes and periodically" 2018-07-12 07:32:42 +00:00
Jorge Niedbalski
1596475db6 [prometheus] Initial implementation of prometheus-alertmanager
This patch extends the prometheus role for being able
to deploy the prometheus-alertmanager[0] container.

The variable enable_prometheus_alertmanager
decides if the container should be deployed and enabled.

If enabled, the following configuration and actions are performed:

- The alerting section on the prometheus-server configuration
is added pointing the prometheus-alertmanager host group as targets.

- HAProxy is configured to load-balance over the prometheus-alertmanager
host group. (external/internal).

Please note that a default (dummy) configuration is provided, that
allows the service to start, the operator should extend it via a node custom config

[0] https://github.com/openstack/kolla/tree/master/docker/prometheus/prometheus-alertmanager

Change-Id: I3a13342c67744a278cc8d52900a913c3ccc452ae
Closes-Bug: 1774725
Signed-off-by: Jorge Niedbalski <jorge.niedbalski@linaro.org>
2018-07-11 16:20:35 -04:00
Zuul
2f37a2b4af Merge "Support deploying Monasca Log Transformer" 2018-07-11 06:51:38 +00:00
Zuul
dc3492867f Merge "Upgrade identity v2 to identity v3 API" 2018-07-11 06:40:42 +00:00
Zuul
fc7f0a9274 Merge "Fix ownership of virtualenv in bootstrap-servers" 2018-07-11 05:52:30 +00:00
Zuul
204ad2a205 Merge "update sahara.conf file for kolla" 2018-07-11 05:23:36 +00:00
Stanislaw Bogatkin
90b886e555 Keep timestamp field
There are cases when we can lost original timestamp field given from
logs, like when we send our logs to the next fluentd forwarder in chain
of forwarders, it will rewrite our timestamp by default. Save
`Timestamp` field explicitly to avoid such situation and be able to
reconstruct messages date and time.

Closes-Bug: #1781046
Change-Id: I2b4486aedacbe16dc4c0fb2e4e4984bd80e59f2d
2018-07-10 23:32:52 +03:00
Mark Goddard
e78f823110 Bifrost: set TFTP cache master path properly
Ironic creates hardlinks between the TFTP master image store and the
HTTP root path when iPXE is enabled. With Docker volumes used for these
locations we run into https://bugs.launchpad.net/ironic/+bug/1507894
during deployment. If we use a directory under /httpboot to store the
master images this issue is avoided.

This change uses the new bifrost config variable,
ironic_tftp_master_path added in [1] to configure the path, rather than
the existing hacked approach of modifying the ironic.conf config file
after the bifrost_deploy container has started.

[1] https://review.openstack.org/#/c/577071

Change-Id: I5c62999c4956bebd0d3920d756ce67ba194b0ebe
2018-07-10 15:07:23 +01:00
Mark Goddard
8e4838dc91 Trigger bifrost CI job on changes and periodically
Use Zuul's filtering mechanisms to only run the bifrost CI job in the
check pipeline when changes are made to the bifrost role. This should
reduce load on the CI system.

Also adds a periodic pipeline containing the bifrost job.

Change-Id: Ie7293d40616c91d2376f4cc85a8e87a130607d99
2018-07-10 15:07:20 +01:00
Mark Goddard
0cc2daa57d Fix sudoers in bootstrap-servers when user != group
In some cases we may want a configuration in which the kolla user's
primary group name is not the same as their username. Doing this
currently breaks the sudoers configuration, since user entries should
reference a user, or a group prefixed with a '%'.

There does not seem to be a good reason to give root privileges to the
entire group (which sometimes may be a shared group), so let's revert to
giving only the user root privileges.

See kayobe CI test [1] in which a different user and group were
configured, leading to permission denied when using kolla ansible.

[1] http://logs.openstack.org/53/581053/2/check/kayobe-overcloud-centos/a70168e

TrivialFix

Change-Id: I677778ebd0de58df0adfa2a8705f161ec5552283
2018-07-10 12:45:23 +01:00
Zuul
60af6b6501 Merge "Update the min version for ansible" 2018-07-10 07:52:43 +00:00
Mark Goddard
8ec92df8e3 Make sudoers config optional in bootstrap-servers
In some environments it may not be desirable to modify the sudoers
configuration. This change makes this part of bootstrap-servers
optional, based on the create_kolla_user_sudoers variable.

Change-Id: I653403bfc5431741807edef57df58e05e679900b
2018-07-09 19:10:39 +01:00
Mark Goddard
2a69050e37 Append to kolla user groups in bootstrap-servers
This makes the bootstrap-servers command more idempotent, since without
the append argument set the kolla user will be removed from the docker
group before being added to it again in a later task.

TrivialFix

Change-Id: Iab0f6b5e18a103e9140631ee3ebbbb48c490bc24
2018-07-09 19:05:24 +01:00
Mark Goddard
4283dff9b4 Fix ownership of virtualenv in bootstrap-servers
In I86bf5e1df3d6568c4f1ca6f4757f08a3dd22754d, creation of the kolla user
was moved to after package installation to ensure the sudo package is
installed when required. This change does not work when python
dependencies are installed in a virtual environment however - when the
virtualenv variable is set.

This change moves the ownership change of the virtualenv to after the
kolla user has been created. It also uses the kolla_user and kolla_group
variables to set the user and group appropriately.

Change-Id: I320e5d611099ad162945a98d5505a79606da0eba
TrivialFix
2018-07-09 18:58:53 +01:00
wu.chunyang
6dd45f62b0 update ansible command usage at user document
ansible command need assign hosts to run.

Change-Id: Ifadc48ba06ef1726aa73b21ff37366360cfffbbe
2018-07-08 04:28:19 +00:00
Zuul
53b2cdca2c Merge "Remove trusts_delegated_roles" 2018-07-06 06:42:04 +00:00
Zuul
095ec410de Merge "Skydive: Update Keystone and Neutron configuration" 2018-07-06 06:27:58 +00:00
Doug Szumski
9c88262ad9 Support deploying Monasca Log Transformer
The Monasca Log Transformer takes raw, unstandardised logs from one
Kafka topic, standardises them with whatever rules the operator wants
to use, and then writes them to a standardised logs topic in Kafka. It
is currently implemented as a Logstash config file.

Since Kolla does a fairly good job of standardising logs, this service
does very little processing. However, when other sources of logs
are used, it may be useful to add rules to the Transformer, particularly
if it's not possible to standardise the logs at source.

Ingesting the logs from this service with Fluentd will be covered under
a different commit.

Change-Id: I31cbb7e9a40a848391f517a56a67e3fd5bc12529
Partially-Implements: blueprint monasca-roles
2018-07-05 17:33:53 +01:00
jacky06
e01f511b08 Update the min version for ansible
Change-Id: Ib9b9440ce56ab2632d2a17c04be7c786b0b3688f
2018-07-05 09:50:03 -04:00
Zuul
60304c7eca Merge "Add enable_ironic_ipxe option to globals.yml" 2018-07-05 13:08:43 +00:00