9137 Commits

Author SHA1 Message Date
Doug Szumski
5441963c9a Support deploying Monasca Log Persister
This is a Logstash component which reads processed logs from Kafka
and writes them to Elasticsearch (or some other backend supported by
Logstash).

Ingesting the logs from this service with Fluentd will be covered under
a different commit.

Change-Id: I2d722991ab2072c54c4715507b19a4c9279f921b
Partially-Implements: blueprint monasca-roles
2018-07-12 15:15:38 +01:00
Zuul
08cbba52fa Merge "[prometheus] Initial implementation of prometheus-alertmanager" 2018-07-12 12:03:20 +00:00
Mark Duggan
4157f30c5f Extending designate named template to include "forwarders" parameter
To get forwarding to work in the kolla implementaion of designate,
I'm adding parameters to the named.conf.j2 template.  I'm adding
the ability to change the default values for dnssec-validation and
recursion and creating a new paramater for forwarders.

Change-Id: Ideef39034d75a0d99e8a3dc2a5f1a7203ccf51d5
Closes-Bug: #1781196
2018-07-12 12:25:39 +01:00
Zuul
093fef944d Merge "Support check and diff mode for merge_config and merge_yaml module" 2018-07-12 10:23:10 +00:00
Zuul
64ff58899f Merge "Keep timestamp field" 2018-07-12 07:40:16 +00:00
Zuul
e7def36783 Merge "Trigger bifrost CI job on changes and periodically" 2018-07-12 07:32:42 +00:00
Jorge Niedbalski
1596475db6 [prometheus] Initial implementation of prometheus-alertmanager
This patch extends the prometheus role for being able
to deploy the prometheus-alertmanager[0] container.

The variable enable_prometheus_alertmanager
decides if the container should be deployed and enabled.

If enabled, the following configuration and actions are performed:

- The alerting section on the prometheus-server configuration
is added pointing the prometheus-alertmanager host group as targets.

- HAProxy is configured to load-balance over the prometheus-alertmanager
host group. (external/internal).

Please note that a default (dummy) configuration is provided, that
allows the service to start, the operator should extend it via a node custom config

[0] https://github.com/openstack/kolla/tree/master/docker/prometheus/prometheus-alertmanager

Change-Id: I3a13342c67744a278cc8d52900a913c3ccc452ae
Closes-Bug: 1774725
Signed-off-by: Jorge Niedbalski <jorge.niedbalski@linaro.org>
2018-07-11 16:20:35 -04:00
Zuul
2f37a2b4af Merge "Support deploying Monasca Log Transformer" 2018-07-11 06:51:38 +00:00
Zuul
dc3492867f Merge "Upgrade identity v2 to identity v3 API" 2018-07-11 06:40:42 +00:00
Zuul
fc7f0a9274 Merge "Fix ownership of virtualenv in bootstrap-servers" 2018-07-11 05:52:30 +00:00
Zuul
204ad2a205 Merge "update sahara.conf file for kolla" 2018-07-11 05:23:36 +00:00
Stanislaw Bogatkin
90b886e555 Keep timestamp field
There are cases when we can lost original timestamp field given from
logs, like when we send our logs to the next fluentd forwarder in chain
of forwarders, it will rewrite our timestamp by default. Save
`Timestamp` field explicitly to avoid such situation and be able to
reconstruct messages date and time.

Closes-Bug: #1781046
Change-Id: I2b4486aedacbe16dc4c0fb2e4e4984bd80e59f2d
2018-07-10 23:32:52 +03:00
Mark Goddard
8e4838dc91 Trigger bifrost CI job on changes and periodically
Use Zuul's filtering mechanisms to only run the bifrost CI job in the
check pipeline when changes are made to the bifrost role. This should
reduce load on the CI system.

Also adds a periodic pipeline containing the bifrost job.

Change-Id: Ie7293d40616c91d2376f4cc85a8e87a130607d99
2018-07-10 15:07:20 +01:00
Zuul
60af6b6501 Merge "Update the min version for ansible" 2018-07-10 07:52:43 +00:00
Mark Goddard
2a69050e37 Append to kolla user groups in bootstrap-servers
This makes the bootstrap-servers command more idempotent, since without
the append argument set the kolla user will be removed from the docker
group before being added to it again in a later task.

TrivialFix

Change-Id: Iab0f6b5e18a103e9140631ee3ebbbb48c490bc24
2018-07-09 19:05:24 +01:00
Mark Goddard
4283dff9b4 Fix ownership of virtualenv in bootstrap-servers
In I86bf5e1df3d6568c4f1ca6f4757f08a3dd22754d, creation of the kolla user
was moved to after package installation to ensure the sudo package is
installed when required. This change does not work when python
dependencies are installed in a virtual environment however - when the
virtualenv variable is set.

This change moves the ownership change of the virtualenv to after the
kolla user has been created. It also uses the kolla_user and kolla_group
variables to set the user and group appropriately.

Change-Id: I320e5d611099ad162945a98d5505a79606da0eba
TrivialFix
2018-07-09 18:58:53 +01:00
wu.chunyang
6dd45f62b0 update ansible command usage at user document
ansible command need assign hosts to run.

Change-Id: Ifadc48ba06ef1726aa73b21ff37366360cfffbbe
2018-07-08 04:28:19 +00:00
Zuul
53b2cdca2c Merge "Remove trusts_delegated_roles" 2018-07-06 06:42:04 +00:00
Zuul
095ec410de Merge "Skydive: Update Keystone and Neutron configuration" 2018-07-06 06:27:58 +00:00
Doug Szumski
9c88262ad9 Support deploying Monasca Log Transformer
The Monasca Log Transformer takes raw, unstandardised logs from one
Kafka topic, standardises them with whatever rules the operator wants
to use, and then writes them to a standardised logs topic in Kafka. It
is currently implemented as a Logstash config file.

Since Kolla does a fairly good job of standardising logs, this service
does very little processing. However, when other sources of logs
are used, it may be useful to add rules to the Transformer, particularly
if it's not possible to standardise the logs at source.

Ingesting the logs from this service with Fluentd will be covered under
a different commit.

Change-Id: I31cbb7e9a40a848391f517a56a67e3fd5bc12529
Partially-Implements: blueprint monasca-roles
2018-07-05 17:33:53 +01:00
jacky06
e01f511b08 Update the min version for ansible
Change-Id: Ib9b9440ce56ab2632d2a17c04be7c786b0b3688f
2018-07-05 09:50:03 -04:00
Zuul
60304c7eca Merge "Add enable_ironic_ipxe option to globals.yml" 2018-07-05 13:08:43 +00:00
Zuul
bbacab5fb2 Merge "Standardise Monasca Kafka variable name" 2018-07-05 12:41:54 +00:00
Zuul
344ee2fc57 Merge "Fix missed notify for zun-wsproxy container." 2018-07-05 11:17:55 +00:00
chenxing
f7e64beaed Add enable_ironic_ipxe option to globals.yml
Kolla Ironic reference point out enable booting via iPXE by setting
"enable_ironic_ipxe" to "true" in "/etc/kolla/globals.yml", but there
is no enable_ironic_ipxe option exists in globals.yml.

Change-Id: I5794fc5a7d236f7f486011f53366a5b3f4c59731
2018-07-05 15:44:08 +08:00
Zuul
66205ab1fa Merge "Migrate ceph keyring creation to kolla_ceph_keyring module" 2018-07-05 07:29:37 +00:00
fan_guiju
420b523f31 Added delay_auth_decision config option for swift
The authtoken config variable delay_auth_decision must be set to True.
The default is False, but that breaks public access, StaticWeb, FormPost,
TempURL, and authenticated capabilities requests (using Discoverability).

Change-Id: I420a95f5f9fda3321a4acfc5846e40294a8bd588
Closes-Bug: #1768795
2018-07-04 23:11:40 -04:00
Zuul
b44bade5f3 Merge "Update using openstack section of quickstart" 2018-07-05 02:59:58 +00:00
Peter Cipriano
acccec75a3 Fix missed notify for zun-wsproxy container.
Change-Id: I8b8631e1c215580dd7711a0c0b3683b06ddc47d3
2018-07-04 22:19:19 -04:00
MinSun
f692b4c9ac Make nova nova_instance_datadir_volume configurable.
User can use custom directory for nova instance.
For example using a shared file system as backend.

Change-Id: I11fe4891719a2e2a34888d8b798df5602e294e4f
2018-07-05 10:16:59 +08:00
Zuul
fd3f54faed Merge "Add a job for testing deployment of bifrost" 2018-07-04 15:51:45 +00:00
Zuul
17cc67816f Merge "Option for enable SSL verification on docker registry" 2018-07-04 15:02:55 +00:00
Doug Szumski
b54ceef8bf Standardise Monasca Kafka variable name
Other lists of servers have the postfix _servers. To be consistent
this change uses the same format for Kafka.

Change-Id: Ia595f2ab485904e76fb76211f6715a7c019886ea
Partially-Implements: blueprint monasca-roles
2018-07-04 11:12:08 +01:00
Zuul
dbd97822a0 Merge "Update docker config docs for insecure registry" 2018-07-04 06:20:32 +00:00
chenxing
4968508d7f Upgrade identity v2 to identity v3 API
As of the Queens release, Keystone solely implements the Identity
API v3. Support for Identity API v2.0 has been removed since Queens
in favor of the Identity API v3.

Change-Id: If65b26935e8bd1e6655d84259499f4013762e4e3
Closes-Bug: #1778846
2018-07-04 05:58:32 +00:00
Sylvain Baubeau
d0f85e3fe5 Skydive: Update Keystone and Neutron configuration
Skydive recently splitted the OpenStack configuration:
one for the authentication - on the analyzer - 'auth.keystone'
and an other one for the Neutron probe on the agent
'agent.topology.neutron'.

Change-Id: Idce277d30f01e7a36499b1aee24c54779c54a807
2018-07-03 16:29:28 +02:00
Zuul
f1c6d54cef Merge "Only start tgtd when cinder_iscsi_helper=tgtadm" 2018-07-03 14:09:49 +00:00
Zuul
19d79f9484 Merge "dev mode: Add support for blazar" 2018-07-03 13:48:25 +00:00
Zuul
80916b3678 Merge "Fix default value logic of 'glance_backend_file' variable" 2018-07-03 12:44:33 +00:00
Zuul
58007e89ac Merge "fix freezer prechecks" 2018-07-03 12:37:06 +00:00
Zuul
45c0f0167c Merge "fixed destroy confirmation no properly evaluated" 2018-07-03 12:36:56 +00:00
Zuul
9dd3b527b6 Merge "Create and use keystone_admin[project|user]" 2018-07-03 12:26:38 +00:00
Christian Zunker
8233bc7a84 Update docker config docs for insecure registry
Change-Id: I751c3901b831aaed03b88d36184cd9cc5df1789b
Closes-Bug: #1779110
2018-07-03 13:26:10 +02:00
Kien Nguyen
c4b8bedd01 Remove trusts_delegated_roles
This option's default value has changed since Newton.[1]

[1] aab01c00ff

Change-Id: I981a59be716072aab40862b3e23bbb1fbd1d63fc
2018-07-03 17:04:49 +07:00
Zuul
34d424a3ee Merge "Make Swift log_level changeable" 2018-07-03 07:24:58 +00:00
Zuul
f715a97558 Merge "Add kuryr prechecks for zun" 2018-07-03 07:05:46 +00:00
Zuul
f14ac4bc3c Merge "Enable yamllint strict mode" 2018-07-03 06:51:20 +00:00
caoyuan
8397d3a7b6 Add kuryr prechecks for zun
the zun is need kuryr to be enabled[0], add it into
prechecks is a good idea.

[0]: https://docs.openstack.org/zun/latest/install/compute-install-ubuntu.html#install-and-configure-components

Change-Id: I4f46907c9b47b9108a9aa7bfbd668b833db420af
2018-07-03 12:45:03 +08:00
Zuul
28c0b0d252 Merge "Add zun-wsproxy into kolla-ansible" 2018-07-03 04:11:31 +00:00
Joshua Harlow
6a331d4e37 Create and use keystone_admin[project|user]
It is not always convenient to use the the given
admin project and admin user; especially when some clouds
use different user and project for there keystone 'admin'

This allows setting the variables for these users to something
else, and defaults them to there current values of 'admin'.

Change-Id: I22b79a30f01c90a92ecc0974886edf3791518f2f
2018-07-02 22:12:51 +00:00