2895 Commits

Author SHA1 Message Date
Paul Bourke
d8fe3ea780 Add a new 'outward' rabbitmq instance
Certain services such as Murano and trove require access to a rabbitmq
instance from tenant networks. [0]

Exposing the internal rabbitmq to end users is a security hole, hence
there are two options, 1) use vhosts in the existing rabbitmq, or two a
separate rabbitmq instances. Given the importance of rabbitmq to the
OpenStack deployment, we have decided to go with a separate instance.
Refer to [1] for more detail on the various options.

This change makes the rabbitmq role generic so that it can be reused, in
this case to start 'outward_rabbitmq'. It needs to be exposed via
haproxy both for network isolation and also because this is what Murano
configuration requires.

Follow on patches will be added to add a vhost in this outward instance
for Murano and other services which require access.

Based on the original work by bdaca[2]

[0] http://murano.readthedocs.io/en/stable-liberty/intro/architecture.html
[1] http://lists.openstack.org/pipermail/openstack-dev/2016-December/109091.html
[2] https://review.openstack.org/#/c/374525

Change-Id: Ib2bcc7ed4bf4f883a7cd1dfad3db89201e3cfd8d
Partial-Bug: #1620374
Depends-On: I020eb6219f89a310451becde41f6f1c7f54baadd
Co-Authored-By: Bartłomiej Daca <bartek.daca@gmail.com>
2017-06-15 11:12:22 +00:00
Jenkins
eefa4f6522 Merge "Change Solum keystone v2 to v3" 2017-06-14 15:11:35 +00:00
Jenkins
51891c17c0 Merge "Add /lib/modules to neutron_openvswitch_agent" 2017-06-14 13:40:27 +00:00
Jenkins
d7da159487 Merge "Fix cron restarting issue" 2017-06-14 12:45:49 +00:00
Vladislav Belogrudov
91789c4dfd Add /lib/modules to neutron_openvswitch_agent
On many systems IPv6 related modules are not loaded by default.
Usually when one runs ip6tables-* commands required modules are
probed. In neutron_openvswitch_agent container /lib/modules
does not exist. The commands fail to process ip6 firewall
rules as consequence.

Change-Id: Ic4e72eb4f5304f013b7a09ddd31794cfafa67e0b
Closes-Bug: #1615715
2017-06-14 14:37:37 +03:00
Jenkins
e804bf5cc6 Merge "Support for increasing thread cache size in TCMalloc." 2017-06-14 11:31:39 +00:00
Jenkins
a671320788 Merge "Bump min Ansible version to 2.2.0" 2017-06-14 08:08:27 +00:00
Jenkins
ca95e2c4e4 Merge "Add a Kolla 'devstack' mode" 2017-06-14 00:02:42 +00:00
Jeffrey Zhang
00a42b8cbe Bump min Ansible version to 2.2.0
Different Y stream version in Ansible is not compatible. Since ansible
2.2.0 is released for a while. It is time for kolla-ansible to bump the
min Ansible version. Then we can remove the annoying WARNING message
in deploying logs and use the new features.

Change-Id: I99f3c5678f6d2d1f93d61c660fbd166184ff6422
2017-06-14 06:57:04 +08:00
Jenkins
c59714ccff Merge "Remove keystone-paste.ini file in kolla" 2017-06-13 14:58:04 +00:00
Eduardo Gonzalez
7ac53ec342 Fix cron restarting issue
Cron is always restarting due dummy environment
variable is None.
This change adds a useless env value.

Change-Id: Iad435bb0671a25bc12c6a6d0d988d555faba76c3
Closes-Bug: #1697706
2017-06-13 16:37:59 +02:00
Jeffrey Zhang
6ce222af3e Remove keystone-paste.ini file in kolla
keystone-paste.ini file is introduced by
I3a3ca2e74c0ae341105d3481f97956c6da473046 for a security risk of
admin_token_auth middleware. Now this middleware is removed by
I57586ccfa0ad1309cc806d95377dc1ecad015914. So it is safe to use upstream
keystone-paste.ini file.

This patch also keep custom paste file feature. Just put the file to
/etc/kolla/config/keystone/keyston-paste.ini path.

Closes-Bug: #1695023
Partially-Implements: blueprint custom-paste
Change-Id: Ieb983b6a9edb6a156928f6b56a4bd2dbed4281e2
2017-06-13 01:38:29 +00:00
Michal (inc0) Jastrzebski
8530bc10a2 Enable deploying ceph on loopback devices
Since whole issue was related to check whether user wants to wipe
device, loopbacks can be opt out from this warnings

Change-Id: Idd823b282e3055457ed041a98c848deb8509cc30
Closes-Bug: #1667074
2017-06-12 11:19:13 -07:00
zhubingbing
8818e33e86 Change Solum keystone v2 to v3
Solum default use keystone v3
https://github.com/openstack/solum/blob/master/solum/common/solum_keystoneclient.py#L40

Change-Id: I85f73e495ad800f614850cd27fa0e7153dcfc685
2017-06-12 20:19:13 +08:00
Jenkins
381c18975c Merge "Change zun rewrite rule number in fluentd" 2017-06-12 12:12:42 +00:00
Jenkins
a5dfa415a9 Merge "Remove deprecated options designate" 2017-06-12 09:57:24 +00:00
Jenkins
eed4579ea7 Merge "Add default_boot_option configuration" 2017-06-12 09:55:06 +00:00
Eduardo Gonzalez
f3a294da38 Change zun rewrite rule number in fluentd
Zun rule number causes conflict with rule 24,
it should be updated to the next free number.

Change-Id: Idbe346bda4ca5dc50f6b5e63818b12af33d532a3
2017-06-12 10:43:34 +01:00
Jenkins
2359d75a9e Merge "Remove symlink from fluentd global conf" 2017-06-12 09:32:26 +00:00
Jenkins
b62e1d9574 Merge "Add the ceph keyring files related task condition" 2017-06-12 09:32:10 +00:00
Jenkins
53a4f23469 Merge "Neutron oslo_messaging_notifications config error" 2017-06-12 07:07:12 +00:00
Jenkins
cd762e8efb Merge "Nova oslo_messaging_notifications config error" 2017-06-12 07:07:05 +00:00
Yotaro Konishi
36a3994ac1 Fix service_type of Octavia
Currently service_type value of Octavia is 'application-catalog', which is obviously wrong.
It must be 'load-balancer'.

See https://developer.openstack.org/api-ref/load-balancer/v2/index.html

Change-Id: Ic457e6d06adb9541273dd3bf191d60cb4421e1c9
Closes-Bug: #1697337
2017-06-12 11:40:41 +09:00
Jenkins
8e6340ae8a Merge "Revert "Avoid facts gathered twice when deploying with --limit"" 2017-06-11 20:39:41 +00:00
Jenkins
b39e84a23b Merge "Add skydive service" 2017-06-10 21:12:57 +00:00
Paul Bourke
8646562435 Revert "Avoid facts gathered twice when deploying with --limit"
This reverts commit d366dd7e4a0002a2e170dbbda1107f61807323e5 as it
breaks deploying with --tags

Change-Id: If0d510698d432b536617fcb10b775a1519c6dd8a
2017-06-09 13:44:19 +01:00
Jenkins
9d27e52137 Merge "Remove extra configuration item in solum.conf.j2" 2017-06-09 10:09:19 +00:00
zhubingbing
59a621e2b4 Remove extra configuration item in solum.conf.j2
We use auth_uri contain auth_protocol and auth_port

Closes-Bug: #1696947

Change-Id: Id9b984d8822508e4ae972f513b36374abe2ebdff
2017-06-09 17:35:08 +08:00
Jenkins
4a83ba6a0a Merge "Add zun log in fluentd" 2017-06-09 07:57:59 +00:00
zhubingbing
ba838b8a2d Add zun log in fluentd
Change-Id: I929587720c622833764c61543cac7675360ccdcb
2017-06-09 13:44:06 +08:00
Bertrand Lallau
e624f216a8 Neutron oslo_messaging_notifications config error
With the following configuration in globals.yml:
enable_ceilometer="no"
enable_designate="no"
enable_searchlight="yes"

neutron.conf is generated like following:

[oslo_messaging_notifications]
driver = messagingv2
topics =

=> topics value is missing.
This patch fix it.

Closes-Bug: #1671940
Change-Id: I28ab60c61882caaba823bab84f30f77e270f29b4
2017-06-08 13:55:47 +00:00
Bertrand Lallau
f45e18144d Nova oslo_messaging_notifications config error
With the following configuration in globals.yml
enable_ceilometer="no"
enable_designate="no"
enable_searchlight="yes"

nova.conf is generated like following:

[oslo_messaging_notifications]
driver = messagingv2
topics =

topics value is missing.

Change-Id: I27145c0da8b864b2614091933c33d83bdec8b9be
Closes-Bug: #1671935
Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
2017-06-08 13:54:30 +00:00
jangseon ryu
76c500fb24 Support for increasing thread cache size in TCMalloc.
Currently TCMalloc's default tc size is 32MB.
This causes poor performance in ceph storage.
A new ceph_tcmalloc_tc_bytes option has been added
with a default of 128MB.

128 MB is default TC size at above jewel version.
and if we don't set this config,
osd daemon will running with 32 MB.
because 32MB is default size in TCmalloc 2.4 version.
32MB and 128MB are twice the performance difference.
- reference : https://www.slideshare.net/Red_Hat_Storage/
ceph-performance-projects-leading-up-to-jewel-61050682

Closes-Bug: #1693692

Change-Id: I0d25c92917b11a29bcfd18f9c129cae328fa2d3e
Signed-off-by: jangseon ryu <jangseon.ryu@navercorp.com>
2017-06-08 10:14:14 +00:00
Paul Bourke
5cb375645c Add a Kolla 'devstack' mode
Add a new variable 'kolla_devmode', which when enabled, clones and
bindmounts service source code into the containers.

This commit adds the relevant changes for Heat, more services can be
added and built upon.

Usage:
* Set 'kolla_devmode: yes'

* Code is cloned to /opt/stack/{{ project_name }} on target
  node(s)

* Users can develop in these repos, and simply restart the container to
  pick up / test changes.

Debugging can be done from the host via 'remote_pdb'[0].

[0] https://pypi.python.org/pypi/remote-pdb

Implements: blueprint mount-sources
Change-Id: Ic0431b10d723bf84eeefc72039376fe0058dd902
2017-06-08 09:55:54 +01:00
shaofeng_cheng
898155dfd2 Add default_boot_option configuration
The default value of default_boot_option configuration will
change eventually from "netboot" to "local".
It is recommended to set an explicit value for it during the
transition period

Change-Id: Ic42b84e82d4ad27e371536ad9915b5a32118012d
Closes-Bug: #1696636
2017-06-08 14:56:14 +08:00
Jenkins
a6cd7832be Merge "Grafana post_config checks only need to run locally" 2017-06-07 09:04:07 +00:00
Jenkins
63ec84d763 Merge "Set tempest image user var" 2017-06-07 07:57:36 +00:00
zhubingbing
9eb9622749 Set tempest image user var
If we don't use cirros image, ``image_ssh_user = cirros`` is wrong,
so we should make it be variable.

Change-Id: I0a1d6999d1dbc8ce319f4bd504455dfd1fb5fceb
Closes-Bug: #1696088
2017-06-07 10:28:38 +08:00
Jenkins
0a18a6966e Merge "Enable multinode gate" 2017-06-06 15:11:40 +00:00
Jenkins
50cbfc8b5b Merge "Mixing binary and source images for M* projects" 2017-06-06 10:12:44 +00:00
Jenkins
f977ee2970 Merge "Mixing binary and source images for I* and K* projects" 2017-06-06 10:12:38 +00:00
Jenkins
5671d7093f Merge "Mixing binary and source images for T*, W*, Z* projects" 2017-06-06 10:12:30 +00:00
Jenkins
55aab60652 Merge "Add makestep in chrony.conf" 2017-06-06 10:03:21 +00:00
Jenkins
2830541dd9 Merge "Mixing binary and source images for S* projects" 2017-06-06 08:47:59 +00:00
zhubingbing
79b49e2f58 Add makestep in chrony.conf
Normally chronyd will cause the system to gradually correct any time offset, by slowing down or speeding up the clock as required.
In certain situations, the system clock might be so far adrift
that this slewing process would take a very long time to correct the system clock

Change-Id: I939b6aae1dbeb133203085ec68bdb9f7936ee9ef
Closes-Bug: #1696056
2017-06-06 16:28:28 +08:00
Jenkins
71116914b0 Merge "Remove archive_policy configuration in ceilometer.conf" 2017-06-06 07:46:13 +00:00
Mathieu Rohon
43900bc8b6 Add skydive service
This patch introduces the ansible materials to deploy
the skydive service, that can be used to monitor and
troubleshoot networking in an openstack deployment.

Implements: blueprint skydive-service

Co-Authored-By: Nicolas Bouron <nicolas.bouron@gmail.com>
Signed-off-by: Mathieu Rohon <mathieu.rohon@gmail.com>

Change-Id: I53051a1b0c85380416288e17040a398b6efb62c0
2017-06-06 09:09:10 +02:00
Jenkins
225e09c7f1 Merge "Mixing binary and source images for N* and O* projects" 2017-06-06 07:08:59 +00:00
Jeffrey Zhang
6ccd1337e6 Remove archive_policy configuration in ceilometer.conf
gnocchi have archive policy rule feature, which can control metric's
archive_policy. gnocchi also have a default archive policy rule which
is using low archive policy.

On the other hand, archive_policy is marked as deprecated and will be
removed in the feature in ceilometer[0].

So should better remove archive_policy ceilometer.conf.

[0] https://review.openstack.org/#/c/448586/

Change-Id: I0aa726f6420d628bda3fb4c4eba86b55fe1e2699
Closes-Bug: #1696038
2017-06-06 11:44:23 +08:00
Jenkins
28e4ae81cf Merge "Mixing binary and source images for Glance" 2017-06-06 01:16:49 +00:00