3754 Commits

Author SHA1 Message Date
Vikram Hosakote
66f3944db7 Fix Linux bridge reconfig issue
This bug was reported by eandersson in IRC today.

TrivialFix

Change-Id: I3100d2bc567f641894817bd9cf3b2213416085b2
2016-03-21 01:01:00 +00:00
Jenkins
37e67ef3ed Merge "Update quickstart doc to use drop-in unit files" 2016-03-21 00:24:37 +00:00
Jenkins
783d17412d Merge "Explain how to use kolla-ansible pull" 2016-03-21 00:21:24 +00:00
Andrei-Lucian Șerb
3b12b7b951 Attach external NIC to a NAT-Network if on Wi-Fi
On computers with wi-fi adapters, promiscuous mode on the VirtualBox (or
maybe other hypervisors as well) NICs does not work, which means the
default way of connecting the Neutron external interface to a bridged
adapter, will not allow communication to and from the Nova VMs over
floating IPs with any computer on the external network (except the host
computer) or with the wi-fi router. This means no ability to connect to
the Nova VMs and no internet access inside the Nova VMs.

According to VirtualBox documentation (excerpt): "Bridging to a wireless
interface is done differently from bridging to a wired interface,
because most wireless adapters do not support promiscuous mode. All
traffic has to use the MAC address of the host’s wireless adapter, and
therefore VirtualBox needs to replace the source MAC address in the
Ethernet header of an outgoing packet to make sure the reply will be
sent to the host interface. When VirtualBox sees an incoming packet with
a destination IP address that belongs to one of the virtual machine
adapters it replaces the destination MAC address in the Ethernet header
with the VM adapter’s MAC address and passes it on. VirtualBox examines
ARP and DHCP packets in order to learn the IP addresses of virtual
machines."

To fix this issue, a new flag has been introduced: WIFI. If true, the
default Vagrant public network is not created anymore. Instead, the 3rd
NIC will be connected to a NAT-Network named OSNetwork. The NAT-Network
has a virtual gateway, which will be used to communicate with the
external physical wi-fi router. Since Vagrant does not have a high-level
mechanism to attach an adapter to a NAT-Network, the code uses the
low-level Vagrant construct vm.customize which makes it provider
specific.

Promiscuous mode is now activated by default on the 3rd NIC.

The WIFI flag is false by default.

This commit only addresses VirtualBox, and it is currently unknown if
the problem described and fixed in this commit is present in other
hypervisors.

DocImpact
Closes-Bug: #1558766
Change-Id: I0b4dbbc562d87191b2179f47b634cdd6f6361a5e
Signed-off-by: Andrei-Lucian Șerb <lucian.serb@icloud.com>
2016-03-21 01:08:45 +02:00
Jenkins
6e9c51898e Merge "Fix the prechecks role idempotent" 2016-03-20 17:48:25 +00:00
Jenkins
59bc1b8d74 Merge "Increase usefulness of openstack-base" 2016-03-20 17:05:51 +00:00
Jenkins
d95c736703 Merge "Ceilometer needs pymongo to start" 2016-03-20 16:38:27 +00:00
Jenkins
69553b95f1 Merge "Fix race condition in haproxy" 2016-03-20 16:17:28 +00:00
Jeffrey Zhang
d7495b1d39 Fix the prechecks role idempotent
the prechecks role should be idempotent and should changed nothing when
running.

TrivialFix

Change-Id: Ib5063d879e0f5f414d607bd9b6493a7499fc5652
2016-03-21 00:10:15 +08:00
Jenkins
c4d3726e10 Merge "Fix linuxbridge driver" 2016-03-20 15:57:21 +00:00
Hui Kang
127bd6f5da Ceilometer needs pymongo to start
pymongo is needed when ceilometer uses mongodb as backend database

Change-Id: Id75dc7bed30cdfa12f95bb66ca6d4cdf7be0261c
Closes-Bug: #1559370
Related-Bug: #1559390
2016-03-19 23:00:14 -04:00
SamYaple
d786ac948a Move manila variable
The user variable was incorrectly in passwords.yml

The naming was inconsistent, it should be prefixed with manila_*

Removed old unused variable

TrivialFix

Change-Id: I182797fcc6d62d35174403d78d71c8ad7ddcbc43
2016-03-19 23:55:13 +00:00
SamYaple
56fd071bcb Change deprecated options throughout Kolla
These options have all be deprecated/removed. This switches all
options to thier proper mitaka values.

TrivialFix
Change-Id: Ica8d5ea0d48da01ee11672a32890431acd6a306d
2016-03-19 23:55:05 +00:00
SamYaple
f4175f04d7 Fix 'optional' config.json values
These values are optional only when the services are not enabled.

If the file does not exist we should not warn, but rather inform.

Ceph-mon is an exception here since its bootstrap process means
the files may or may not exist initially.

TrivialFix

Change-Id: Ic02bece76d480e99deecf612036f37abb5604135
2016-03-19 23:01:27 +00:00
SamYaple
0a1486a2c7 Rework heka log copying
Now that we have reconfigure we dont have to copy over all config
files at the same time.

TrivialFix

Change-Id: I866be0f05e604151e081974a64f17bf65787f604
2016-03-19 23:01:15 +00:00
SamYaple
5250a00781 Allow external ceph journals and fix bootstrap
This allows us to specify external journals for osds which can greatly
improve performance when the external journals are on the solid-state
drives.

The new lookup and startup methods fix the previous races we had
preventing osds from being created properly.

This retains the same functionality as before and is completely
compatible with the previous method and labels, however this does set
new labels for all new bootstrap OSDs. This was due to a limitation
in the length of the name of a GPT partition.

Closes-Bug: #1558853
DocImpact
Partially-Implements: blueprint ceph-improvements
Change-Id: I61fd10cb35c67dabc53bd82270f26909ef51fc38
2016-03-19 22:36:30 +00:00
SamYaple
6d0cd535d3 Allow user to choose filesystem for osd
Change-Id: I9c770a08219d2eead5ece8e3462157359cd920cb
Partially-Implements: blueprint ceph-improvements
2016-03-19 22:36:30 +00:00
SamYaple
d4535b6dc3 Add memcached_servers to keystone_auth section
The in-process cache for keystone tokens has been deprecated due to
"incosistent results and high memory usage" with the expectation we
switch to memcached_servers if we want to stay performant.

Add memcache_servers [cache] section to the appropriate servers as the
[DEFAULT]\memcache_servers options was deprecated.

TrivialFix
Related-Id: Ied2b88c8cefe5655a88d0c2f334de04e588fa75a

Change-Id: Ic971bdddc0be3338b15924f7cc0f97d4a3ad2440
2016-03-19 21:53:03 +00:00
SamYaple
0da25415f8 Increase usefulness of openstack-base
Just like last cycle, I ran all of the requirements and found the
packages that were installed >=10 times throughout our containers. By
combining them in the openstack-base we reduce the size of the images
by ~600MB (10%) and decrease build time by a measurable amount (5-10m
in the case of Centos)

TrivialFix
Change-Id: I582d75644a8e8b936c6f9fc10c6b5821e1e8c5c4
2016-03-19 17:41:11 +00:00
SamYaple
45aafc724f Fix linuxbridge driver
We were specifying the wrong driver in our nova.conf

Change-Id: I37a3d366f2895b9d1281815ef85209feaa37b92d
Closes-Bug: #1559494
2016-03-19 16:32:41 +00:00
SamYaple
e9b9a84157 Fix permissions for log extraction in gate
Some gates are failing to properly pull all logs out resuling in an
UNSTABLE status.

This resets all logs to 777 perms to ensure readability by jenkins.

TrivialFix

Change-Id: Ib92c5bfea5fa8bcc6380ad8aa6001b13888717ac
2016-03-19 15:36:49 +00:00
Maru Newby
b9205399c5 Update quickstart doc to use drop-in unit files
While it's possible to edit distro/package unit files installed to
/lib/systemd/system, a cleaner solution exists.  systemd will pick up
'drop-in' unit files located in '/etc/systemd/system/[unit name].d/'.
A drop-in unit file only has to include fields that override those in
the main unit file, and the drop-in unit and main unit file can change
independently.

This change updates the quickstart doc to use drop-in unit files to
configure docker.service instead of editing the main unit file.

See: https://coreos.com/os/docs/latest/using-systemd-drop-in-units.html

Change-Id: Iddbebf658741937e3c4157fc0a021751f10fabd2
2016-03-19 05:10:35 +00:00
Michal (inc0) Jastrzebski
d2f828a134 Add check if all the hostnames are resolvable
Rabbitmq can't work with IPs, so we need to make sure that all
rabbit cluster hosts can resolve each others hostnames. We
should also require that in docs.

DocImpact
Closes-Bug: #1559158

Change-Id: I2418187138988d21da3dc3624e9cdbda891d4894
2016-03-19 04:24:41 +00:00
Steven Dake
50c52081de Explain how to use kolla-ansible pull
During multi-node, it is possible for master target node images to
be older then the Ansible master playboks if the repository is
updated.  Add documentation to explain this situation.

Change-Id: I2ccf57004147873e89f23fbb996d01f550e90c3f
2016-03-18 11:57:27 -07:00
Serguei Bezverkhi
05b6995f63 Fixes incorrect swift service endpoints
This bugfix fixes incorrect swift proxy-server endpoint.

Closes-Bug: #1559207

Change-Id: Idcdbaedbbde4922b0d5e31557aaf5cfcfdff8636
2016-03-18 12:42:23 -04:00
MD NADEEM
de695f04db Fix inconsistancy in globals.yml
The parameter values in global.yml were inconsist,
for some variable default values are shown while for
others it's not.

From user point of view it is important to know
the default values of the parameters and the globals.yml is
the file where user is supposed to look for config variable,
for sure a user do not want to look kolla/ansible/group_var/all.yml
file just for checking default values. So it is better to show all
default values in global.yml

This patch will solve this issue.

TrivialFix

Change-Id: I991fc5e1d4ed48d106da002a0f18a2b31525a482
2016-03-18 15:17:10 +00:00
SamYaple
9fbcd6c2ba Enabled nova->glance snapshots
Thanks to the related-id commit we can do nova->glance snapshots. This
updates the keyrings to reflect that change.

Change-Id: I02f083aec0255e9d681bd225a11ead6f5a379366
Related-Id: If13d25b6c94e247d2505583b524ae3af9c34b5dc
2016-03-18 14:55:32 +00:00
Michal (inc0) Jastrzebski
23e7f6c292 Playbook for rabbitmq upgrade
Main issue with rabbitmq clusterer setup is to shut down gospel node
as last one, which is bulk of this change

Co-Authored-By: Sam Yaple <sam@yaple.net>
Change-Id: I88e566a19ed813b0e3eef65ef7139ccfaa0c2700
Implements: blueprint upgrade-rabbitmq
Partially-implements: blueprint upgrade-kolla
2016-03-18 14:11:29 +00:00
Jenkins
db0de9b7af Merge "Install Elasticsearch and Kibana packages using yum/apt-get" 2016-03-18 07:15:02 +00:00
Jenkins
c61d9b5bc1 Merge "Add unmap to cinder for ceph" 2016-03-18 06:53:48 +00:00
Jenkins
38be3f2ce9 Merge "Correct var name in globals.yml" 2016-03-18 05:37:41 +00:00
MD NADEEM
bb342b074b Correct var name in globals.yml
Change variable name ceph_use_cache to ceph_enable_cache

TrivialFix

Change-Id: Ifeabf2a7212a78a81703f3e867c2566652b1aebc
2016-03-18 09:42:53 +05:30
Vikram Hosakote
ec3baf0428 Install Elasticsearch and Kibana packages using yum/apt-get
Test results of this patch set are at
http://paste.openstack.org/show/490450/.

Change-Id: I2957cc70fcca34706ec50a630d785f0630c3f5c0
Closes-Bug: #1553203
2016-03-18 04:05:30 +00:00
Jenkins
f5bdcfbb60 Merge "Allow per node configuration with augments" 2016-03-18 03:45:06 +00:00
SamYaple
ef0a13554c Add unmap to cinder for ceph
This matches the current default for nova.conf. Use unmap/discard if
t is enabled on the hypervisor. This option is new for mitaka.

TrivialFix

Change-Id: Id94c05e2ec8a65c75ec82afcd4150390f8b87ee2
2016-03-18 02:48:04 +00:00
Jenkins
e20f3ec7f5 Merge "Refactor glance config tasks" 2016-03-18 02:29:54 +00:00
Jenkins
14b3a7f187 Merge "Add cron to pull playbooks" 2016-03-18 02:21:19 +00:00
Jenkins
9c235f6b91 Merge "Change libvirt volume name to libvirtd" 2016-03-18 02:06:19 +00:00
Jenkins
7adfd95184 Merge "Reorder operations of mkdir and useradd in toolbox" 2016-03-18 01:58:06 +00:00
Jenkins
0b19bbc132 Merge "Changing Swift option section in globals.yml" 2016-03-17 22:37:32 +00:00
Steven Dake
a577634fd3 Reorder operations of mkdir and useradd in toolbox
The home directory for Ansible already exists and does not
need to be created.  Reorder useradd and mkdir at suggestion
of Jeff Peeler to avoid warning.

The warning looks like this:

INFO:__main__:kolla-toolbox:Step 6 : RUN mkdir -p /etc/ansible /usr/share/ansible /home/ansible     && echo 'localhost ansible_connection=local' > /etc/ansible/hosts     && useradd --user-group ansible --groups kolla     && sed -i 's|  "identity_api_version": "2.0",|  "identity_api_version": "3",|' /usr/lib/python2.7/site-packages/os_client_config/defaults.json
INFO:__main__:kolla-toolbox: ---> Running in ccded9c01fca
INFO:__main__:kolla-toolbox:useradd: warning: the home directory already exists.
INFO:__main__:kolla-toolbox:Not copying any file from skel directory into it.
INFO:__main__:kolla-toolbox:

TrivialFix

Change-Id: I031ade6597f8071f5be1768a7e70b1008dd94e52
2016-03-17 13:30:28 -07:00
Serguei Bezverkhi
c2f2be4d5e Changing Swift option section in globals.yml
This patch adds some explanations for different options available
in /etc/kolla/globals.yml for customizing swift configuration.

Trivial fix

Change-Id: Iaf03f5293804d63c87d8881ac4282909a81b0bfe
2016-03-17 14:26:00 -04:00
SamYaple
1f371e2717 Allow per node configuration with augments
This type of per node configuration is required to support things like
availability zones for nova. As always, if this file doesnt exist it
doesnt get used so this change is safe.

TrivialFix

Change-Id: Iff8172af522c2c96e5f2c173b24a5dfd4d522ed2
2016-03-17 17:18:00 +00:00
SamYaple
ff91d53c76 Refactor glance config tasks
This now matches the way we copy confis in other services.

TrivialFix

Change-Id: Ia9c6d5f9a633c0b20b4d9a697863bd2753d39443
2016-03-17 17:18:00 +00:00
SamYaple
b160a78995 Add cron to pull playbooks
TrivialFix

Change-Id: I9e7e65d6e5ddfb3c387e147a8cc6f5aae1aab0cd
2016-03-17 17:13:38 +00:00
SamYaple
f096cdcb40 After refactor, the upgrade code was missing task
TrivialFix

Change-Id: Ic946c613e5197d988897bd450040a1ea66a60f77
2016-03-17 17:13:09 +00:00
Jenkins
2701f28309 Merge "Increase the docker parition for rht bases in gate" 2016-03-17 17:02:59 +00:00
Jenkins
bbe08628d0 Merge "Manila ubuntu binary container" 2016-03-17 15:45:12 +00:00
MD NADEEM
264e90885d Update README for heka image
Added heka description in the list of
images provided by kolla.

TrivialFix
Change-Id: I28ce2ef185f260b779cb6613b4c6ac458376fa95
2016-03-17 13:33:25 +00:00
MD NADEEM
a41ab6fd73 Reconfigure for haproxy
Add reconfiguration for haproxy

Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
Closes-Bug: #1553528
Change-Id: Ibe9266dfac8e79c5aa56a17eb908ff12cd81cc05
2016-03-17 21:12:52 +08:00