38 Commits

Author SHA1 Message Date
Jeffrey Zhang
38da0b3dc2 Enable horizon deployment in gate
horizon is a key service and need to be test in the gate.

Change-Id: I89fc1a32b54483c4331c31fb6349dee317c1bc2a
2016-12-21 08:09:06 +00:00
Jeffrey Zhang
27ee3973a7 Install ansible with OpenStack requirements constrains
OpenStack requirements constrains is well tested. Use it in case of
installing upstream broken package.

This also fixes latest requests 2.12.2 break docker-py, which makes
kolla gate red.

Change-Id: I3e4ec4af2a6e1280313733e8f31f2eea7669dbc1
2016-12-01 18:50:42 +08:00
Jeffrey Zhang
c4cecc2bf4 Use tox to build gate images
Change-Id: I6f9190eccb2e1a1c5bd450ba63833f35f5d09aac
2016-11-21 11:27:07 +00:00
Jeffrey Zhang
db5954e0b3 fix ci gate
* Build kolla image by using kolla project's code
* bump openstack_release to 4.0.0
* Remove tox deploy related env, it is useless now.

Depends-On: I132ee005bce993cbadf411697817c2e95548dc81
Change-Id: Id899eb39d476b95130fbeb43adf4fd49ef32be32
2016-11-21 19:26:44 +08:00
Jenkins
cc098c19b9 Merge "Improve playbook to setup gate nodes" 2016-11-04 14:52:27 +00:00
David Moreau-Simard
fd60d2baf4 Unpin ARA, update callback location
ARA 0.9.2 was released which deprecates the previous callback location
in favor of a new one. The deprecated location still works but let's
move to the new one right away.

Change-Id: I8a10d5855ab6f813e52cc6efce5bcfe91d9c3f92
2016-10-22 21:52:05 -04:00
David Moreau-Simard
75cc748b09 Pin ARA to 0.9.1 temporarily
The next release of ARA (0.10.0) contains a change to the callback
plugin location that /should/ be backwards compatible but let's
control the update to the newer version to be safe and avoid
breaking the gate needlessly.

Change-Id: I32176166e8ebcbfdf0baa8bd7ec30e5ec6d795a5
2016-10-20 17:53:32 -04:00
Jenkins
a64f88168e Merge "Use xenial repos for Ubuntu in the gate" 2016-10-20 10:58:38 +00:00
Paul Bourke
b1e538341f Use xenial repos for Ubuntu in the gate
The gate jobs are using Xenial as the base OS so it seems we should be
using the same non-infra repos as our base image.

TrivialFix

Change-Id: I6e5d27364054c474c16120a3195cae819861c8a1
2016-10-19 17:16:41 +01:00
Christian Berendt
4e073cca0e Use correct Kibana version on the gates
We bumped the Kibana version from 4.4 to 4.6 with
Ia18cb89e0951359226add5cbd96d3a91c7fcfd8a. This version should be
used on the gates as well.

Change-Id: I21ccac9a12e4b604d3cf336c6263f2e4cd925524
Closes-bug: #1634049
2016-10-17 08:50:03 +00:00
Christian Berendt
ce11216a0e Improve playbook to setup gate nodes
* use become instead of sudo
* use file instead of shell to change file modes
* rename setup_nodes.yml to playbook-setup-nodes.yml

Change-Id: I69eda1f034b97d13be76efc91458b6d762c76baf
2016-09-29 16:34:03 +02:00
Jeffrey Zhang
cae4d364ad
Add ara to collect ansible playbook running statics
TrivialFix

Change-Id: Id2a13be9c04920b5326534005750286f842aa731
Signed-off-by: Jeffrey Zhang <zhang.lei.fly@gmail.com>
2016-09-11 18:39:28 +08:00
Michal (inc0) Jastrzebski
0a50cb8889 Change ceph version to Jewel
This patch changes version of ceph from hammer to jewel. Also removed
versionlock as it seems we don't use it in ubuntu, and actually might be
risky if we miss security patch on ceph.

Change-Id: Ib8f88c2f914a4b635e59a509fa0194605eb73165
Implements: blueprint upgrade-ceph-to-jewel
2016-09-09 14:30:36 +00:00
Jeffrey Zhang
a912b7909a
Use a local docker image namespace in gate
use different a docker namespace name in case it pull image from
hub.docker.io when deplying in gate

TrivialFix

Change-Id: I643000e5d9e597a254a4f12c0c10186d4eb20429
Signed-off-by: Jeffrey Zhang <zhang.lei.fly@gmail.com>
2016-09-01 22:17:57 +08:00
Jeffrey Zhang
2e0c5ecbf8 Fix Ubuntu source gate deployment
In CI environment, MySQL-python wheel package has a wrong _mysql.so
file, which is not compatible with Ubuntu.

Disable wheel index in the CI for pip.

Closes-Bug: #1615231
Change-Id: I127ebb017e09a5bf245e0fdad9bf052203e68e55
2016-08-20 22:28:13 +08:00
Steven Dake
4ece523613 Use local mirror of ceph and uca
Change-Id: I75962ec416a8e4bedb0ad85c93b46cdcd80e8a72
Partially-Implements: blueprint mirrors
2016-07-12 02:34:18 -04:00
Jenkins
6f5239ce40 Merge "Bump the ansible to 2" 2016-05-26 10:57:27 +00:00
Jeffrey Zhang
491822c510 Bump the ansible to 2
DocImpact

Change-Id: I3cdfbf84919de80f535c030bd146787ecda40dec
partial-Implements: blueprint ansible2
2016-05-24 19:53:31 +08:00
Jenkins
072cec2fbe Merge "Fix the rabbitmq crash on CentOS binary and source deploy" 2016-05-23 12:59:18 +00:00
Jeffrey Zhang
c98e9c44f2 Fix the rabbitmq crash on CentOS binary and source deploy
this is a wordround fix for the rabbitmq failed when deploy on CentOS in
the CI gate. the ideal fix should set the hostname in setup_gate.sh
script. But it do not work as expect with unknown reason

Partial-Bug: #1581301
Change-Id: Ia692794aadf11d3ebe75e4e2bf6b42d9a5f3996f
2016-05-22 00:26:49 +08:00
Jeffrey Zhang
43abb15c25 Collect more info from the gate for debug
* enable the openstack logging debug in the gate
* copy the /etc/kolla files out
* copy the /var/log files out

TrivialFix

Change-Id: I9cf5fa773ec5f41c6ea93325076a64dd24ce22da
2016-05-18 07:03:53 +08:00
Jeffrey Zhang
f21485fbaa Remove the eth1 up and down manually in the rax-ord node
Change-Id: I8372df9869df6e83b7a176184ce93da633525cbd
Closes-Bug: #1574134
2016-04-24 08:00:08 +08:00
Steven Dake
f442319b19 Workaround broken nodepool to unblock gate
Sed and check the length of the IP addresses in the private list.
If none found, copy the public to the private.

Change-Id: I05e4798aa301e022de7d5097d503d8213f2b66a8
Closes-Bug: #1571275
2016-04-19 18:09:20 -07:00
Paul Belanger
b700fc44fb Enable unbuffered output for ansible
This will allow ansible to output to the console log in realtime.

Closes-Bug: #1569769

Change-Id: If4e4ccd9911d9fa9031eed8419bb5a1367c99e49
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-14 06:59:47 +00:00
Nguyen Hung Phuong
328a7e8898 Fix typos in Kolla
TrivialFix

Change-Id: I21f51811ec4256d9b6b2e219de6201e4811dfc5a
2016-03-26 08:06:49 +00:00
Jenkins
8258143542 Merge "Fix rax-ord commands" 2016-03-21 22:16:48 +00:00
Jenkins
892dc09c81 Merge "Add generate_passwords.py to generate passwords" 2016-03-21 20:25:44 +00:00
SamYaple
c135dcbf6b Fix rax-ord commands
It isn't always possible to get a rax-ord gate. Last patch wasn't
correct.

TrivialFix

Change-Id: Id94264166e0914f038f32f3f9b68e463aa15ccd3
2016-03-21 20:21:43 +00:00
SamYaple
f03e06e09b Add generate_passwords.py to generate passwords
As with all tools, this is a first pass at the generation. Perhaps we
even want to move this into kolla/kolla/cmd and be generated with tox
itself in the future.

This tool, when run, will only populate empty fields that have no
values meaning that it is safe to run repeatedly on the same file.

Of note, there is no way to preserve comments in the file after it has
been processed by the yaml parser in python. Comments and sections
will remain in the passwords.yml template for additional documentation
if the user wishes to populate the file themselves.

Use SystemRandom and clean up the docs a bit to not use pronouns.

Co-Authored-By: Steven Dake <stdake@cisco.com>

Closes-Bug: #1559266
Change-Id: I2932d592df8871f1b7811059206d0b4d0553a687
2016-03-21 17:02:23 +00:00
SamYaple
052b01cf9a Fix rax-ord gate
Change-Id: I169647999b313def30c0605172cf188ef4518cdb
Related-Id: Id9ea8c5e402f3a06b9064a939ad4b2e168cd6223
2016-03-21 03:28:44 +00:00
Vikram Hosakote
ec3baf0428 Install Elasticsearch and Kibana packages using yum/apt-get
Test results of this patch set are at
http://paste.openstack.org/show/490450/.

Change-Id: I2957cc70fcca34706ec50a630d785f0630c3f5c0
Closes-Bug: #1553203
2016-03-18 04:05:30 +00:00
SamYaple
8b3f0d0857 Use ubuntu Mitaka repo
The rabbitmq-server package is upgraded to 3.5.7 in cloud-archive
so we update centos to match

The xen-utils package now needs an explict version, xen-utils-4.6 is
what is provided by cloud-archive mitaka

Libvirt 1.3 is in the ubuntu cloud-archive. This has a new daemon for
logging that needs further implementation in newton. For now, it has
been disabled within the qemu.conf

Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
TrivialFix
Change-Id: I84217824817c484b6800a64cbd7767b127a3098e
2016-03-14 15:52:48 +00:00
Jeffrey Zhang
12d6eeceb5 Copy the logs out of the container
Heka logs almost done. When testing, The collected logs can copy
to the /tmp/logs folder, which will be handle by the gate. This
will be very useful for our gate debug.

TrivialFix

Change-Id: I06ca8ebd13933bfd15cb2fb5e53fc3038b17b8c3
2016-03-09 09:34:59 +08:00
SamYaple
85600cd428 Add elasticsearch repo to gate
TrivialFix

Change-Id: I0f083654df901fb765e9517308ac94316859d971
2016-02-22 22:28:50 +00:00
SamYaple
ae4407a2ab Launch VM in gate
Change-Id: I18b1015ca62a352e193ef01bd49cd6d6f9372193
Partially-Implements: blueprint functional-testing-gate
2016-02-18 19:55:24 +00:00
SamYaple
44a4682da2 Fix detect_distro
It was run before ansible was installed and did not properly fail.
This prevented the mirrors for apt from being properly used.

TrivialFix

Change-Id: I5331020993b62c8635a4a97dc3a3d2e01e3d4360
2016-02-12 03:38:48 +00:00
SamYaple
0921308a97 Use Infra provided mirrors in gate
Both apt and pip mirrors are added here

Related-Id: I26f5fc5cec224cf4f4ea361e0f71cecbf320fbb0
TrivialFix

Change-Id: Ib3cb1d2c6fb27887e3ea819d277e21ea3a530f56
2016-02-08 03:58:23 +00:00
SamYaple
6adb5c0aa5 Convert gate to file backend rather than partition
The existing gate partitioned a disk for use with docker, depending
on the gate it would use the swap disk (RAX) or a spare disk (HP).
However, with the new gates (Bluebox + OVH) there is neither a spare
disk nor a swap disk. This leaves us with one choice: File based loop
device.

This patch creates a file at /swapfile to ensure we have swap. It
creates a file at /docker to ensure we have a loop device for Docker.

Right now the /docker file is 10GB and the /swapfile is 4GB due to
size limitations in the gate across all servers and types. This has
proven to be enough space for all our current tests.

Additionally, reduce the number of threads the gate uses to 4 to
prevent the lockup and hour timeout we have been seeing as more
recently in the gate.

The scripts that setup the gate are moved to the tools directory
rather than the tests directory to match the structure of the other
projects.

Partially-Implements: blueprint functional-testing-gate

Change-Id: I3e370f2382b6df36103d8b2ceda9b21d9b4229d5
2016-01-21 22:59:13 +00:00