58 Commits

Author SHA1 Message Date
Jenkins
9a520e0906 Merge "Fix gates out of disk space" 2017-08-31 13:52:26 +00:00
Eduardo Gonzalez
894e73146c Fix gates out of disk space
Sometimes gates fails due lack of disk space,

This change mounts a second disk in opt and moves
registry data to opt.
Disk format commands are excepts from devstack-gate:
dc49f9e6eb/functions.sh (L306)

Change-Id: I606aa491b8cbf678e83281bad1a0ff39d3920ff2
Closes-Bug: #1713652
2017-08-29 09:11:56 +01:00
Surya Prakash Singh
7aec5a2823 Changed as per the standard convention set to use "."
When we have to source a script file use . instead of source
For Reference follow below link:
https://docs.openstack.org/contributor-guide/writing-style/code-conventions

Change-Id: Ia170ccf245131463e3179dd75ccc66142521bc5f
2017-08-28 16:15:13 +05:30
David Moreau-Simard
77f1812e00 Dynamically retrieve the location of ARA to work on both py2 & py3
Remove the hardcoded callback path with python2.7 and use the
virtualenv python to determine the path where ARA is installed so
that no matter if we're running py2 or py3, it will work.

Change-Id: Ica0b94aeebabaeca8416a9768fadd12d3925e7b2
2017-07-22 23:13:16 -04:00
Jenkins
7333ae330f Merge "Upgrade from docker-py to docker" 2017-07-19 03:19:33 +00:00
Jenkins
2cb46ffbae Merge "Allow tmp path to download registry" 2017-07-14 17:38:20 +00:00
Jenkins
a981b9e325 Merge "Fix depends-on kolla gates" 2017-07-13 10:07:38 +00:00
Michal (inc0) Jastrzebski
50735ff1bb Allow tmp path to download registry
Required for dockerhub publisher

Change-Id: I0231bd07415ef05b3f4f937e32a9df4cd0643672
2017-07-12 14:34:02 -07:00
Michal (inc0) Jastrzebski
2f00c64616 Enable proxy cache for tarballs download
Lately, after we increased number of jobs, infra started to experience
network traffic issues due to us downloading registries. This
per-nodepool cache should help and also speed up actual gate.

Change-Id: I621a9c91e4508ef208a28137a736fd8468388219
Depends-On: I527d32f9b43dabb7640bfb056e2bf828b7c1dfa9
2017-07-12 11:50:44 -07:00
Hongbin Lu
3daeea37ea Upgrade from docker-py to docker
The pypi package 'docker-py' [1] has been renamed to 'docker' [2].
It is better to move to the new 'docker' package because the old
package will be deprecated and all the new features will go into
the new package only.

Package 'docker' has been added to requirements [3]. The old
package 'docker-py' is still allowed to be in the global requirements
during the transition period but it should be removed after all or
most of the projects finsih the migration.

[1] https://pypi.python.org/pypi/docker-py
[2] https://pypi.python.org/pypi/docker
[3] https://review.openstack.org/#/c/423715/

Change-Id: Ibcd5a57a1fbf55dcc5a690e41f20917f95b63da0
2017-07-10 14:19:28 +00:00
Eduardo Gonzalez
378ec1f1fe Fix depends-on kolla gates
When using depends-on, gates will not build cinder
and ceph images, causing ceph deploy gates to fail.

Change-Id: I441c742251754db27374331f774041c214678eba
2017-07-10 11:28:42 +00:00
Michal (inc0) Jastrzebski
339b27c7fe Enable multi-scenario gates
First non-trivial scenario we'll be testing in gates will be cinder +
ceph. This patchset is supposed to create framework to easily add new
testing scenarios.

Change-Id: I6790eaf5cf3297af04a64e4169a39b6e2cd1890f
2017-06-19 10:14:33 -07:00
Michal (inc0) Jastrzebski
f5354f55b1 Enable multinode gate
This patches changes deploy_gate quite a bit so in reality all
deployments will now assume multinode (even if it's single node). After
that we will refactor it even further to enable easy addition of new
scenerios.

Change-Id: I1faada46e6a7aa026128b2f01d77eabb04759439
2017-06-05 11:35:20 -07:00
Eduardo Gonzalez
ba6e3249d2 Change ssh/config permissions to 600
ssh/config permissions are 664 currently, causing error
`Bad owner or permissions on /home/jenkins/.ssh/config`

http://logs.openstack.org/68/461368/1/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/0a94da7/console.html#_2017-05-01_12_06_08_440775

config file should only be writen by owner.

Closes-Bug: #1687408
Change-Id: Id804f11a91858fa297e5236beb2110e3511eabec
2017-05-01 14:21:24 +00:00
Eduardo Gonzalez
029de18d0b Add ssh-keyscan to unblock kolla-ansible gate
As a change to remove puppet from infra nodepool,
ssh-keyscan is needed for each node.[0]

Host key checking was disabled by default by jenkins
user. [1]

Refs:
[0] http://lists.openstack.org/pipermail/openstack-dev/2017-April/116036.html
[1] https://review.openstack.org/#/c/460731/
Change-Id: I0f4000f18b7a2b3266c95c3f7a5109e3603c94a7
2017-04-28 13:16:20 +00:00
youri jeong
f8322dffd3 fix typo
fix typo for specs/kubernetes-deployment.rst, tools/ovs-dpdkctl.sh, tools/setup_gate.sh

'managment' -> 'management'
'seperated' -> 'separated'
'occuring' -> 'occurring'
'discribed' -> 'described'
'recomended' -> 'recommended'
'thier' -> 'their'

Change-Id: Ie59c600698c965cebd9a541b951d704eda9301cb
2017-04-11 12:08:19 +00:00
Jeffrey Zhang
38813f8c74 Install ansible without upper constraints
Ansible use jinja2 < 2.9, but requirements/upper-constraints.txt
requires jinja2===2.9.5. Installing ansible shouldn't use upper
constraints provides by OpenStack.

Change-Id: Ib37e8d06373a61959b41b8737085d5f001650e42
2017-02-12 07:44:16 -07:00
Jenkins
2b37e3b871 Merge "Add fluentd role" 2017-01-24 12:54:12 +00:00
zhubingbing
d3d4a933be Add fluentd role
* add fluentd role
* remove heka configure

Co-Authored-By: yangzb09 <yangzb09@qq.com>

Partially-Implements: blueprint add-fluentd-role

Change-Id: Ica804a99f5bb8b157f406299c5982b7b6283b3e3
2017-01-24 07:44:59 +00:00
Jeffrey Zhang
4fdac509c6 Pull kolla images from tarballs.o.o
Pull images from tarballs.openstack.org site[0] when there is no
Depends-On in current commit message.

[0] http://tarballs.openstack.org/kolla/images/

Change-Id: I2e5d4d7ed6418624494121e0a530ec95fd045970
2017-01-18 10:39:52 +08:00
Jeffrey Zhang
38da0b3dc2 Enable horizon deployment in gate
horizon is a key service and need to be test in the gate.

Change-Id: I89fc1a32b54483c4331c31fb6349dee317c1bc2a
2016-12-21 08:09:06 +00:00
Jeffrey Zhang
27ee3973a7 Install ansible with OpenStack requirements constrains
OpenStack requirements constrains is well tested. Use it in case of
installing upstream broken package.

This also fixes latest requests 2.12.2 break docker-py, which makes
kolla gate red.

Change-Id: I3e4ec4af2a6e1280313733e8f31f2eea7669dbc1
2016-12-01 18:50:42 +08:00
Jeffrey Zhang
c4cecc2bf4 Use tox to build gate images
Change-Id: I6f9190eccb2e1a1c5bd450ba63833f35f5d09aac
2016-11-21 11:27:07 +00:00
Jeffrey Zhang
db5954e0b3 fix ci gate
* Build kolla image by using kolla project's code
* bump openstack_release to 4.0.0
* Remove tox deploy related env, it is useless now.

Depends-On: I132ee005bce993cbadf411697817c2e95548dc81
Change-Id: Id899eb39d476b95130fbeb43adf4fd49ef32be32
2016-11-21 19:26:44 +08:00
Jenkins
cc098c19b9 Merge "Improve playbook to setup gate nodes" 2016-11-04 14:52:27 +00:00
David Moreau-Simard
fd60d2baf4 Unpin ARA, update callback location
ARA 0.9.2 was released which deprecates the previous callback location
in favor of a new one. The deprecated location still works but let's
move to the new one right away.

Change-Id: I8a10d5855ab6f813e52cc6efce5bcfe91d9c3f92
2016-10-22 21:52:05 -04:00
David Moreau-Simard
75cc748b09 Pin ARA to 0.9.1 temporarily
The next release of ARA (0.10.0) contains a change to the callback
plugin location that /should/ be backwards compatible but let's
control the update to the newer version to be safe and avoid
breaking the gate needlessly.

Change-Id: I32176166e8ebcbfdf0baa8bd7ec30e5ec6d795a5
2016-10-20 17:53:32 -04:00
Jenkins
a64f88168e Merge "Use xenial repos for Ubuntu in the gate" 2016-10-20 10:58:38 +00:00
Paul Bourke
b1e538341f Use xenial repos for Ubuntu in the gate
The gate jobs are using Xenial as the base OS so it seems we should be
using the same non-infra repos as our base image.

TrivialFix

Change-Id: I6e5d27364054c474c16120a3195cae819861c8a1
2016-10-19 17:16:41 +01:00
Christian Berendt
4e073cca0e Use correct Kibana version on the gates
We bumped the Kibana version from 4.4 to 4.6 with
Ia18cb89e0951359226add5cbd96d3a91c7fcfd8a. This version should be
used on the gates as well.

Change-Id: I21ccac9a12e4b604d3cf336c6263f2e4cd925524
Closes-bug: #1634049
2016-10-17 08:50:03 +00:00
Christian Berendt
ce11216a0e Improve playbook to setup gate nodes
* use become instead of sudo
* use file instead of shell to change file modes
* rename setup_nodes.yml to playbook-setup-nodes.yml

Change-Id: I69eda1f034b97d13be76efc91458b6d762c76baf
2016-09-29 16:34:03 +02:00
Jeffrey Zhang
cae4d364ad
Add ara to collect ansible playbook running statics
TrivialFix

Change-Id: Id2a13be9c04920b5326534005750286f842aa731
Signed-off-by: Jeffrey Zhang <zhang.lei.fly@gmail.com>
2016-09-11 18:39:28 +08:00
Michal (inc0) Jastrzebski
0a50cb8889 Change ceph version to Jewel
This patch changes version of ceph from hammer to jewel. Also removed
versionlock as it seems we don't use it in ubuntu, and actually might be
risky if we miss security patch on ceph.

Change-Id: Ib8f88c2f914a4b635e59a509fa0194605eb73165
Implements: blueprint upgrade-ceph-to-jewel
2016-09-09 14:30:36 +00:00
Jeffrey Zhang
a912b7909a
Use a local docker image namespace in gate
use different a docker namespace name in case it pull image from
hub.docker.io when deplying in gate

TrivialFix

Change-Id: I643000e5d9e597a254a4f12c0c10186d4eb20429
Signed-off-by: Jeffrey Zhang <zhang.lei.fly@gmail.com>
2016-09-01 22:17:57 +08:00
Jeffrey Zhang
2e0c5ecbf8 Fix Ubuntu source gate deployment
In CI environment, MySQL-python wheel package has a wrong _mysql.so
file, which is not compatible with Ubuntu.

Disable wheel index in the CI for pip.

Closes-Bug: #1615231
Change-Id: I127ebb017e09a5bf245e0fdad9bf052203e68e55
2016-08-20 22:28:13 +08:00
Steven Dake
4ece523613 Use local mirror of ceph and uca
Change-Id: I75962ec416a8e4bedb0ad85c93b46cdcd80e8a72
Partially-Implements: blueprint mirrors
2016-07-12 02:34:18 -04:00
Jenkins
6f5239ce40 Merge "Bump the ansible to 2" 2016-05-26 10:57:27 +00:00
Jeffrey Zhang
491822c510 Bump the ansible to 2
DocImpact

Change-Id: I3cdfbf84919de80f535c030bd146787ecda40dec
partial-Implements: blueprint ansible2
2016-05-24 19:53:31 +08:00
Jenkins
072cec2fbe Merge "Fix the rabbitmq crash on CentOS binary and source deploy" 2016-05-23 12:59:18 +00:00
Jeffrey Zhang
c98e9c44f2 Fix the rabbitmq crash on CentOS binary and source deploy
this is a wordround fix for the rabbitmq failed when deploy on CentOS in
the CI gate. the ideal fix should set the hostname in setup_gate.sh
script. But it do not work as expect with unknown reason

Partial-Bug: #1581301
Change-Id: Ia692794aadf11d3ebe75e4e2bf6b42d9a5f3996f
2016-05-22 00:26:49 +08:00
Jeffrey Zhang
43abb15c25 Collect more info from the gate for debug
* enable the openstack logging debug in the gate
* copy the /etc/kolla files out
* copy the /var/log files out

TrivialFix

Change-Id: I9cf5fa773ec5f41c6ea93325076a64dd24ce22da
2016-05-18 07:03:53 +08:00
Jeffrey Zhang
f21485fbaa Remove the eth1 up and down manually in the rax-ord node
Change-Id: I8372df9869df6e83b7a176184ce93da633525cbd
Closes-Bug: #1574134
2016-04-24 08:00:08 +08:00
Steven Dake
f442319b19 Workaround broken nodepool to unblock gate
Sed and check the length of the IP addresses in the private list.
If none found, copy the public to the private.

Change-Id: I05e4798aa301e022de7d5097d503d8213f2b66a8
Closes-Bug: #1571275
2016-04-19 18:09:20 -07:00
Paul Belanger
b700fc44fb Enable unbuffered output for ansible
This will allow ansible to output to the console log in realtime.

Closes-Bug: #1569769

Change-Id: If4e4ccd9911d9fa9031eed8419bb5a1367c99e49
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-14 06:59:47 +00:00
Nguyen Hung Phuong
328a7e8898 Fix typos in Kolla
TrivialFix

Change-Id: I21f51811ec4256d9b6b2e219de6201e4811dfc5a
2016-03-26 08:06:49 +00:00
Jenkins
8258143542 Merge "Fix rax-ord commands" 2016-03-21 22:16:48 +00:00
Jenkins
892dc09c81 Merge "Add generate_passwords.py to generate passwords" 2016-03-21 20:25:44 +00:00
SamYaple
c135dcbf6b Fix rax-ord commands
It isn't always possible to get a rax-ord gate. Last patch wasn't
correct.

TrivialFix

Change-Id: Id94264166e0914f038f32f3f9b68e463aa15ccd3
2016-03-21 20:21:43 +00:00
SamYaple
f03e06e09b Add generate_passwords.py to generate passwords
As with all tools, this is a first pass at the generation. Perhaps we
even want to move this into kolla/kolla/cmd and be generated with tox
itself in the future.

This tool, when run, will only populate empty fields that have no
values meaning that it is safe to run repeatedly on the same file.

Of note, there is no way to preserve comments in the file after it has
been processed by the yaml parser in python. Comments and sections
will remain in the passwords.yml template for additional documentation
if the user wishes to populate the file themselves.

Use SystemRandom and clean up the docs a bit to not use pronouns.

Co-Authored-By: Steven Dake <stdake@cisco.com>

Closes-Bug: #1559266
Change-Id: I2932d592df8871f1b7811059206d0b4d0553a687
2016-03-21 17:02:23 +00:00
SamYaple
052b01cf9a Fix rax-ord gate
Change-Id: I169647999b313def30c0605172cf188ef4518cdb
Related-Id: Id9ea8c5e402f3a06b9064a939ad4b2e168cd6223
2016-03-21 03:28:44 +00:00