474 Commits

Author SHA1 Message Date
Jenkins
a2c317f16d Merge "Fix non-root deploys" 2016-02-14 20:23:20 +00:00
Allen Gao
a5a0a830ef rabbitmq_data container is removed
TrivialFix

Change-Id: I5168191182c249df68fd0b5c70a778f223326974
2016-02-14 20:18:55 +08:00
SamYaple
44a4682da2 Fix detect_distro
It was run before ansible was installed and did not properly fail.
This prevented the mirrors for apt from being properly used.

TrivialFix

Change-Id: I5331020993b62c8635a4a97dc3a3d2e01e3d4360
2016-02-12 03:38:48 +00:00
SamYaple
9f7c3b630d Fix non-root deploys
TrivialFix

Change-Id: Id0e7cf9e1c0c4259b8a50c39e95214103256517b
2016-02-12 03:38:45 +00:00
Jenkins
51e9046ea7 Merge "Use Infra provided mirrors in gate" 2016-02-12 01:51:30 +00:00
Jeffrey Zhang
7899d00c6f Trap error exit in deploy aio script
This make sure the check_failure called whenever the script exits
unexpectedly.

TrivialFix

Change-Id: If38e9ad42810deec48afd3f8b57387ae6ffd926c
2016-02-10 21:31:48 +08:00
Jenkins
1fdae5b9d0 Merge "Increase ansible verbosity during gate deploy" 2016-02-09 17:37:06 +00:00
Martin André
fd7b431069 Add all neutron agents to cleanup-containers script
When breaking neutron-agents into thin containers, we forgot to update
the cleanup-containers script.

TrivialFix

Change-Id: Idad2eb73a4de7c66109ad5bffcce3173970e2af9
2016-02-09 14:49:39 +09:00
Martin André
bda91649e8 Increase ansible verbosity during gate deploy
The gate currently doesn't provide any context when ansible fails. This
commit adds a new --verbose option to `kolla-ansible` that is passed to
`ansible-playbook`, and sets the default to -vvv for `kolla-ansible
deploy` in the gate.

TrivialFix

Change-Id: If248a4186b140e1ec0d2e787c27481cec7e81eec
2016-02-08 18:18:05 +09:00
SamYaple
0921308a97 Use Infra provided mirrors in gate
Both apt and pip mirrors are added here

Related-Id: I26f5fc5cec224cf4f4ea361e0f71cecbf320fbb0
TrivialFix

Change-Id: Ib3cb1d2c6fb27887e3ea819d277e21ea3a530f56
2016-02-08 03:58:23 +00:00
SamYaple
74cd09a3fc Add retry function for Docker keyring
Sometimes the keyserver has a mirror failure which results in a failed
gate. Add a retry to help prevent that failure.

TrivialFix

Change-Id: I143626dd6d799b4ea0f82f6649d2155c2f45a115
2016-02-08 03:58:23 +00:00
SamYaple
e8d66766f0 Fix gate for docker 1.10
Docker 1.10 has broken the gate and this patch will correct that
breakage.

The issue comes with rsyslog. Due to a commit in Docker 1.10 [1] we
must change the way we get the log socket for rsyslog. The /dev/
folder will no longer populate as we used it. So instead we simply
make a new socket in a path we control and share that to the correct
location in the containers.

Additionally, adjust the gate for new Docker daemon.

[1] https://github.com/docker/docker/pull/16639
Partially-Implements: blueprint kolla-upgrade
Change-Id: I881a2ecdf6d7b35991e1d38a3f3e60d022d6577f
2016-02-06 06:48:53 +00:00
Jenkins
1b3480edca Merge "Fix the ugly base directory path" 2016-02-05 17:52:38 +00:00
Jenkins
b891afd64c Merge "Rename kolla_ansible to kolla_toolbox" 2016-02-05 15:04:37 +00:00
Allen Gao
343e736e62 Fix the ugly base directory path
Remove the '..' in the path like:
/home/jenkins/workspace/gate-kolla-dsvm-deploy-centos-binary/tools/../ansible/inventory/all-in-one

TrivialFix

Change-Id: I80724a9e876ed1826c65e08b55cfa08124d70eb9
2016-02-05 16:59:01 +08:00
SamYaple
80b7266ed1 Rename kolla_ansible to kolla_toolbox
This change is needed for clarity. We have a kolla-ansible script.
We have a kolla-mesos repo. We plan to have a kolla-ansible repo.
Already we have had far too much confusion about whether we are
talking about the container or the project. Naming this kolla-toolbox
eliminates all of that confusion and its probably a bit more accurate
of a name too.

Closes-Bug: #1541053
Change-Id: I8fd1f49d5a22b36ede5b10f46b9fe02ddda9007e
2016-02-02 18:12:15 +00:00
Jeffrey Zhang
7ec170a9ff Validate that all the containers are started
Container maybe exit after deployed. But the print_failure
never runs if the kolla-ansible run success.
This PS checks all the containers status after deploy and
failed the test if the container status is exited

TrivialFix
Change-Id: Ia461b280855eda500e143ee1d6cfd5f215eaf6fe
2016-02-02 19:47:38 +08:00
Mauricio Lima
488f46f537 Update cleanup-containers to remove manila containers
Change-Id: Ie7a53396b03ce4e472b5e810a02ccdfc9bd8aacd
Partially-Implements: blueprint enable-manila-containers
2016-01-28 14:47:37 -05:00
Allen Gao
0f01d3ebc7 Add the keyfile option to decrypt the passwords.yml
The passed keyfile path is used to decrypt the passwords.yml
which encrypted by the ansible vault.

Partially-Implements: blueprint	encrypt-sensitive-info
DocImpact
Change-Id: Ifaebf464478cde99e896c13b375cfaf9282ee576
2016-01-27 06:24:59 +08:00
Allen Gao
2a81598434 Add the missed long option tags
And use variables for options.

TrivialFix

Change-Id: I6cf8612b4e15ef263d2f5b2dbacc186ccd16871b
2016-01-27 06:17:21 +08:00
Jenkins
06b16d577d Merge "Convert gate to file backend rather than partition" 2016-01-26 03:04:43 +00:00
Jeffrey Zhang
94f5e87002 Expose the ansible-playout tags parameter
we can deploy specific services by using tags feature. It is very
useful, especially in develop/test stage.

TrivaiFix

Change-Id: I21cc55e6f1a32a5c57570bc2c2fb9b084e513af8
2016-01-25 09:54:22 +08:00
SamYaple
6adb5c0aa5 Convert gate to file backend rather than partition
The existing gate partitioned a disk for use with docker, depending
on the gate it would use the swap disk (RAX) or a spare disk (HP).
However, with the new gates (Bluebox + OVH) there is neither a spare
disk nor a swap disk. This leaves us with one choice: File based loop
device.

This patch creates a file at /swapfile to ensure we have swap. It
creates a file at /docker to ensure we have a loop device for Docker.

Right now the /docker file is 10GB and the /swapfile is 4GB due to
size limitations in the gate across all servers and types. This has
proven to be enough space for all our current tests.

Additionally, reduce the number of threads the gate uses to 4 to
prevent the lockup and hour timeout we have been seeing as more
recently in the gate.

The scripts that setup the gate are moved to the tools directory
rather than the tests directory to match the structure of the other
projects.

Partially-Implements: blueprint functional-testing-gate

Change-Id: I3e370f2382b6df36103d8b2ceda9b21d9b4229d5
2016-01-21 22:59:13 +00:00
Jenkins
e00dc579c1 Merge "Delete __init__.py in tools" 2016-01-21 10:34:07 +00:00
jing.liuqing
be647080c0 Delete __init__.py in tools
In general, the tools is some scripts, not a python module.

TrivialFix

Change-Id: I638e4d8a347dbe6e4faa395cae708b939ec4cc26
2016-01-21 09:11:37 +00:00
Allen Gao
980bbcb414 kolla-ansible: refactor the command options
TrivialFix

Change-Id: I511f463250d1472c831aa3e5b126dafb36ce79c4
2016-01-21 08:34:19 +00:00
Allen Gao
c7a7234415 refactor the cleanup containers
TrivialFix
Sort the containers, remove *_data ones, etc.

Change-Id: Ic7923828517da954e7c8802d6cf5918e425df255
2016-01-20 12:04:38 +08:00
Allen Gao
e84de1d31d kolla-ansible: add prechecks subcommand
TrivialFix

Change-Id: Ifb0ca3383cd04f5ff6baeb30ae6996d450d5c579
2016-01-20 06:37:14 +08:00
Jenkins
f764ad8d17 Merge "kolla-ansible: add post-deploy subcommand" 2016-01-19 00:44:56 +00:00
Jeffrey Zhang
bbe088cad2 Remove the not used setup_docker.sh file
TrivalFix

Change-Id: I18a69d31c1b3442c79b7ffaab7259363600727e2
2016-01-18 16:49:14 +08:00
Wanlong Gao
0e913e6ab5 kolla-ansible: add post-deploy subcommand
It is more convenient to add a subcommand instead of assigning
playbook path manually.

Change-Id: Ia2f27a0f44eb719b28d5e7f9762dc47186eeb0e6
2016-01-15 15:46:03 +08:00
Jenkins
cea76a1b86 Merge "Standardize bashate and add linters" 2016-01-13 22:03:39 +00:00
SamYaple
a87c2a6929 Add kolla-ansible upgrade command
Change-Id: I432802fed979c9e42fb51703ce830f0fd8debc1e
Partially-Implements: blueprint upgrade-kolla
2016-01-13 18:47:38 +00:00
SamYaple
b863a46805 Standardize bashate and add linters
The linters gate combindes pep8 and bashate (and then any other
linters we want). This changes bashate to be a sript rather than doing
a script inline. This matches the way other projects (and
project-config themselves) uses bashate [1].

Once a change upstream merges we can remove the redundant pep8 and
bashate gates.

[1] https://github.com/openstack-infra/project-config/blob/master/tox.ini#L11
https://github.com/openstack-infra/project-config/blob/master/tools/run-bashate.sh

Related-Id: I2afa7931bf3e18798b95a8af33ccf5ef761c4ad5

TrivialFix

Change-Id: I2ea2c1156e1b4de008f19e333e2740795dc406de
2016-01-13 17:33:28 +00:00
Jeffrey Zhang
dd6df534cf make the kolla-ansible python3 compatible
* remove unused sys
* user print() for python3 compatible

TrivalFix

Change-Id: I65c66d0373cdec19da668c3d911f061ce95d1374
2016-01-06 15:31:00 +08:00
SamYaple
462e8a3b6e Allow common role to pull images
Change-Id: I3de01770eca6b7e681b7964a6d6e15564065aaea
Partially-Implements: blueprint pre-pull-images
2016-01-04 19:49:26 +00:00
Artur Zarzycki
95c1d7380f Remove ironic containers in the cleanup script
TrivialFix

Change-Id: Ia37369acf8bf7ca7f49fd647f40c6e98f40e93d8
2015-12-14 16:57:04 +01:00
Sidharth Surana
a3b7b866b7 Remove cinder containers in the cleanup script
Change-Id: I29b788a71f30d133e66759a5de2ecd43222313a8
Closes-Bug: #1524557
2015-12-09 16:25:44 -08:00
Sean Mooney
2ffb35ee53 adds tools/cleanup-containers regex support
- this change extends the tools/cleanup-containers script to
  support a grep extended regex as a first paramater.
- if tools/cleanup-containers is called with a grep extended
  regex string as a first paramater, only containers mataching
  that regex will be cleaned up.
- e.g. tools/cleanup-containers "neutron|openvswitch"
  will cleanup all container whoes name contains either neutron
  or openvswitch.

Change-Id: Iadb68c0a8de40e9ec2c0a27568e3a372ec0e8303
Closes-Bug: #1522168
2015-12-02 23:01:42 +00:00
Hui Kang
1c9056bcb6 Output unique admin id of user and project list
Change-Id: I8983768b6fafdd70f4c8aa7bdcf91af4f50efe70
Closes-Bug: #1520982
2015-11-29 20:17:19 +00:00
Hui Kang
afb30cbebd Remove openvswitch_data container in the cleanup script
Change-Id: Iec94e254e8df501005fd3660c80e3c2eefbb05bb
Closes-bug: #1520833
2015-11-28 16:30:00 -05:00
Swapnil Kulkarni (coolsvap)
59a1c8b9fb Remove hardcoded MAINTAINER in Dockerfiles
Added new option in kolla-build.conf

Change-Id: I45fe51966bcb59ea19d112281ba3d5a1ba091a56
Closes-Bug:#1514304
2015-11-23 11:03:47 +00:00
Jenkins
84b6f7edc4 Merge "Add Ansible support for Magnum" 2015-11-13 17:01:04 +00:00
Michal Rostecki
2cd5d9ed74 Add Ansible support for Magnum
Change-Id: Idb25ac4d3148c9b9400cf675ac2e47d35cce6224
Implements: blueprint ansible-magnum
2015-11-13 11:31:34 +01:00
Angus Salkeld
33d39f2942 Fix validate-all-maintainer.sh to look for Dockerfile.j2
And fix the fallout.

Change-Id: Iccad3f4fdb0a6a7c14246df3408cae0425b833a5
2015-11-09 15:20:13 +10:00
Jenkins
b178ed2021 Merge "Few improvements in Kolla tools. Added Ubuntu support." 2015-11-06 12:22:35 +00:00
Kirill Proskurin
396014f8d1 Few improvements in Kolla tools. Added Ubuntu support.
pip install default prefix in Ubuntu is /usr/local, and Kolla tools scripts
didnt respect that. So I added few OS checks in this scripts.

I improve config path check in build.py. Added more verbose error if we can't
find config directory.

Change-Id: Ide521ed205b0dc1fc27e237a9a8f4da0168e664f
Closes-Bug: #1512302
2015-11-06 14:03:30 +03:00
Hui Kang
bcce4502ed Use kolla_internal_address in the example rc file
Change-Id: I4ec1b5208a347a45ff729e1d8bff6fe6e37b925e
Closes-Bug: #1509865
2015-10-28 12:50:02 -04:00
Michal Rostecki
9a9c0ce944 Remove memcached container in cleanup-containers tool
Change-Id: Ic56b7b2fd6cd7d191cc364a37f3ebbc44950932e
Closes-Bug: #1508780
2015-10-22 06:47:32 +02:00
Kuo-tung Kao
1e86af763b put conatiner name to array in cleanup-containers
The brace in string variable will not be expanded in some case.
Put conatiner name into array.

Change-Id: I2fb16e7352bd579f207efce0fb9b2565a1e7236d
Closes-Bug: #1502467
2015-10-06 13:55:58 +08:00