89 Commits

Author SHA1 Message Date
Mark Goddard
65aa706a44 Use kolla-ansible version to tag images
If building images, kolla currently uses its own version for their tag
by default.  This might not match the version of kolla-ansible, which is
what is used by default in kolla-ansible. This leads to the image not
being found.

This change uses kolla-ansible's version to tag locally built images.

Change-Id: I49c7afb9167d1e3f8a4470b6ebbb6ad6798d4996
2019-01-09 18:13:27 +00:00
Eduardo Gonzalez
535aba79a9 Add NFV orchestration services CI job
Change-Id: I33484d0961f1cd17ed05dd124eba68d99b4db83f
2018-12-21 11:43:22 +01:00
Eduardo Gonzalez
362b6ee40e Test zun container creation in gates
Change-Id: If5b4ba975a65e07d2704eb6bdb9d841d6a9c3d42
2018-12-19 19:50:59 +01:00
Zuul
0bc44c9ae9 Merge "Refactor tests/templates/globals.yml" 2018-11-08 16:33:18 +00:00
Eduardo Gonzalez
26af377a3b Refactor tests/templates/globals.yml
Improve where openstack services are deployed
to a variable, so we will avoid many conditions
when more CI jobs are added with different configs.
Heat is enabled by default in globals.yml, lets deploy it
at least.

Change-Id: If0f009cf434c3ed5874b3171d8c75911ef8e4be1
2018-11-08 10:15:38 +00:00
Michal Nasiadka
9257c18469 Add logs_dir to kolla-ansible CI jobs
Change-Id: Ie3efb4d5de046ba90a72e2d722130a685c4fcabf
2018-11-07 20:30:18 +01:00
Mark Goddard
f92de48c28 Refactor CI testing scripts
This change is intended to ease the addition of new test scenarios, by
splitting the existing setup_gate.sh script up into several smaller
scripts. We may wish to further break these scripts up in future,
depending on the requirements of new test jobs.

Change-Id: Ifa442ac79a54f749c56d20f5f7383c3852d95268
2018-11-06 16:43:19 +00:00
Zuul
f941d47dcb Merge "Don't use 'become' in CI tests" 2018-11-06 16:31:25 +00:00
Hongbin LU
f57c1aec6c Add Zun scenario job for ubuntu
Introduce a job 'kolla-ansible-ubuntu-source-zun' to test kolla
with Zun enabled. To reduce CI resource, this job will be triggered
only if there are changes on the Zun's ansible roles.

Change-Id: I0ba207e1d3761da2d6992c5834d4f59e7e1d6628
2018-10-22 14:24:36 +00:00
Zuul
83de86960c Merge "Use openstackclient instead of neutronclient" 2018-10-22 06:45:31 +00:00
Hongbin Lu
9691d53009 Use openstackclient instead of neutronclient
The python-neutronclient is deprecated. We should use openstackclient
and openstacksdk for the equivalent functionality.

Change-Id: Iaf49d6b7942343104e0b40b6db89b78a793b858b
2018-10-21 19:42:47 +00:00
Zuul
453fca37ad Merge "Revert commit of fixing ceph gates" 2018-10-15 08:39:06 +00:00
Mark Goddard
8399fc7813 Don't use 'become' in CI tests
Kolla Ansible now claims [1] to support executing as a user other than
root.  We should ensure that this is tested in CI.

This change removes the 'become' from hosts in the inventory, and sets
the remote user to 'kolla', as configured via the bootstrap-servers
command. The bootstrap-servers command and other ansible commands
executed before it still need to execute as the zuul user and not as
kolla, since kolla does not exist yet.

The autogenerated SSH private key in passwords.yml is now added to the
zuul user's SSH config, such that it can SSH as the kolla user, which
has authorised this key.

[1]
https://blueprints.launchpad.net/kolla-ansible/+spec/ansible-specific-task-become

Change-Id: I8f3587e2908bc5b8889cd6fbc01981a6186d33e6
2018-10-02 09:30:18 +01:00
confi-surya
dfd372b6e2 Revert commit of fixing ceph gates
This patch is to test and revert the change

Change-Id: If930306a357e40ad02c4d7f71779701a9a52b94a
revert: Ie8feb03e9a07a6486a8b375d3304c9e6f1f8b890
2018-09-23 04:29:47 +00:00
Paul Bourke
b163cb02d1 Update rabbitmq to use new conf & clustering
Depends-On: I75e00312b36e1678b90a42cf58d24652323eff27
Change-Id: Ia716fabffca41eff816e59bbf9f4cab79ee8b72f
2018-09-21 16:47:59 +00:00
Zuul
95135e7f03 Merge "Temporarily remove the rabbitmq clusterer plugin" 2018-09-20 07:43:17 +00:00
Mark Goddard
354894e2e9 Add check.yml for prometheus and vitrage
Without this, kolla-ansible check fails with the following error:

Unable to retrieve file contents
Could not find or access '/path/to/kolla-ansible/ansible/check.yml'"}

Also adds the check command to the CI tests, to ensure that it does not
break again.

Change-Id: I9fc2f9999f55cb742ac3ac38579dcf26524a9fc7
Closes-Bug: #1790653
2018-09-04 15:36:34 +01:00
Paul Bourke
0d03fc2789 Temporarily remove the rabbitmq clusterer plugin
In order to migrate to the latest release of rabbitmq (3.7), we need to
first remove this deprecated plugin which is no longer supported (the
problems it solved are now addressed in rabbitmq itself).

This avoids a circular dependency in CI where the new images depend on
the new clustering and the new clustering depends on the new images.

Change-Id: I921459f3e40b9e0d4af9497384e49aabf0abe79b
2018-08-21 11:24:09 +00:00
Mark Goddard
c71de0e2c9 Fix the name of the CI log for reconfigure
The reconfigure output was previously overwriting the post-deploy
output.

Change-Id: Idada4b0b1d34b6a37a99f022407c74aff043497a
2018-08-02 15:59:39 +01:00
Eduardo Gonzalez
8998877021 Fix ceph gates
Cinder removed some parameters from the API.
Openstack client is not updated yet and failing.

Revert this change once is fixed.

Change-Id: Ie8feb03e9a07a6486a8b375d3304c9e6f1f8b890
2018-08-01 12:20:27 +02:00
Eduardo Gonzalez
cc5cdba7c8 Fix depends on kolla changes
Depends on needs chrony image to succeed deploy

Change-Id: Id4bcbffad2392d8b2dabd8359330139448c6f7b7
2018-07-31 10:12:48 +02:00
Jeffrey Zhang
b51eeed89e Use include_tasks instead of include
include is marked as deprecated since ansible 2.4[0]

[0] https://docs.ansible.com/ansible/2.4/include_module.html#deprecated

Co-Authored-By: confi-surya <singh.surya64mnnit@gmail.com>
Change-Id: Ic9d71e1865d1c728890625aeddf424a5734c0a8a
2018-07-25 23:57:22 +08:00
Mark Goddard
45a4f9c075 Add a job for testing deployment of bifrost
Deploys a bifrost container using kolla-ansible bifrost-deploy.

IPA and disk images are downloaded rather than built to improve
reliability.

Currently only minimal testing of the deployment is performed, creating
and deleting an ironic node. Ideally we would perform a bare metal node
deployment.

The job is based on CentOS, as Ubuntu bifrost deployment is currently
failing with a python-MySQLdb error.

Change-Id: Ic45094594c21116b5b0d6a606f568fc7954175e3
2018-06-18 13:40:43 +01:00
Jeffrey Zhang
4ab76ed9e1 Put upper limit on cmd2 in kolla-toolbox
This fixes an issue with cmd2 >= 0.9.0 requiring python3.

Change-Id: I5f88f0b0540785f8e7b7ab7c5252c6a51f314922
Closes-Bug: #1773938
2018-05-30 16:00:58 +08:00
Jeffrey Zhang
def7d35404 Implement ARA sqlite databases over http feature
More info please check[0][1].

[0] http://lists.openstack.org/pipermail/openstack-dev/2018-March/128902.html
[1] https://ara.readthedocs.io/en/latest/advanced.html

Change-Id: I5cf68c0bb54878e328387143712dec9582be04a1
2018-04-02 14:13:54 +08:00
Eduardo Gonzalez
e0d37de9d0 Fixes ceph deploy gates
- Ceph images are not being built when using depends-on a kolla build
  job.
- Sync inventory files with current ones which causes ceph to fail due
  missing groups.
- Small corrections in ceph config.yml syntax.
- fix preparse the disk only once
- enable ceph nfs only when enable_ceph_nfs is true

Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com>
Change-Id: Id0c7963bf59e2af4944834dcd16589a638e78ba5
2018-01-24 15:10:01 +08:00
Michal (inc0) Jastrzebski
478e2cf9c9 Enable multinode scenarios in zuulv3
Another step to migrate to new CI

Change-Id: Id9bf9b4b1114f5be66f6c028a0db16d869efeceb
Depends-On: Iaacdca31b27b7033ec08499bcea7061b9d3ec279
2017-12-27 09:21:35 -08:00
Jeffrey Zhang
11f9afba1b Pull image from dockerhub rather than tarballs.o.o site
Change-Id: Id71c1ecda9f8647a0eb290fe02a12afb3df09988
2017-11-16 15:44:24 +08:00
Jeffrey Zhang
cdd125117f Optimize zuul v3 jobs
- move check container failure from post.yml to run.yml
- add binary related jobs
- use static kolla-ansible src dir, which is helpful for kolla project
  to use.
- generate correct /etc/hosts by using private ip address and hostname
- fix the wrong api interface in global.yml file

Change-Id: Idfdee6dfe18f0fa2d4f984df59b57553122ce298
2017-10-26 09:58:29 +08:00
Jeffrey Zhang
baa9319a75 Move to zuul v3 in project jobs
Partial-Bug: #1720601
Change-Id: Ibc20a6ae8c645ff82f3c14a6286073dffd4cfae2
2017-10-18 12:31:52 -07:00
Eduardo Gonzalez
fa06dcd37b Fix ci gate failure
This patch includes three unrelated fixes.

Make qemu use nova user in centos
Libvirt 3.2.0 (latest version in centos) seems to
have changed behavior of dynamic_ownership.

Pin ansible to <2.4 to make ara work in gates
ARA does not work yet with ansible 2.4, this change
pins to lower version to make gates work.
Revert once ara works with 2.4

Disable selinux for oraclelinux and centos.

Co-Authored-By: wanghongxu <wang19930902@gmail.com>
Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
Change-Id: Iac8bec19437192cd198d58f71c6ed0a65a76f820
Closes-bug: #1718541
2017-09-23 09:03:52 +08:00
Jenkins
9a520e0906 Merge "Fix gates out of disk space" 2017-08-31 13:52:26 +00:00
Eduardo Gonzalez
894e73146c Fix gates out of disk space
Sometimes gates fails due lack of disk space,

This change mounts a second disk in opt and moves
registry data to opt.
Disk format commands are excepts from devstack-gate:
dc49f9e6eb/functions.sh (L306)

Change-Id: I606aa491b8cbf678e83281bad1a0ff39d3920ff2
Closes-Bug: #1713652
2017-08-29 09:11:56 +01:00
Surya Prakash Singh
7aec5a2823 Changed as per the standard convention set to use "."
When we have to source a script file use . instead of source
For Reference follow below link:
https://docs.openstack.org/contributor-guide/writing-style/code-conventions

Change-Id: Ia170ccf245131463e3179dd75ccc66142521bc5f
2017-08-28 16:15:13 +05:30
David Moreau-Simard
77f1812e00 Dynamically retrieve the location of ARA to work on both py2 & py3
Remove the hardcoded callback path with python2.7 and use the
virtualenv python to determine the path where ARA is installed so
that no matter if we're running py2 or py3, it will work.

Change-Id: Ica0b94aeebabaeca8416a9768fadd12d3925e7b2
2017-07-22 23:13:16 -04:00
Jenkins
7333ae330f Merge "Upgrade from docker-py to docker" 2017-07-19 03:19:33 +00:00
Jenkins
2cb46ffbae Merge "Allow tmp path to download registry" 2017-07-14 17:38:20 +00:00
Jenkins
a981b9e325 Merge "Fix depends-on kolla gates" 2017-07-13 10:07:38 +00:00
Michal (inc0) Jastrzebski
50735ff1bb Allow tmp path to download registry
Required for dockerhub publisher

Change-Id: I0231bd07415ef05b3f4f937e32a9df4cd0643672
2017-07-12 14:34:02 -07:00
Michal (inc0) Jastrzebski
2f00c64616 Enable proxy cache for tarballs download
Lately, after we increased number of jobs, infra started to experience
network traffic issues due to us downloading registries. This
per-nodepool cache should help and also speed up actual gate.

Change-Id: I621a9c91e4508ef208a28137a736fd8468388219
Depends-On: I527d32f9b43dabb7640bfb056e2bf828b7c1dfa9
2017-07-12 11:50:44 -07:00
Hongbin Lu
3daeea37ea Upgrade from docker-py to docker
The pypi package 'docker-py' [1] has been renamed to 'docker' [2].
It is better to move to the new 'docker' package because the old
package will be deprecated and all the new features will go into
the new package only.

Package 'docker' has been added to requirements [3]. The old
package 'docker-py' is still allowed to be in the global requirements
during the transition period but it should be removed after all or
most of the projects finsih the migration.

[1] https://pypi.python.org/pypi/docker-py
[2] https://pypi.python.org/pypi/docker
[3] https://review.openstack.org/#/c/423715/

Change-Id: Ibcd5a57a1fbf55dcc5a690e41f20917f95b63da0
2017-07-10 14:19:28 +00:00
Eduardo Gonzalez
378ec1f1fe Fix depends-on kolla gates
When using depends-on, gates will not build cinder
and ceph images, causing ceph deploy gates to fail.

Change-Id: I441c742251754db27374331f774041c214678eba
2017-07-10 11:28:42 +00:00
Michal (inc0) Jastrzebski
339b27c7fe Enable multi-scenario gates
First non-trivial scenario we'll be testing in gates will be cinder +
ceph. This patchset is supposed to create framework to easily add new
testing scenarios.

Change-Id: I6790eaf5cf3297af04a64e4169a39b6e2cd1890f
2017-06-19 10:14:33 -07:00
Michal (inc0) Jastrzebski
f5354f55b1 Enable multinode gate
This patches changes deploy_gate quite a bit so in reality all
deployments will now assume multinode (even if it's single node). After
that we will refactor it even further to enable easy addition of new
scenerios.

Change-Id: I1faada46e6a7aa026128b2f01d77eabb04759439
2017-06-05 11:35:20 -07:00
Eduardo Gonzalez
ba6e3249d2 Change ssh/config permissions to 600
ssh/config permissions are 664 currently, causing error
`Bad owner or permissions on /home/jenkins/.ssh/config`

http://logs.openstack.org/68/461368/1/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/0a94da7/console.html#_2017-05-01_12_06_08_440775

config file should only be writen by owner.

Closes-Bug: #1687408
Change-Id: Id804f11a91858fa297e5236beb2110e3511eabec
2017-05-01 14:21:24 +00:00
Eduardo Gonzalez
029de18d0b Add ssh-keyscan to unblock kolla-ansible gate
As a change to remove puppet from infra nodepool,
ssh-keyscan is needed for each node.[0]

Host key checking was disabled by default by jenkins
user. [1]

Refs:
[0] http://lists.openstack.org/pipermail/openstack-dev/2017-April/116036.html
[1] https://review.openstack.org/#/c/460731/
Change-Id: I0f4000f18b7a2b3266c95c3f7a5109e3603c94a7
2017-04-28 13:16:20 +00:00
youri jeong
f8322dffd3 fix typo
fix typo for specs/kubernetes-deployment.rst, tools/ovs-dpdkctl.sh, tools/setup_gate.sh

'managment' -> 'management'
'seperated' -> 'separated'
'occuring' -> 'occurring'
'discribed' -> 'described'
'recomended' -> 'recommended'
'thier' -> 'their'

Change-Id: Ie59c600698c965cebd9a541b951d704eda9301cb
2017-04-11 12:08:19 +00:00
Jeffrey Zhang
38813f8c74 Install ansible without upper constraints
Ansible use jinja2 < 2.9, but requirements/upper-constraints.txt
requires jinja2===2.9.5. Installing ansible shouldn't use upper
constraints provides by OpenStack.

Change-Id: Ib37e8d06373a61959b41b8737085d5f001650e42
2017-02-12 07:44:16 -07:00
Jenkins
2b37e3b871 Merge "Add fluentd role" 2017-01-24 12:54:12 +00:00
zhubingbing
d3d4a933be Add fluentd role
* add fluentd role
* remove heka configure

Co-Authored-By: yangzb09 <yangzb09@qq.com>

Partially-Implements: blueprint add-fluentd-role

Change-Id: Ica804a99f5bb8b157f406299c5982b7b6283b3e3
2017-01-24 07:44:59 +00:00