200 Commits

Author SHA1 Message Date
Zuul
1106e7e697 Merge "Remove devstack-single-node-fedora-27" 2018-08-09 19:37:12 +00:00
Paul Belanger
b73fb37051
Remove devstack-single-node-fedora-27
There is no projects using this and allows openstack-infra to delete
fedora-27 images.

Change-Id: I37d482dd2b5e099c370ab693ff430cb9c56360f8
Depends-On: https://review.openstack.org/588369
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-02 16:17:37 -04:00
Kevin Benton
66b361b538 WSGI Neutron integration
This patch provides a new mechanism to deploy Neutron using
WSGI script. This also starts a Neutron RPC server process
when the Neutron API is loaded via a WSGI entry point to
serve the agents.

Co-Authored-By: Victor Morales <victor.morales@intel.com>
Co-Authored-By: Nguyen Phuong An <AnNP@vn.fujitsu.com>

Change-Id: I16a199b04858bfc03ef50d9883154dba8b0d66ea
Depends-On: https://review.openstack.org/#/c/580049/
Partially-implements: blueprint run-in-wsgi-server
2018-07-30 12:30:37 +07:00
Paul Belanger
ef3571338a
use fqdn for zuul projects
When setting up a 3pci zuul, there is an edge case where a downstream
zuul may already have openstack/foo projects, eg:
review.rdoproject.org/openstack/foo.  In this case, if openstack
projects are not namespaced to include the connection information zuul
gets confused and complains.  We can avoid this by using the fqdn for
git.o.o for devstack jobs and both upstream and downstream zuul will
properly use the correct connection.

Change-Id: I01419ea9f51ce7491aa319b6240aec9c0d4f2356
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-07-10 18:36:03 -04:00
Zuul
5e3a294210 Merge "Enable nova VNC configuration on the subnode" 2018-06-16 00:54:13 +00:00
Paul Belanger
bed03ea77a Switch to fedora-latest for nodeset name
To help avoid the amount zuul.yaml chrun when we bring a new version
of fedora online, switch to using fedora-latest. As of writing,
fedora-28 is the latest release which we update our testing for.

Also add fedora-28 support to stash.sh and remove fedora-25 /
fedora-26 as they are EOL.

Change-Id: I3d716554e8f270f4434cc9cac3408f8e890e0665
Depends-On: https://review.openstack.org/565758/
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-05-03 10:53:18 +10:00
Andrea Frittoli (andreaf)
05da9a9b1e Enable nova VNC configuration on the subnode
The n-novnc service only runs on the controller node, however novnc
settings must be enabled on both nodes for vnc to work, since both
hosts are compute hosts.

Change-Id: Icc29441f507e6e4df9fd900eb7f35b0862f52043
2018-04-25 13:52:44 +01:00
Zuul
ebabcfd857 Merge "Extract a devstack-minimal base job" 2018-04-05 09:35:14 +00:00
Monty Taylor
4d7e337576
Extract a devstack-minimal base job
For folks who are doing functional testing with less than the full set
of normal base services. Should be a no-op/ignorable for most people.

Change-Id: If14ee018c01995e0a5b6bcdaac9ddc8810c6d503
2018-04-04 09:42:03 -05:00
Zuul
95e988ddaf Merge "Update default ETCD_VERSION to latest 3.2 etcd release" 2018-03-28 09:19:16 +00:00
esberglu
b8fcb2594c Update default ETCD_VERSION to latest 3.2 etcd release
This updates the default ETCD_VERSION to the latest 3.2 etcd release,
v3.2.17.  3.2 is chosen as it is packaged in bionic and fedora; we
hope to move to packaged versions for distros that support it in due
course.

This version supports arm64 and ppc64le which were not supported by the
previous default, v3.1.10.

We have removed the override to tarballs.o.o, as these files are now
cached as described in [1]

[1] http://lists.openstack.org/pipermail/openstack-infra/2018-March/005871.html

Depends-On: https://review.openstack.org/556688
Change-Id: I5103b4331a8d7c5660848fc148ebe4139ce6dad9
2018-03-27 00:39:54 +00:00
Zuul
5bae5e93c7 Merge "Add nova-cells-v1 to experimental queue jobs" 2018-03-23 03:29:41 +00:00
Luigi Toscano
34e09dd3a9 Fix devstack job: the dict name is devstack_local_conf
It looks like a typo.

Change-Id: Id017b169f25a7589da3eca509c28f5d867fd5962
2018-03-18 17:56:27 +01:00
Jens Harbott
e6faf84ec3 Revert to using neutron-legacy based services
The patch to remove the use of the test-matrix [0] also switched from
using the neutron-legacy based service names (q-*) to the new neutron-*
names. However it turns out that the new implementation is not yet working
properly for most neutron-consuming projects, so we switch back to the
previous situation for now.

[0] https://review.openstack.org/546765

Change-Id: Id6de87211d6c4ea8fd14aa9203d8d5b17e9e2f04
2018-03-13 12:21:34 +00:00
Zuul
8d2f2644d4 Merge "Add an openSUSE Tumbleweed devstack non-voting check job" 2018-03-13 02:07:02 +00:00
Dirk Mueller
4404f680f2 Add an openSUSE Tumbleweed devstack non-voting check job
This adds the necessary fixes to pass a devstack run
on openSUSE Tumbleweed. Also removes opensuse 42.2 as it
is EOL for some time already and no longer actively tested
in the OpenStack infra.

Depends-On: I1b68c08c07cf6653ea58506f738cbe0054b38f3a
Change-Id: I2894482deef063fd02b0818c695a2ddbf6767039
2018-03-11 14:04:36 +01:00
Zuul
6d9e483172 Merge "Document jobs" 2018-03-11 10:57:03 +00:00
Zuul
5a6683dba1 Merge "Fix multinode mode for devstack" 2018-03-11 10:57:01 +00:00
Zuul
ea62df4b5b Merge "Define devstack services without the test-matrix" 2018-03-11 10:56:59 +00:00
Andrea Frittoli
067e36582b Document jobs
Add inline documentation to jobs and render it in the jobs doc page.
Adjust the roles page to match jobs for title and filename.

Change-Id: I47a2b4b379c8517b0dea59a75943f3f871c29046
2018-03-09 20:04:34 +00:00
Andrea Frittoli
5e714d3308 Fix multinode mode for devstack
Extend the devstack job so that it can support both single and multinode
cases.  Multinode mode require extra settings in devstack configuration,
some of which as subnode specific, some controller specific.

Also keep a simple devstack-multinode job defined for now so we can run
a multinode job in devstack gate, until the full tempest multinode job
is ready to match the old
gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv.

Fixing multinode also requires sharing the CA configuration between
controller and peers, overlay network configuration for communication
between virtual machines and running discover_hosts for nova after the
subnode has been setup.

The extra orchestration required for multinode is encoded in a
dedicated role to allow for jobs in other repos to re-use it.

Change-Id: I2dcbd9bdb401860820e655d97aa3c4775af2827f
2018-03-07 12:47:55 +00:00
Matt Riedemann
36c3aaa07e Add nova-cells-v1 to experimental queue jobs
The legacy-tempest-dsvm-cells job is being moved into the
nova repo and renamed to nova-cells-v1. This change adds
the new job name to the in-tree definition of the experimental
queue jobs that run on devstack changes. A project-config change
will depend on this patch to undefine the legacy job name from
being used on devstack changes.

Depends-On: https://review.openstack.org/549780
Change-Id: I22fa1411809c46ffc423e0dd1cde0d8f40362635
2018-03-06 10:59:49 -05:00
Zuul
e184e762aa Merge "Add a note on experimental jobs" 2018-03-06 12:39:11 +00:00
Ian Wienand
1610cc2219 Add a note on experimental jobs
With I4161e1f1c8d47070dd35fad38b00715438d94eb2 and
I37fe007dc6f387d43cbaf55771027718005ac40d we have removed most of the
legacy experimental jobs.

Add a short note so we don't go back to the Hotel California model of
"you can check in but never check out".  With zuulv3 it is possible to
have self-testing changes for testing indiviual jobs.  Experimental
should be for things with wider application to run against all
changes.

Change-Id: Ibfb902b17a8f7d5355689f2a584c061c001df0d8
2018-03-06 11:40:46 +11:00
Andrea Frittoli (andreaf)
2a2349be5f Stage .localrc.auto
Change-Id: I9beb713a0b037e0229b13fd13d7d4de156ed0b59
Depends-on: https://review.openstack.org/544606
2018-03-06 09:24:55 +11:00
Zuul
d8ad1b26ff Merge "Define devstack-base abstract job" 2018-03-05 14:38:16 +00:00
Andrea Frittoli (andreaf)
d9c1275c5d Define devstack services without the test-matrix
Emit a disable_all_services and define which service we run in
the job directly. This drops the dependency from the test matrix,
from devstack default list of services and it makes it easier for
jobs to add/remove services based on the list in the base job.

Change-Id: Ib1debefd541b933dbfc54d484c263cc0ed60423d
2018-03-03 08:44:50 +00:00
Andrea Frittoli
7b1d5b64ac Define devstack-base abstract job
Define an abstract job devstack base that does not require any
project apart from devstack. This job defines basic devstack_localrc
settings that are common to any devstack job (mostly to work with
infra) and devstack_services to emit "disable_all_services" so to
cancel any devstack default.

The variables are defined as global ones as well as host-vars for
the controller and group-vars for peer nodes, so that any
descendent job may extend them, thanks for Zuul dict merging.

Change-Id: I2cdb723f6ee209683044fecec59ff7b510a2752b
2018-02-27 07:39:10 +00:00
Ian Wienand
11641ce14d Move platform jobs to zuulv3 native
We've called the jobs that don't run on our main Ubuntu targets
"platform" jobs; start at moving these jobs to native jobs.

Depends-On: https://review.openstack.org/541010

Change-Id: Ib64d91206a9ac677f4d77873bc54c6a84702d6c3
2018-02-23 08:26:34 +11:00
Ian Wienand
83ecb97fec Add VERBOSE_NO_TIMESTAMP flag
As described in the documentation, this flag is intended for the case
where the console output is being captured by a tool that appends its
own timestamps.

In the gate this is the job-output.txt.  We want the console output as
people like to watch that scrolling by as part of the live console
log.  Although this gets saved to job-output.txt, we still want to
keep logging to the individual log files even though it's technically
a duplicate -- in the multinode case the job-output.txt gets
interleaved by all the running nodes; it's much easier to just look at
the individual log files.  Also, people are used to it where it is :)

Change-Id: I3486636f1c76139581f6cd9668426f507b7c621d
2018-02-23 08:26:34 +11:00
Matt Riedemann
21e3be8a5e Add the nova-next job to the experimental queue
The nova-next job is being moved from openstack-zuul-jobs
to the nova repo and so we'll remove it's usage from
project-config, therefore we need to define it's usage for
devstack here.

The related project-config change is:

I36d96f89b3e5323746fcbcef5cc7e4d0384a184d

Depends-On: I24a5f73c29094a23e2fdef8ee8b43601300af593
Change-Id: I28971dc7e5cb0b5cf9698e5251a7bb099e63f3db
2018-02-13 10:31:09 -05:00
Zuul
3f2f418fbf Merge "Add Zuul v3 native unit-tests" 2018-02-12 23:24:54 +00:00
Zuul
47467acf2f Merge "Move extensions_to_txt to the job defintion" 2018-02-09 12:29:21 +00:00
Andreas Jaeger
838b833b63 Add Zuul v3 native unit-tests
Add new job to replace legacy-devstack-unit-tests.

Change-Id: I4fe59b1954514a7146a4412e3103a0a05a9250f2
2018-02-04 21:42:00 +01:00
Andrea Frittoli (andreaf)
63171eeae2 Move extensions_to_txt to the job defintion
Move extensions_to_txt to the job defintion so that it may be
extended by descendant jobs.

Depends-on: https://review.openstack.org/540485/

Change-Id: I6e9009faa1451698ed781ce1ffdd9f22c97daa93
2018-02-02 18:45:40 +00:00
Zuul
85f990b1f5 Merge "Zuul: Remove project name" 2018-02-02 16:28:30 +00:00
James E. Blair
6e316daf45 Zuul: Remove project name
Zuul no longer requires the project-name for in-repo configuration.
Omitting it makes forking or renaming projects easier.

Change-Id: I32868cec22149ec1c18fe2737a65e88d32bff531
2018-02-02 03:48:46 -08:00
Monty Taylor
a904caded4
Move zuul_copy_output to be a job variable
The zuul_copy_output variable is designed to be able to be used as
a zuul job variable so that zuul dictionary merging will work. However,
it's currently being set in the playbook rather than as a job variable,
so it's not possible to supplement it in a child job.

Move it to be a job variable. Also remove the wrapping {} as they should
not be needed to make zuul_copy_output a dictionary.

Change-Id: I78c7fed47c2ab868384c74dbff7904d33d510dd9
2018-01-31 14:40:39 -06:00
Andreas Jaeger
b4d772b9fd devstack job: Add irrelevant-files
Do not run devstack and its siblings if only rst files, releasenotes, or
files in doc directory change.

This is the minimal set of irrelevant files shared by most projects
already.

Needed-By: Ie8504ba3d5d46f6338a228ed2d248ba6363e37ae
Change-Id: Id0095763eb91592c2fd1a913526883987df704bd
2017-12-23 20:49:15 +01:00
Monty Taylor
e1b0c3886b
Add base jobs for functional tests
I keep copy-pasting these to projects from the shade repo. Let's make
some base jobs people can more easily use.

devstack-tox-functional runs devstack and a tox functional environment.

devstack-tox-functional-consumer is the same, but runs devstack in pre.
It's intended for projects for whom patches to the project won't
actually impact the devstack deployment (shade, nodepool, gophercloud
are all examples of such things)

Change-Id: I84de60181cb88574e341ff83cd4857cce241f2dd
2017-12-11 16:13:22 -06:00
Monty Taylor
52804403ca
Gate on v3 devstack job
The devstack base job in in use in many projects, but it is not being
gated here in devstack. Let's add it to the list so that we don't
accidentally break it.

Change-Id: Iea13235a8438d4b540f9f27b94aed13e719481dc
2017-12-10 07:15:09 -06:00
Andrea Frittoli (andreaf)
7d4446541d Set the base set of services
Use the test-matrix role from devstack-gate to define a base set of
services to be enabled for the controller and compute nodes.

Extend the local conf module to handle the base set of services.

Since the test-matrix defines services for primary and subnode nodes, we
need a multinode job to test that this works. Add a new host group
called subnode that includes the non-controller hosts. Add a new job
that runs devstack on a two nodes environment.

Using service from the test matrix enables swift in the gate, so we need
to set SWIFT_HASH for devstack to work.

Depends-on: Ie36ba0cd7cfcd450b75000a76a64d856f2a83eba
Depends-on: Id9ad3be4be25e699f77d6b5a252f046ce8234f45
Change-Id: I379abf482c89122533324e64fefbff3d5a618a89
2017-12-06 12:46:44 +00:00
James E. Blair
c0d8c1c72d Zuul: add file extension to playbook path
Zuul now supports including the file extension on the playbook path
and omitting the extension is now deprecrated.  Update references
to include the extension.

Change-Id: I4bff5f12742364f7cc92e17869a047fd2185dda4
2017-10-29 09:21:42 -07:00
Zuul
464d6e06ea Merge "Zuul: add run attribute" 2017-10-27 08:27:27 +00:00
Zuul
2974283e7e Merge "Use configure-swap from o-z-j" 2017-10-27 05:11:35 +00:00
James E. Blair
228d90d5eb Zuul: add run attribute
A proposed change[1] to Zuul removes the implied run attribute.
Add an explicit run attribute here to prepare for that.

[1] Ia8f23bce9898cd4f387554e6787b091b63e75519

Change-Id: I1fbc36c3d1b8c4ed70fceef1c587255dad50da04
2017-10-26 16:47:07 -07:00
Monty Taylor
c9e109f135
Disable nested virt in base devstack job
We were doing this in devstack-gate. The gate can't handle nested virt.

Change-Id: Ie71663c3144908ddd134fa5a5b1b2d265a60edcf
2017-10-21 18:04:49 +02:00
Ian Wienand
d8753b7dc9 Use configure-swap from o-z-j
Use the generic role

Change-Id: I534ed0256b7dfe5bef4ab13ae57cd73c51e8bd15
Depends-On: I0e9c846ace7fac8a1340746c6818fba6ec963018
2017-10-20 15:08:37 +11:00
James E. Blair
9640d3bfbf Zuul: remove file matcher for devstack job
The file matcher was from the early versions of this when we were
running both v2 and v3.  We should always run the new devstack
job on all changes to devstack now that v3 is in production and we
plan on building jobs off of this one.

Change-Id: I7dd336b0059043f6653bdfdcba0ee5cded3e67b1
2017-10-15 16:23:57 -07:00
Monty Taylor
36ddea31a2 Add devstack base job for zuul v3
This should be managed in the devstack repo, since it's a base job to
run devstack.

Change-Id: Iffe54fbccbccd68db08f79a1b51dd7f76dbff408
Depends-On: Ie2119f24360d56690ffd772b95a9ea6b98dd4a39
2017-10-15 07:17:18 -07:00