109 Commits

Author SHA1 Message Date
Julia Kreger
aa5db417d2 Lower standalone concurrency to 3 from 4
The standalone job seems to be the most problematic CI job
in ironic's CI jobs at this point in time. While we've moved
to unsafe disk caching for the test VMs, there are times when
the devstack instance is still being crushed with IO wait for
multiple seconds.

This could be from processes in the VM or just a noisy neighbor
but first lets try to lower the concurrency to hopefully make
the job more reliable.

Change-Id: I4dfeb3407cfe4064a5d93a4ed3657677fa5237ef
2019-08-20 08:01:41 -04:00
Zuul
95a140a54c Merge "Enable testing software RAID in the standalone job" 2019-08-14 17:14:15 +00:00
Dmitry Tantsur
27f7143eb9 Switch non-multinode jobs to new-style neutron services
Change-Id: I62f462986f0f3976cdd8ac72f0e86afea07760cd
2019-08-13 11:16:55 +02:00
Dmitry Tantsur
2f7de3264c Enable testing software RAID in the standalone job
Change-Id: Id5cc1854492df230e6657bc8450c49a52f21ac16
Depends-On: https://review.opendev.org/#/c/675064/
2019-08-07 14:11:04 +02:00
Dmitry Tantsur
3dfce5f2de CI: stop using pyghmi from git master
It's just a library we consume, there is no reason to use its
git head. Currently 1.4.0 is breaking us.

Story: #2006301
Task: #36014
Change-Id: Ib1b1e32bc60d7ec271098dcd17086f79518c09df
2019-07-29 17:52:49 +02:00
Zuul
1ac2caa339 Merge "Adds bandit template and exclude some of tests" 2019-06-29 12:54:49 +00:00
Dmitry Tantsur
ac0900add2 CI: remove quotation marks from TEMPEST_PLUGINS variable
The has stopped working out of a sudden. We should move to tempest_plugins
zuul variable later on, but it is only available since Stein.

Change-Id: I2cc64580b089566e664d54ea2087878b9cce6666
2019-06-26 13:12:28 +02:00
Kaifeng Wang
bffb075d20 Adds bandit template and exclude some of tests
Adds bandit configuration template and exclude some of
tests that we don't want to fix for the moment.

Keeping job unvoted so that we can keep an eye on possible
issues while not breaking gate.

Change-Id: Ic577cad3b61421c04023ea887236992acb19f77c
Story: 2005791
Task: 33518
2019-06-20 15:08:43 +08:00
Zuul
adecc670f7 Merge "Incorporate bandit support in CI" 2019-06-19 05:45:10 +00:00
Nisha Brahmankar
df5ac6d5bc Updates ironic for using ironic-python-agent-builder
Change-Id: Ic7a515eeda59b6611049c39978fda3ccbb162a45
Task: 33746
Story: 2005114
2019-06-13 03:54:43 +05:30
Kaifeng Wang
caf925349a Incorporate bandit support in CI
Change-Id: I0ffe0c12e9e32f32d2b400b5756fc2148a2993a0
Story: 2005791
Task: 33518
2019-06-10 09:26:04 +08:00
Julia Kreger
55e8d3fde1 Add a pxe/uefi/grub2 CI job
Fixes the grub2 based devstack logic and adds a grub2 CI job
such that the ironic team can safely clean-up some of the PXE
code without fear of breaking the grub2 scenario.

Story: 2003936
Task: 27724
Change-Id: Ieb395bf35e2689741a243c11b56d08a237b200bc
2019-06-05 14:21:13 -07:00
Dmitry Tantsur
75d796e731 Make the multinode grenade job voting again
Change-Id: I483fd8efc642ecb780421a1181c771f6108ad8b4
Depends-On: https://review.opendev.org/#/c/661559/
2019-05-27 13:07:03 +02:00
ZhongShengping
befc4a61e6 Update Python 3 test runtimes for Train
This goal is to implement the process set out in the 2018-10-24 Python
Update Process TC resolution[1], for the Train cycle to ensure unit
testing is in place for all of the Tested Runtimes for Train[2].
In practice, this generally means adding unit tests for Python 3.7 and dropping
unit tests for Python 3.5. Using the Zuul template for Train will ensure that
all projects that support Python3 will be tested against the agreed runtime
versions, and make it easier to update them in future.

[1]https://governance.openstack.org/tc/resolutions/20181024-python-update-process.html
[2]https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I06e6c071b8bd369c8a66bade2490f65070fd0665
Depends-On: https://review.opendev.org/#/c/641878/
2019-05-09 17:42:47 +08:00
Julia Kreger
bda02c43fb Direct bridge to be setup
The multinode jobs are failing because the br-infra bridge
is not being setup. It is not being setup because somewhere
in the infra, the multi-node-bridge role is never established
as a requirement. Realistically, only ironic does this, but
we need to ensure it is present.

Change-Id: Ia1dcc68d7e75a931e01829ce23da36c978a70765
2019-04-23 16:47:24 +00:00
OpenDev Sysadmins
d0e6c6cb10 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:40:53 +00:00
Zuul
5fe272f4f8 Merge "Use the PUBLIC_BRIDGE for vxlan" 2019-04-12 15:03:05 +00:00
Julia Kreger
1d0accbbe1 Use the PUBLIC_BRIDGE for vxlan
The PUBLIC_BRIDGE parameter, for most multinode zuul jobs
defaults to br-infra in cases where native zuul configuration
is used.

However, this is not true for legacy jobs still using devstack-gate.

When jobs are invoked with devstack-gate, the bridge must be set
to match the devstack-gate scripting as zuul *does not* setup the
vxlan bridge for us. Devstack-gate does so.

Change-Id: I37bff3c4d930ada483690d0dea17cb9a64d51fd2
2019-04-10 07:10:49 -07:00
Julia Kreger
2bb05fef72 Temporarily mark grenade multinode as non-voting
Seems the bridg name has changed, and until we're
able to get it sorted, lets mark it non-voting such
that we're able to land other code... and actually
land any fixes since the changes ideally need to
merge to stable/stein first given grenade's
operating model.

Change-Id: Ibeb89003416b398c199d605744eadf408927de45
2019-04-09 12:54:34 -07:00
Zuul
eaf6d8d95d Merge "Replace openstack.org git:// URLs with https://" 2019-03-31 19:25:07 +00:00
Riccardo Pittau
6f22c00149 Workaround for uefi job with ubuntu bionic
In ubuntu bionic, the UEFI provided in the ovmf package version
0~20180205.c0d9813c-2, EFI v2.70 by EDK II, seems broken and
causes kernel panic.
To be able to boot using uefi, we download and install the old
working version 2.60 from the multiverse repository.

Story: 2004604
Task: 28500

Change-Id: I1a5b4a6544621316f71203282f7418d2001ad357
2019-03-26 15:08:39 +01:00
Ian Wienand
228dfe308a Replace openstack.org git:// URLs with https://
This is a mechanically generated change to replace openstack.org
git:// URLs with https:// equivalents.

This is in aid of a planned future move of the git hosting
infrastructure to a self-hosted instance of gitea (https://gitea.io),
which does not support the git wire protocol at this stage.

This update should result in no functional change.

For more information see the thread at

 http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003825.html

Change-Id: Ie1be8a026e88eba235bce29fe0504e35e03afe8e
2019-03-24 20:33:50 +00:00
Zuul
f1bcaf7b80 Merge "Migrate ironic-grenade-dsvm-multinode-multitenant job to Ubuntu Bionic" 2019-03-23 01:31:15 +00:00
Zuul
971b1ed13e Merge "Add a non-voting metalsmith job for local boot coverage" 2019-03-21 14:14:21 +00:00
Julia Kreger
3f734c8728 fast tracked deployment support
Provides a facility to minimize the power state changes of
a baremetal node to save critical time during deployment
operations.

Story: #2004965
Task: #29408
Depends-On: https://review.openstack.org/636778
Change-Id: I7ebbaddb33b38c87246c10165339ac4bac0ac6fc
2019-03-14 10:34:31 -07:00
ghanshyam
407724a22a Migrate ironic-grenade-dsvm-multinode-multitenant job to Ubuntu Bionic
We have migrated the zuulv3 job to Bionic during Dec/Jan month.
 - http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000837.html
 - https://etherpad.openstack.org/p/devstack-bionic
But that effort does not move all gate job to Bionic as there are
large amount of jobs are still legacy jobs. All the legacy jobs still
use Xenial as nodeset.

As per the decided runtime for Stein, we need to test everything on openstack
CI/CD on Bionic - https://governance.openstack.org/tc/reference/runtimes/stein.html

Below patch move the legacy base jobs to bionic which will move the derived jobs
automatically to bionic. These jobs are modified with branch variant so that they will use
Bionic node from stein onwards and xenial for all other stable branches
until stable/rocky.
- https://review.openstack.org/#/c/639096

This commit remove the overridden nodeset in ironic-grenade-dsvm-multinode-multitenant
job so that it will start using the nodeset defined in parent job.

More Details: 
- https://etherpad.openstack.org/p/legacy-job-bionic
- http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003614.html

Depends-On: https://review.openstack.org/#/c/639096
Change-Id: If5876243d2d9b16f1c1ef37ef0ab5a660629f741
2019-03-13 00:58:02 +00:00
Dmitry Tantsur
2bf3d0a3a0 Add a non-voting metalsmith job for local boot coverage
Also provides coverage of standalone ironic and openstacksdk.

Change-Id: I9419ae769d38324b035c2f2c1c1ac3829e3bab0a
Story: #1531149
Task: #10406
2019-03-11 14:55:28 +01:00
Mark Goddard
cf2c0a0022 Add python3 unit test with drivers installed
Adds unit-with-driver-libs-python3 tox environment, and corresponding
ironic-with-driver-libs-python3 Zuul job.

The lack of this job was highlighted by
https://review.openstack.org/#/c/641972 which marks UcsSdk as supported
in python 2 only.

Change-Id: Ibc0f9a8fddd8f6b358efed1c4c93b95d4e01bc13
2019-03-11 11:22:49 +00:00
Riccardo Pittau
c8ece0c625 Add option to set python interpreter for ansible
This patch adds the option to configure the python interpreter
that is used when deploying machines using the ansible deploy
interface.

Also set the default interpreter for tinyipa image with
ansible deploy interface to /usr/bin/python3 on devstack
and marks ironic-standalone job as voting again.

Change-Id: I8eb58fb00980c9e8946e3b3ef77611a9f5212668
Story: #2005159
Task: #29877
2019-03-07 18:40:06 +01:00
Riccardo Pittau
790530f337 Temporary marking ironic-standalone non-voting
The ironic-standalone job is failing because the most recent IPA
image has only python3 and ansible uses python 2 as default
interpreter, resulting in a /usr/bin/python not found error.
Marking ironic-standalone non voting and removing it from the
gate until we can run ansible with python3 on remote machines.

Change-Id: I56768d7c8a577f267172de02d77e2cc2ead785ad
2019-03-06 17:00:11 +01:00
Riccardo Pittau
578805b34b [trivial] Removing python 3.5 template jobs
Also correcting docs as we don't have a py35 environment

Change-Id: I409db4b73a2dedf283107708e7eea105549da867
2019-02-22 12:21:25 +01:00
Dmitry Tantsur
7efbbcc2d9 Support using JSON-RPC instead of oslo.messaging
Using AMQP-based RPC can be an overkill in case of ironic, especially
when used standalone. This change allows using a built-in JSON RPC
implementation instead.

This implementation does not currently support the object indirection
API, which does not seem to be used anywhere anyway.

The standalone and API test jobs are changed to use JSON RPC.

Story: #2004874
Task: #29141
Change-Id: I7cc95935d6bdae43fab5dfbd544c8e6d65fcc38d
2019-02-14 12:56:20 +01:00
Iury Gregory Melo Ferreira
3e1a7b4642 Remove duplicated jobs and refactor jobs
This is a follow-up from I96a96a9d6f23f02f9f49c962f183e8c5ca78e048
Removing the duplicated jobs after we have the patches for other
repositories merged.

Also we have refactor the jobs so we can use ironic-base in other
repositories jobs to avoid unnecessary code duplication

Depends-On: https://review.openstack.org/#/c/629494/
Change-Id: Icd4a486f176c8d7dbd78426c39097c169f27c0ae
2019-02-11 12:53:04 +01:00
Dmitry Tantsur
15fafe686c Add a voting CI job running unit tests with driver-requirements
This seems to get broken quite often (RDO runs something similar).

Change-Id: I53fd5f86dfcee5b14318d4324c43d5f02b86702c
2019-02-06 19:14:53 +01:00
Derek Higgins
d6c9d6caed Replace use of Q_USE_PROVIDERNET_FOR_PUBLIC
This is being removed from devstack in
I23e1b98bd2839b79226b55700ee404a8fda83f83

Change-Id: I81b8cc348900837b876216065d7a2bf4a3665b8b
2019-01-18 13:26:03 +00:00
Iury Gregory Melo Ferreira
3ad700acae Remove dsvm from zuulv3 jobs
According to [1] the dsvm should be removed from zuulv3 jobs

[1] https://docs.openstack.org/infra/manual/drivers.html#naming-with-zuul-v3

Duplicate jobs to avoid break the gate in other projects like:
- ironic-tempest-plugin, ironic-inspector, nova, neutron, devstack

Change-Id: I96a96a9d6f23f02f9f49c962f183e8c5ca78e048
2019-01-10 10:49:50 +01:00
Derek Higgins
1effd562ed Switch to cirros 0.4.0
This supports ext4 partitions with metadata_csum(as created
by ubuntu bionic by default).

Also Using it with the e1000 virt driver cirros sees the nics.

This allows us to remove 2 of the special cases we had inserted
when the CI jobs were switched to bionic.

Change-Id: I68165110dd57ed314cbc29430f84ff5092065d38
Story: #2004604
Task: #28570
Task: #28499
2018-12-18 16:52:44 +00:00
Derek Higgins
71f0256b1d Disable metadata_csum when creating ext4 filesystems
Cirros can't mount a ephemeral partition if its enabled.

Change-Id: I7b56fcd0be1cd48a6b72a0c156d37b3f279a8da9
Story: #2004604
Task: #28499
2018-12-14 14:34:38 +00:00
Derek Higgins
053965c6db Switch the default NIC driver to e1000
The version if qemu-ipxe on bionic doesn't attempt
to network boot when using virtio-net.

Change-Id: I335a2a0a8a82bb43a06202f96e629aa72d10cfac
Story: #2004604
Task: #28498
2018-12-14 14:34:33 +00:00
Derek Higgins
c5a4ad8006 Switch CI back to xenial
Switch back from bionic to xenial while we sort
out the various priblems in CI

Change-Id: Ie7341654077273f0dd3a682449c3c61fcffee5c8
Story: #2004604
Task: #28497
2018-12-13 13:56:12 +00:00
Julia Kreger
2f991522e7 Change multinode jobs to default to local boot
When validations occur, we raise an exception internally
which can lead to confusing and misleading log messages
when whole disk images are utilized with the standing
default of network booting on neutron.

We've long discussed changing it, so why not start.

Change-Id: I68bb1b9bf8c14ba686eb1c9d2755badf84481f91
2018-12-05 10:21:38 -08:00
Zuul
6fe3b66796 Merge "Extend job build timeout" 2018-12-04 17:41:58 +00:00
Zuul
83f7edf485 Merge "Mark several tests to not test cleaning" 2018-12-04 13:20:38 +00:00
Zuul
080ee978c8 Merge "Switch ironic-tempest-...-tinyipa-multinode to zuulv3" 2018-11-29 22:36:30 +00:00
Julia Kreger
a90bdb1c96 Extend job build timeout
On slower nodes, sometimes Ironic can take up to ten
minutes for the deployment to complete. The downside is
that the tempest build timout is set to ten minutes.

In order to reduce the number of erronious failures
and rechecks, extending the timer to 12 minutes which
should provide enough time for the deployment to complete
to tempest's satistfaction.

Change-Id: Ie883d641d0951cb148e8cfb812b9607fa77ddb4b
2018-11-29 18:21:33 +00:00
Julia Kreger
eace34ab49 Mark several tests to not test cleaning
We don't need to test cleaning with some of the integration tests
where ultimately we are only testing a slightly different scenario
with an unrelated code path.

Change-Id: Ic7825a12763c07956e812fe509c455989868590d
2018-11-29 10:11:32 -08:00
Derek Higgins
c67b46e350 Switch ironic-tempest-...-tinyipa-multinode to zuulv3
And rename to ironic-tempest-dsvm-ipa-wholedisk-direct-tinyipa-multinode

Change-Id: I6ab7bfa0343e0c8df5814d26e62864f3c66cf7b1
2018-11-19 16:30:45 +00:00
Dmitry Tantsur
440f53fa3f Add a non-voting bifrost job to ironic
We already broke openstacksdk CI with our changes once, and now we
broke it again with an ironic-inspector change. Let us add a job
to add coverage for bifrost and openstacksdk code paths.

Start non-voting since our CI is already a bit unstable.

Change-Id: I1277b52067efbfcc4119b60678f356397a82166c
Depends-On: https://review.openstack.org/618726
2018-11-19 11:59:49 +01:00
Derek Higgins
6389ad2829 Increase RAM for the ironic node in UEFI job
This now appears to need more then the bios jobs. A recent
update to one of the components of the tiny IPA image appears
to have increased the requirements.

Change-Id: Ia38ab45d0b1d7f7c57a2be71cf290de02ab86e6f
Story: 2004355
Task: 27954
2018-11-15 22:17:53 +00:00
Julia Kreger
84b94ee2d1 Change BFV job to use ipxe interface
As Nova's CI jobs can call the ironic-tempest-dsvm-bfv job,
it seemed to only make sense to keep that job name and have it
leverage the ipxe boot interface instead.

The newer named job, ironic-tempest-dsvm-ipxe-bfv only exists
in the ironic repository according to codesearch.openstack.org.

This removes one un-necessary check in the ironic check gate.

Change-Id: I55bd2e7e5fa5d10ca6ed3093ebabf7dc3be07fb9
2018-10-31 07:51:00 -07:00