71 Commits

Author SHA1 Message Date
Jenkins
921c508027 Merge "Enable/disable ironic in tempest config" 2013-11-21 21:08:30 +00:00
Clark Boylan
3b80bde8c7 Check if flavors exist before creating them.
* lib/tempest: When creating the m1.tiny and m1.nano flavors ensure that
they don't exist first. This is important for Grenade where code may be
run multiple times and should expect that some things preexist.

Change-Id: I1772d4334f39d612f8a187eb5311a1b2caee3953
2013-11-20 17:51:50 -08:00
Roman Prykhodchenko
d005959552 Enable/disable ironic in tempest config
In order to run tempest tests for Ironic in devstack
the availability of the Ironic service must be set in
the tempest config.

This patch adds a shortcut for Ironic services and sets
availability of Ironic in tempest config.

Change-Id: I206fc2ea13412ceb128f8bfe90c153348d6f2f3e
2013-11-14 09:58:53 +02:00
Jenkins
7751354b44 Merge "Decrease tempest BUILD_TIMEOUT" 2013-10-31 19:02:02 +00:00
Jenkins
b7c11a0f98 Merge "Fix some Markdown formatting issues" 2013-10-31 14:19:15 +00:00
Adam Spiers
6a5aa7c6a2 Fix some Markdown formatting issues
Address miscellaneous issues with Markdown formatting in comments which
are consumed by shocco when generating the online documentation.

Change-Id: I953075cdbddbf1f119c6c7e35f039e2e54b79078
2013-10-24 17:38:19 +01:00
Mehdi Abaakouk
6730a9d1c6 Handle the CM service availability in tempest
This patch handle the ceilometer service availability in tempest.

Change-Id: Ib0d1d7b858ff327785ebbcc27d7f920fb4a32444
2013-10-24 17:32:20 +02:00
Sean Dague
101b424842 fix whitespace in the rest of lib/*
this brings this in line with bash8 checker

Change-Id: Ib34a2292dd5bc259069457461041ec9cd4fd2957
2013-10-22 13:02:23 -04:00
Attila Fazekas
8111ef0aa5 Decrease tempest BUILD_TIMEOUT
The BUILD_TIMEOUT is the generally used timeout option in tempest.

Almost never expected to any operation takes more than 60 sec,
the 400 sec is too match for timeout.
Changing the BUILD_TIMEOUT to 196 sec, it is still expected to be safe.

It can make faster the failing test jobs.

Change-Id: I7e7c767400ca448cb86d27b60a1229a2afa69726
2013-10-18 16:26:04 +02:00
DennyZhang
48e1bab542 Fix false negative, when HEAT_CREATE_TEST_IMAGE is unset
Fix shell variable comparision bug
Closes-Bug: #1239041

Change-Id: Ifbc8545f929eb7bbf9b85df889dfd9fa3a96b7c0
2013-10-14 20:56:41 -05:00
Sean Dague
1c1aef0eb7 Revert "Enable tenant isolation to tempest for neutron"
This reverts commit 3d84cf2d7c323750971cf2d27f3a4eaa26cb7a9f.

This is believed to be the cause for the massive increase in
neutron failures in the gate reseting other projects. Realize
this is just a work around.

Change-Id: Id3c59f3fe9ccbb869eb3200ef7ff2659409e2253
Partial-Bug: 1224001
2013-10-01 07:58:16 -04:00
Matthew Treinish
3d84cf2d7c Enable tenant isolation to tempest for neutron
This commit re-enables tenant isolation in tempest for neutron. This
is a requirement for running tempest in parallel. This commit depends
on tempest change I7587c85017cca09f7a67eae0670f67b2bceacb60

Fixes bug 1216076

Change-Id: I63a30bacd48cecd110fb90e1fc718249c2b1904b
2013-09-26 15:39:16 +00:00
Attila Fazekas
8f5bf93d06 lib/tempest remove whitebox section
tempest whitebox tests are removed from the tempest repo, so it's
configuration is unnecessary.

Change-Id: I6659e2af894014518a486f411ca06179d43bbb8b
2013-09-16 01:40:13 +02:00
Giulio Fidente
3632ab1b66 enable volume backup tests if c-bak is enabled
this will set to True the tempest volume/volume_backup_enabled
option if c-bak is in ENABLED_SERVICES

Change-Id: I69931d668411fc8144d0fdb2f58ad9b6e987f793
2013-09-10 02:51:26 +02:00
Joe Gordon
bb8c6d42a4 add TEMPEST_LARGE_OPS_NUMBER to option
The tempest scenario.large_ops test tries to catch any performance issues
when running large numbers of operations at once, in this case launching
instances.

Set to 0 by default, to maintain the current default, but add this as an
option so this can be set via devstacks localrc.

Part of regression test for bug 1199433

Change-Id: I459717b849f9b6d180a7956c0ff470cefe7c1ff6
2013-08-26 19:45:00 -04:00
Jenkins
27899ccc1f Merge "Generate heat images for tempest tests" 2013-08-13 20:48:48 +00:00
Steve Baker
d5cccad2f0 Generate heat images for tempest tests
This requires HEAT_CREATE_TEST_IMAGE to be set for any images
to be created.

If the file (files/fedora-vm-heat-cfntools-tempest.qcow2) already
exists then disk-image-create will not be called, and the existing
image file will be registered with glance. This is most likely to
happen in the following scenarios:
- a second run of stack.sh
- the image has been pre-built elsewhere (such as during devstack-gate
  image building)
Change-Id: I276573a20927e72f2cb68784f655c1ba1913ae8a
2013-08-12 09:10:25 +12:00
Matthew Treinish
385152cd89 Enable debug logging on tempest
With tempest moving to testr (serially currently) the log level is no
longer defaulting to debug as it did with nose. To get the same level
of verbosity in the logging as when running with nose this commit
sets the debug flag on tempest.

Change-Id: I6acd57be0f8188d31825d88471ba9883ebb30519
2013-08-09 11:13:28 -04:00
Matthew Treinish
4ee4a0182e Fix tempest logging configuration
This commit will correctly set the tempest output logging to dump
all of tempest logs into a tempest.log file in
$DEST/tempest/tempest.log. This will also fix the logging for
tempest in the gate so it will no longer print every log message on
the console.

Fixes bug 1207066

Change-Id: I91f2ee781c4a7a18c561ea3e3b26832b97431464
2013-07-31 17:06:19 -04:00
Jenkins
f829e46bd0 Merge "Set tempest lock_path to default in $DATA_DIR" 2013-07-29 22:49:52 +00:00
Jenkins
0cbaa41214 Merge "Configure horizon and horizon URLs in Tempest" 2013-07-29 21:54:52 +00:00
Matthew Treinish
14ccba0e40 Set tempest lock_path to default in $DATA_DIR
Change I464edf9e11710e1931ed4f7b0262328a57e5b3de set the tempest
lock_path to be $TMPDIR, however when run in the gate this is an
empty string which results in all tests that use locking failing.
This commit corrects that by setting the lock_path config variable
to use $TEMPEST_STATE_PATH which defaults to $DATA_DIR/tempest.

Change-Id: I02fbd50ca68d6daafb5b4c23579473eb703ae72a
2013-07-29 16:15:53 -04:00
Jenkins
fa7ac3f9b0 Merge "Set lock_path for Tempest to TMPDIR" 2013-07-29 14:40:34 +00:00
Julie Pichon
fea70f80c0 Configure horizon and horizon URLs in Tempest
Tempest now supports testing the dashboard. Adjust the configuration
accordingly.

Change-Id: Ifb5619caab8bd6080c5df4ed43e16c921e7f9b1f
2013-07-29 11:52:20 +01:00
Matthew Treinish
859cc6800b Set lock_path for Tempest to TMPDIR
Tempest change I5376f977a110f502f0e4958cbccbd379539e006b syncs
lockutils from oslo. Tempest with testr needs to use external locks
which require a lock_path config option. This commit sets that option
for tempest to use devstack's TMPDIR.

Change-Id: I464edf9e11710e1931ed4f7b0262328a57e5b3de
2013-07-26 15:26:59 -04:00
Matthew Treinish
b56d81d595 Set service_available config options in tempest
This commit loops over the list of services that tempest has config
options for in the service_available group and checks if the service
is enabled. Devstack will then set whether or not the service is
configured in tempest.conf.

Change-Id: Ib845d3e098fd3f45c8c26f5696af14cca1534e01
2013-07-24 10:03:45 -04:00
Matthew Treinish
c373cf8b89 Update neutron_available config option.
Tempest change I5ee9ec816845de483fe88d76d1bb047e7bb1af7e changed
the behavior of the neutron_available config option. This commit
updates devstack to use it's new name and group.

Change-Id: I7d5074209fe81f6100f380512d7702fbc8e252ac
2013-07-22 20:57:57 -04:00
Jenkins
6094cdd56d Merge "Set the scenario/img_dir option for tempest.conf" 2013-07-08 23:10:56 +00:00
Mark McClain
b05c876994 update for name change to Neutron
Note: Nova and Horizon are not updated until those projects have
migrated.

Change-Id: I256ef20e7caadd9c96e6dd908c5d8b69ca5c4aeb
2013-07-07 00:15:11 -04:00
William Marshall
24d866ef45 Set the scenario/img_dir option for tempest.conf
The default value does not work unless devstack is installed in
/opt/stack/new/devstack. This patch changes the img_dir option to point
to the correct install location.

Change-Id: Iea41d209dad10b2f9a7c97efd55c39a8d29347cc
2013-07-02 12:26:31 -05:00
Jenkins
16bfac4e76 Merge "Fix spelling mistakes" 2013-07-02 14:19:30 +00:00
Joe Gordon
4640026cc1 Fix spelling mistakes
git ls-files | misspellings -f -
Source: https://github.com/lyda/misspell-check

Change-Id: I7d63578734ca5cc1ec865a7d024c1a013d1ada87
2013-06-30 04:32:27 -07:00
Ian Wienand
7fa1902f9b Add cli_dir to tempest config
Add the cli_dir option to the generated tempest config.  This is
required on platforms such as RHEL where the binaries are not in the
standard location.

Note that to be fully operational this requires [1] in tempest so that
the cli path is created correctly.

[1] https://review.openstack.org/#/c/34302/

Change-Id: Ic7369193f1434974366cfabc7550e8545de244cd
2013-06-25 14:11:48 +10:00
Ian Wienand
c42ed258b4 Fix syntax error in lib/tempest
Fix syntax error in lib/tempest:
 Created tempest configuration file:
 21:06:30 ++ CINDER_MULTI_LVM_BACKEND=False
 21:06:30 ++ '[' False == 'True ]'
 21:06:30 /home/stack/devstack/lib/tempest: line 278: [: missing `]'

Change-Id: Ib4e393dad12751bdfb0e6f8fac3accd380a1f760
2013-06-17 13:23:44 +10:00
Jenkins
f756470f0d Merge "Ensure flavor_ref_alt is different from flavor_ref" 2013-06-14 16:15:06 +00:00
Sean Dague
c377145632 allow overwriting of http_image in tempest.conf
the default http_image variable is an upstream cirros url in
tempest. However, in the gate this can cause flakey failures if
that has connection issues.

Ensure that we can override this from devstack-gate to be
something we are sure is going to work.

Partial fix for bug #1190623

Change-Id: Ie06fc231725c235f5ee8fd17fc87d3305bc845a3
2013-06-13 14:44:53 -04:00
Giulio Fidente
97e1bd0323 Enables the multibackend Cinder tests in tempest when useful.
The change adds in lib/tempest an optional dependency on the var
$CINDER_MULTI_LVM_BACKEND which, if set, enables the multibackend
tests in the tempest config.

Change-Id: Iccafd00f5adabbbc2309fa72664bf29440744d91
2013-06-12 10:12:26 +02:00
Attila Fazekas
bae0233cf9 Decrease the tempest build interval
Decreasing the build interval leads to faster state change detection,
so it will speed up the gating jobs.

It may increase the possibility of a "hidden" issues causes
indeterministic test results.

Change-Id: Ida5e7296e4ea53d761e0efef34376699337d8377
2013-06-08 15:57:48 +02:00
Adalberto Medeiros
63a71a2316 Ensure flavor_ref_alt is different from flavor_ref
For tempest, server resize tests needs different values
for flavors to pass. Ensure different values in tempest.conf
for flavor_ref_alt and flavor_ref.

Change-Id: I2f8ee92967abc767637e334ae483b540dd7d5b78
Fix: bug 1187768
2013-06-06 09:00:20 -04:00
Steve Baker
26824b0546 Run heat tempest tests if heat is enabled in devstack.
Change-Id: I6a5d1bae99982a8f0201885abd1203e1a8d78dcc
2013-06-04 13:19:02 +12:00
Dean Troyer
cc6b443545 Formatting cleanups, doc updates and whatnot
Change-Id: Ica8298353be22f947c8e8a03d8dc29ded9cb26dd
2013-04-09 14:05:32 -05:00
Sean Dague
584d90ec56 add emacs shell-script tagging
for files that don't start with a #! or end in .sh, the added tags
are nice for emacs users to automatically switch to the right mode.

Change-Id: If4b93e106191bc744ccad8420cef20e751cdf902
2013-03-29 14:36:49 -04:00
Mark McLoughlin
7ddbea25c4 Don't directly pip install tempest pip-requires
This code:

    # Tempest doesn't satisfy its dependencies on its own, so
    # install them here instead.
    pip_install -r $TEMPEST_DIR/tools/pip-requires

causes us to do:

    Found existing installation: oslo.config 1.1.0
     Uninstalling oslo.config:

so rather than 1.1.0 installed, we end up with 1.1.0b1 and everything
goes kabloomy.

It looks like this comment came from a time (commit 9a352daf) before
tempest included proper install_requires (tempest commit 5abb253c3).

It should be safe to delete this and allow setup_develop() do all the
work just like the other projects.

Change-Id: I869f727900bb08c72e5e8f4e84858a9c77049715
2013-03-13 06:57:19 +00:00
Sean Dague
4a20f9a175 add quantum_available flag to tempest
this ensures that if we setup quantum, we are explicit about it
in tempest. This is important so that nova tests which require
quantum features have any idea if they should function.

Change-Id: I5e6be9ff325676f25b2c391430dd66ff64a7a833
2013-03-01 07:23:38 -05:00
Jenkins
d5c0b66206 Merge "replace use of cirros 0.3.0 with 0.3.1" 2013-02-22 12:22:23 +00:00
Scott Moser
cde655acb0 replace use of cirros 0.3.0 with 0.3.1
cirros 0.3.1 images have several significant improvements over 0.3.0, including:
 * newer kernel (3.2.0-25.40)
 * support for more filesystems (vfat, iso9660)
 * support for configdrive (config-drive-v2) as a datasource
 * acpi reboot/shutdown
 * curl with https support (previously there was no way to get https urls)

Change-Id: Idd7bef0cebb941f77d1cead9dc990fa0b03ff46b
2013-02-20 12:33:39 -05:00
Andrea Frittoli
2bccb8604e Remove ssh tests diabling as #1074039 is fixed
Removed the setting completely so that this is
left under control of tempest.conf.sample

Fixes LP# 1130750
Change-Id: I710f1c111e66834f4bc7020cad82c04bf495441c
2013-02-20 16:45:57 +00:00
Attila Fazekas
25c42f6eb4 Remove old tempest configuration variables
Change-Id: I4c15c876514e1a8071a557ce79f56266a83b24b8
2013-02-14 15:00:02 +01:00
Sean Dague
a52095b18c allow resize tests to run
resize tests were turned off explicitly, which they shouldn't be
turn these back on in a default config as we've set nova to allow
resize_to_same_host.

Change-Id: Iacedf11e56aff3a541f1b67b208e8ed3a30b2c44
2013-02-09 07:24:33 -05:00
Jenkins
6c678fe328 Merge "Renames old $devstack_dir to $TOP_DIR" 2013-01-30 01:14:17 +00:00