1)Adding 'image_is_advanced' option to tempest config, so you can
run specific tests with images that are not cirros.
2)Adding decorator to run 'subport_connectivity' test with such
image for VLAN aware VM feature.
3)Configuring gate to run trunk test with ubuntu image only
4) Updating release notes and TESTING.rst with the change
Change-Id: Ie15b0e79c6ea320322b2815fb8afbc8ec95f853a
* Update the URLs affected by the doc-migration
(/developer/<project>/ to <project>/latest/)
* Follow content rearrangement
* Convert links to local documents into :doc: or :ref:
* Use https instead of http for the updated links on docs.openstack.org.
Part of the doc-migration work.
Change-Id: I62e317d9198f175a43d73bbfd419b6878de90d5a
Leading spaces before item lists leads to vertical line
on the left side. They are completely unnecessary.
Change-Id: I08c3f077e470aa593076a525de1445bc5d0bdb9a
openstackdocstheme generates the toc tree in the left sidebar
based on the page hierarchy from the top page.
The previous developer guide hirarchy is a bit deep, and
this commit reorganizes the devref pages for better navigation
with openstackdocstheme.
Change-Id: I1412b047efc1c268b34ef97e78073da7bcbb6d7e
Removed one orphan reference of unclear value (pudb), and moved another
one into the text itself. This allows to pass gate with new sphinx.
Change-Id: I943d9b0904731ebcc4d3fd3a9b686fd08b03c48b
Closes-Bug: #1694614
As some tests require extensions to be enabled on the server, this patch
introduces a new class attribute to the API base class. If any extension
defined in test class is not enabled on the server, then all tests in
the test class will be skipped.
Change-Id: I0629153f973daeb3bef3a6968360cbc2d427f9ad
Since we switched to use Ubuntu Cloud Archives in upstream gate, the
note in TESTING.rst is not longer valid for the gate. The condition to
trigger the test still remains in order to avoid false negative test
results for those that run functional tests with older openvswitch
version.
Change-Id: Ibff983efe0f452864d003913205cbbfa39ee7374
We used to compile from source for functional and fullstack jobs. For
functional job we skip single test and avoid compiling. We still do
compile from source for fullstack job. This patch adds justification to
TESTING.rst document.
Change-Id: I60c272bba6fa9eeefa29dfa4faa69433989efde2
Ic68858aaf1a519085dff394e6edc8c8fe6aeee6a forgot to move these
sections one level up. Without this, tox -edocs barfs.
Change-Id: I649ba20013ccbe25023b2c8c3a2014fb7be47d97
This allows us to configure neutron when running the rally job in
the gate. This effort stems from patch [1]. Blame Kevin for not
wanting to squash the two together.
[1] I12aaf6121b677e9696131601b3539a7091e2858c
Change-Id: I006957784ac7900021bcfee57cbc83b5a6c533c4
We support tox for testing.
We don't maintain anything else.
In the Pike release we will remove the script.
Change-Id: Ic68858aaf1a519085dff394e6edc8c8fe6aeee6a
neutron-sanity-check tool was importing neutron.tests.base module, which
may be not present on some systems (f.e. RDO splits neutron/tests/
subtree in a separate python-neutron-tests package). It made the tool
not usable in some setups.
https://bugzilla.redhat.com/show_bug.cgi?id=1374282
This is not the first time when we by mistake import from
neutron.tests.* and break distributions. It's time to stop it by
proactively forbidding that pattern via a new hacking check.
Some functions were moved from neutron.tests.base to
neutron.common.utils to fulfill the need requirement. They were moved
using debtcollector, no current consumers should be affected.
Closes-Bug: #1621782
Change-Id: I790777ddcbd1b02218b3db54ae3d5c931d72d4fa
This is helpful when you want to inspect the database when sitting at
a break-point in a unit test.
Change-Id: Id4e25ef980437fe160822c3598135aa220127ac8
A Basic scenario:
- Creates an internal network and a subnet
- Creating a key pair
- Creating a router, setting the gateway and adding an
internal interface
- Lauching an instance with a Nic connected to the internal network
- Adding rules to the tenant's default security group to allow SSH
and ICMP
- Creating and associating a Floaing IP to the instance
- Checking SSH connectivity to the instance Floating IP address
Change-Id: Ica6fef4763b6f98c7795629b99ab392e6f7b6e59
Co-Authored-By: John Schwarz <jschwarz@redhat.com>
Log files as .txt files, don't zip them, and put them where
they need to be instead of copy them there in the post gate
hook. The benefit to doing this is that we'll get logs
for tests even if the job timed out.
Change-Id: I4bfd27534c827aed3cbd7b43d7d1289480ea4806
Related-Bug: #1567668
Since adoption of the Tempest plugin framework, this
extra plumbing is no longer necessary in tree.
Related-bug: 1555356
Depends-on: If5f7ea82c45494953452f728fabb7403d0b6e14e
Change-Id: I5377f33c5a7b29f97f00878e048d154378a4fe34
Make use of the Tempest plugin interface instead of copying Neutron
files into Tempest. This will remove the burden to port Neutron
tests onto Tempest master recurrently.
It uses neutron/tests/tempest/ as new top folder for all Tempest
tests. It follows the model of Heat [1].
[1]: https://github.com/openstack/heat/tree/master/heat_integrationtests
Partially implements bp external-plugin-interface
Change-Id: Ia233aa162746845f6ae08a8157dcd242dcd58eab
Note in TESTING.rst that fullstack tests that depend on changes to
python-neutronclient to execute need to wait until there is a released
version of python-neutronclient before they will work in the gate.
Change-Id: I1d32c65f0c941cf8f163a441258faa34b50ff88f
We currently don't log everything being output from the test
runner, only what the processes themselves are logging.
Change-Id: Id5fb9cd44a0ed677a03da1d153ee3079fd5b7975
Deleted tests that duplicate tests from Tempest, according to the
new criteria specified in TESTING.rst.
Follow up steps are detailed here:
https://etherpad.openstack.org/p/neutron-tempest-defork
For reviewers, here's how to get a complete list of network
tests from Tempest. From a Tempest directory, execute:
testr list-tests tempest.api.network | cut -d"[" -f1 | cut -d"." -f4-
I verified that every test removed here actually exists in that list.
Here's a list of patches that modified tests after the fork:
https://etherpad.openstack.org/p/neutron-tempest-defork-patches-since-initial-sync
And the list of tests we care about:
https://etherpad.openstack.org/p/neutron-tempest-defork, Ctrl-F for:
'Tests that should be synced from Neutron'
Related-bug: #1552960
Change-Id: I685291058f221a7ef0b5b7485280cdabceaa4af3
This patch adds resources, fixtures and base test_connectivity tests
for host with linuxbridge agent.
Model of host with linuxbridge agent is made in separate namespace
named "host-XXX". It has got connectivity with rabbit via ovs port.
Same port is used also to provide connectivity with different "hosts"
Co-Authored-By: Mathieu Rohon <mathieu.rohon@gmail.com>
Change-Id: I6230d8d09f77bd20674bf6c3be69fbc1627d66f8
Closes-bug: #1518675
The patch takes OVS with conntrack support, compiles it and loads its
kernel modules. The patch steals parts from networking-ovn
project [1]. To run compilation of OVS, an environment variable
COMPILE_OVS must be set to True. Optional environment variables
OVS_REPO and OVS_BRANCH can be defined as a source of bits.
Once Neutron starts using neutron-lib, next steps will be taking
content of devstack/lib/ovs and putting it into neutron-lib project
in order to let other projects like networking-ovn to re-use the
code.
[1] https://github.com/openstack/networking-ovn/blob/master/devstack/plugin.sh#L175
Change-Id: Id2f51853a6339da72dbde7a82f94f99a4c306565
* Added motivation paragraph
* Added definitions and an explanation about the scope of the
test vs. the test infrastructure it uses
* Added content and examples to unit & functional tests sections
Change-Id: If78bd01d0fd7d899d4e6fbcdc8a33c441d2a1609
* Removed long term goals documentation (I don't see a need
to document these).
* Added and rearranged short term goals.
Change-Id: If494533cb6507f18b84a41b3f1daf42cd10d9f51
The lack of convention for heading levels among the independently
written devref documents was starting to make the Table of Contents
look rather messy when rendered in HTML.
This patch does not cover the "Neutron Internals" section since its
layout is reasonably OK for now.
Change-Id: I827c105599f05773bda7e4fc0a941ce04ebd51fa
Currently, it's up to the developer who wants to run full-stack on his
machine to make the directory in question (/opt/stack/logs). However,
this also means that the files don't get compressed at the end of a gate
run. Now, each full-stack test will have each own log directory in /tmp.
Once the logs are there, post_test_hook.sh can run 'gzip' on all the log
files before moving them to /opt/stack/logs on its own.
Change-Id: I5c04d0af0b9858722ae0c4baf0ee478ffb078e02
There were a few errors that went undetected.
TESTING.rst:266: SEVERE: Title level inconsistent:
TESTING.rst:67: ERROR: Unknown target name: "test".
TESTING.rst:74: ERROR: Unknown target name: "test".
Change-Id: Iad225e95c23b7460d228ba5447f4a361aa68d5dc
Add detail about api testing and provide better visual separation
between the different types of testing.
The current testing guidelines are mainly about running tests, and
this change does little to fix that. The intention is to add detail
about writing tests in subsequent changes.
Change-Id: I39d0439c91e5c6edb1d48d4da310443c99fb6d9e
This change ensures that the structure of the unit test tree matches
that of the code tree to make it obvious where to find tests for a
given module. A check is added to the pep8 job to protect against
regressions.
The plugin test paths are relocated to neutron/tests/unit/plugins
but are otherwise ignored for now.
Change-Id: If307593259139171be21a71c58e3a34bf148cc7f
Partial-Bug: #1440834
This patch introduces the full-stack tests framework, as specified in
the blueprint. In short, this adds the neutron.tests.fullstack module,
which supports test-managed neutron daemons. Currently only
neutron-server is supported and follow-up patches will support for
multiple agents.
Implements: blueprint integration-tests
Co-Authored-By: Maru Newby <marun@redhat.com>
Change-Id: Iff24fc7cd428488e918c5f06bc7f923095760b07