openstack/neutron
Code Issues Proposed changes

Merge "Add tempest job which will run on the oldest Ubuntu release"

Browse Source
This commit is contained in:
Zuul 2022-11-23 04:44:31 +00:00 committed by Gerrit Code Review
commit 77fc7cd285
3 changed files with 110 additions and 97 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

197
doc/source/contributor/testing/ci_scenario_jobs.rst
View File

@ -34,58 +34,61 @@ Each of those jobs runs on slightly different configuration of Neutron services.
Below is a summary of those jobs. Below is a summary of those jobs.
:: ::
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
| Job name | Run tests | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate | | Job name | Run tests | nodes | Operating system | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | | | driver | mode | | | | queue | | | | | | driver | mode | | | | | queue |
+==============================================+==================================+=======+=============+=================+==========+=======+========+============+=============+ +==============================================+==================================+=======+==================+==============+================+==========+=======+========+============+=============+
|neutron-tempest-plugin-designate-scenario |neutron_tempest_plugin.scenario.\ | 1 | openvswitch | openvswitch | legacy | False | False | True | No | |neutron-tempest-plugin-designate-scenario |neutron_tempest_plugin.scenario.\ | 1 | Ubuntu Jammy | openvswitch | openvswitch | legacy | False | False | True | No |
| |test_dns_integration | | | | | | | | | | |test_dns_integration | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-linuxbridge |neutron_tempest_plugin.api | 1 | linuxbridge | iptables | ha | False | False | False | Yes | |neutron-tempest-plugin-linuxbridge |neutron_tempest_plugin.api | 1 | Ubuntu Jammy | linuxbridge | iptables | ha | False | False | False | Yes |
| |neutron_tempest_plugin.scenario | | | | | | | | | | |neutron_tempest_plugin.scenario | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | | | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | | | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-openvswitch |neutron_tempest_plugin.api | 1 | openvswitch | openvswitch | ha | False | False | False | Yes | |neutron-tempest-plugin-openvswitch |neutron_tempest_plugin.api | 1 | Ubuntu Jammy | openvswitch | openvswitch | ha | False | False | False | Yes |
| |neutron_tempest_plugin.scenario | | | | | | | | | | |neutron_tempest_plugin.scenario | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | | | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | | | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-openvswitch-\ |neutron_tempest_plugin.api | 1 | openvswitch | iptables_hybrid | ha | False | False | False | Yes | |neutron-tempest-plugin-openvswitch-\ |neutron_tempest_plugin.api | 1 | Ubuntu Jammy | openvswitch | iptables_hybrid | ha | False | False | False | Yes |
| iptables_hybrid |neutron_tempest_plugin.scenario | | | | | | | | | | iptables_hybrid |neutron_tempest_plugin.scenario | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | | | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | | | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-plugin-scenario-ovn | neutron_tempest_plugin.scenario | 1 | ovn | ovn | --- | False | False | False | Yes | |neutron-tempest-plugin-scenario-ovn | neutron_tempest_plugin.scenario | 1 | Ubuntu Jammy | ovn | ovn | --- | False | False | False | Yes |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_attach_interfaces | | | | | | | | | | | test_attach_interfaces | | | | | | | | | |
| |tempest.api.compute.servers.\ | | | | | | | | | | |tempest.api.compute.servers.\ | | | | | | | | | |
| | test_multiple_create | | | | | | | | | | | test_multiple_create | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovs-tempest-multinode-full |tempest.api (without slow tests) | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes | |neutron-ovs-tempest-multinode-full |tempest.api (without slow tests) | 2 | Ubuntu Jammy | openvswitch | openvswitch | legacy | False | False | True | Yes |
| |tempest.scenario | | | | | | | | | | |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | | |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | | |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovs-tempest-dvr-ha-multinode-full |tempest.api (without slow tests) | 3 | openvswitch | openvswitch | dvr | True | True | True | No | |neutron-ovs-tempest-dvr-ha-multinode-full |tempest.api (without slow tests) | 3 | Ubuntu Jammy | openvswitch | openvswitch | dvr | True | True | True | No |
|(non-voting) |tempest.scenario | | | | dvr_snat | | | | | |(non-voting) |tempest.scenario | | | | | dvr_snat | | | | |
| | | | | | dvr_snat | | | | | | | | | | | | dvr_snat | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovs-tempest-slow |tempest slow tests | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes | |neutron-ovs-tempest-slow |tempest slow tests | 2 | Ubuntu Jammy | openvswitch | openvswitch | legacy | False | False | True | Yes |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|tempest-integrated-networking |tempest.api (without slow tests) | 1 | ovn | ovn | --- | False | False | True | Yes | |tempest-integrated-networking |tempest.api (without slow tests) | 1 | Ubuntu Jammy | ovn | ovn | --- | False | False | True | Yes |
| |tempest.scenario | | | | | | | | | | |tempest.scenario | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ipv6-only-ovs-release |tempest.api (without slow tests) | 1 | ovn | ovn | --- | False | False | True | Yes | |neutron-ovn-tempest-ovs-release-ubuntu-old |tempest.api (without slow tests) | 1 | Ubuntu Focal | ovn | ovn | --- | False | False | True | Yes |
| |(only tests related to | | | | | | | | | | |tempest.scenario | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ |neutron-ovn-tempest-ipv6-only-ovs-release |tempest.api (without slow tests) | 1 | Ubuntu Jammy | ovn | ovn | --- | False | False | True | Yes |
| |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
Grenade jobs running in Neutron CI Grenade jobs running in Neutron CI
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@ -95,15 +98,15 @@ Each of those jobs runs on slightly different configuration of Neutron services.
Below is summary of those jobs. Below is summary of those jobs.
:: ::
+------------------------------------+-------+-------------+-------------+----------+-------+--------+------------+-------------+ +------------------------------------+-------+------------------+-------------+-------------+----------+-------+--------+------------+-------------+
| Job name | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate | | Job name | nodes | Operating system | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | | driver | mode | | | | queue | | | | | | driver | mode | | | | queue |
+====================================+=======+=============+=============+==========+=======+========+============+=============+ +====================================+=======+==================+=============+=============+==========+=======+========+============+=============+
| neutron-ovs-grenade-multinode | 2 | openvswitch | openvswitch | legacy | False | False | True | Yes | | neutron-ovs-grenade-multinode | 2 | Ubuntu Jammy | openvswitch | openvswitch | legacy | False | False | True | Yes |
+------------------------------------+-------+-------------+-------------+----------+-------+--------+------------+-------------+ +------------------------------------+-------+------------------+-------------+-------------+----------+-------+--------+------------+-------------+
| neutron-ovs-grenade-dvr-multinode | 2 | openvswitch | openvswitch | dvr | False | False | True | Yes | | neutron-ovs-grenade-dvr-multinode | 2 | Ubuntu Jammy | openvswitch | openvswitch | dvr | False | False | True | Yes |
| | | | | dvr_snat | | | | | | | | | | | dvr_snat | | | | |
+------------------------------------+-------+-------------+-------------+----------+-------+--------+------------+-------------+ +------------------------------------+-------+------------------+-------------+-------------+----------+-------+--------+------------+-------------+
Tempest jobs running in Neutron experimental CI Tempest jobs running in Neutron experimental CI
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@ -116,46 +119,46 @@ the patch in Gerrit.
Currently we have in that queue jobs like listed below. Currently we have in that queue jobs like listed below.
:: ::
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
| Job name | Run tests | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate | | Job name | Run tests | nodes | Operating system | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | | | driver | mode | | | | queue | | | | | | | driver | mode | | | | queue |
+==============================================+==================================+=======+=============+=================+==========+=======+========+============+=============+ +==============================================+==================================+=======+==================+=============+=================+==========+=======+========+============+=============+
|neutron-ovn-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 1 | ovn | ovn | --- | --- | --- | --- | No | |neutron-ovn-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 1 | Ubuntu Jammy | ovn | ovn | --- | --- | --- | --- | No |
|(non-voting) |tempest.scenario | | | | | | | | | |(non-voting) |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | | |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | | |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-full-multinode-ovs-master |Various tempest api, scenario | 2 | ovn | ovn | --- | --- | --- | --- | No | |neutron-ovn-tempest-full-multinode-ovs-master |Various tempest api, scenario | 2 | Ubuntu Jammy | ovn | ovn | --- | --- | --- | --- | No |
| |and neutron_tempest_plugi tests | | | | | | | | | | |and neutron_tempest_plugi tests | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ovs-master |Various tempest api, scenario | 1 | ovn | ovn | --- | --- | --- | --- | No | |neutron-ovn-tempest-ovs-master |Various tempest api, scenario | 1 | Ubuntu Jammy | ovn | ovn | --- | --- | --- | --- | No |
| |and neutron_tempest_plugi tests | | | | | | | | | | |and neutron_tempest_plugi tests | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-with-neutron-lib-master |tempest.api (without slow tests) | 1 | openvswitch | openvswitch | legacy | False | False | True | No | |neutron-ovn-tempest-with-neutron-lib-master |tempest.api (without slow tests) | 1 | Ubuntu Jammy | openvswitch | openvswitch | legacy | False | False | True | No |
| |tempest.scenario | | | | | | | | | | |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | | |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | | |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 1 | openvswitch | openvswitch | legacy | False | False | True | No | |neutron-tempest-with-uwsgi-loki |tempest.api (without slow tests) | 1 | Ubuntu Jammy | openvswitch | openvswitch | legacy | False | False | True | No |
|(non-voting) |tempest.scenario | | | | | | | | | |(non-voting) |tempest.scenario | | | | | | | | | |
| |(only tests related to | | | | | | | | | | |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | | |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
|neutron-ovn-tempest-ipv6-only-ovs-master |tempest.api (without slow tests) | 1 | ovn | ovn | --- | False | False | True | Yes | |neutron-ovn-tempest-ipv6-only-ovs-master |tempest.api (without slow tests) | 1 | Ubuntu Jammy | ovn | ovn | --- | False | False | True | Yes |
| |(only tests related to | | | | | | | | | | |(only tests related to | | | | | | | | | |
| |Neutron and Nova) | | | | | | | | | | |Neutron and Nova) | | | | | | | | | |
+----------------------------------------------+----------------------------------+-------+-------------+-----------------+----------+-------+--------+------------+-------------+ +----------------------------------------------+----------------------------------+-------+------------------+-------------+-----------------+----------+-------+--------+------------+-------------+
And we also have Grenade jobs in the experimental queue. And we also have Grenade jobs in the experimental queue.
:: ::
+--------------------------------+-------+-------------+-------------+----------+-------+--------+------------+-------------+ +--------------------------------+-------+------------------+-------------+-------------+----------+--------+------------+------------+-------------+
| Job name | nodes | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate | | Job name | nodes | Operating system | L2 agent | firewall | L3 agent | L3 HA | L3 DVR | enable_dvr | Run in gate |
| | | | driver | mode | | | | queue | | | | | | driver | mode | | | | queue |
+================================+=======+=============+=============+==========+=======+========+============+=============+ +================================+=======+=============+==================+=============+==========+========+============+============+=============+
| neutron-ovn-grenade-multinode | 2 | OVN | --- | --- | --- | --- | False | no | | neutron-ovn-grenade-multinode | 2 | Ubuntu Jammy | OVN | --- | --- | --- | --- | False | no |
| (non-voting) | | | | | | | | | | (non-voting) | | | | | | | | | |
+--------------------------------+-------+-------------+-------------+----------+-------+--------+------------+-------------+ +--------------------------------+-------+------------------+-------------+-------------+----------+--------+------------+------------+-------------+
Columns description Columns description

4
zuul.d/project.yaml
View File

@ -66,6 +66,8 @@
- ^roles/.*functional.*$ - ^roles/.*functional.*$
- ^playbooks/.*functional.*$ - ^playbooks/.*functional.*$
- ^zuul.d/(?!(project)).*\.yaml - ^zuul.d/(?!(project)).*\.yaml
- neutron-ovn-tempest-ovs-release-ubuntu-old:
irrelevant-files: *ovn-irrelevant-files
gate: gate:
jobs: jobs:
@ -77,3 +79,5 @@
- neutron-ovn-tempest-ipv6-only-ovs-release - neutron-ovn-tempest-ipv6-only-ovs-release
- tempest-integrated-networking: - tempest-integrated-networking:
irrelevant-files: *ovn-irrelevant-files irrelevant-files: *ovn-irrelevant-files
- neutron-ovn-tempest-ovs-release-ubuntu-old:
irrelevant-files: *ovn-irrelevant-files

6
zuul.d/tempest-singlenode.yaml
View File

@ -597,6 +597,12 @@
description: Job testing for devstack/tempest testing Neutron with ovn driver and latest OVN version provided by the packages released in the operating system this job is deployed on description: Job testing for devstack/tempest testing Neutron with ovn driver and latest OVN version provided by the packages released in the operating system this job is deployed on
parent: neutron-ovn-base parent: neutron-ovn-base
- job:
name: neutron-ovn-tempest-ovs-release-ubuntu-old
description: Job testing for devstack/tempest testing Neutron with ovn driver and previously supported (old) version of the Ubuntu operating system
parent: neutron-ovn-base
nodeset: openstack-single-node-focal
- job: - job:
name: neutron-ovn-tempest-ovs-master name: neutron-ovn-tempest-ovs-master
description: Job testing for devstack/tempest testing Neutron with ovn driver and OVN master branch description: Job testing for devstack/tempest testing Neutron with ovn driver and OVN master branch