148 Commits

Author SHA1 Message Date
Zuul
c289887203 Merge "Revert "Increase per project quota to 50"" 2024-12-27 13:51:13 +00:00
Zuul
5d4b6d99d8 Merge "Update gate jobs as per the 2025.1 cycle testing runtime" 2024-12-04 15:08:20 +00:00
Abhishek Kekane
4418b0f740 Tempest job for s3 backend of glance
At the moment this job does not support tls.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/934307
Change-Id: I891652829f297f5ed2b8fca9b0dbb5cd4533fd6c
2024-11-22 05:48:56 +00:00
Ghanshyam Mann
1ca8c20d48 Update gate jobs as per the 2025.1 cycle testing runtime
As per 2025.1 testing runtime[1], we need to test on Ubuntu
Noble (which will be taken care by tempest and devstack
patches to move base jobs to Noble (depends-On)) and at least single
job to run on Ubutnu Jammy (for smooth upgrade from previous
releases).

This commit keep rbac default job continue running on Jammy
which can be moved to noble in next cycle.

Depends-On: https://review.opendev.org/c/openstack/tempest/+/932156
[1] https://governance.openstack.org/tc/reference/runtimes/2025.1.html

Change-Id: Id1d9282ede1c89ce71db18dccf9a37bd3e058edf
2024-11-18 20:14:19 -08:00
Rajat Dhasmana
26b9e49ab9 Revert "Increase per project quota to 50"
This reverts commit 704b24fd67b6d3dee5f1f42f9b793832b4b47bf4.

Reason for revert: We can revert this as the main fix is released now

https://review.opendev.org/c/openstack/releases/+/933578

Change-Id: I013e5a90a4dd5b6ba436b9f57ffe88fdc29eb326
2024-10-29 16:17:37 +00:00
Rajat Dhasmana
704b24fd67 Increase per project quota to 50
This is a workaround to set the default volumes quota to 50.
The correct way is to release the openstackclient fix[1].

Until the OSC fix is released, this patch will unblock gate.

[1] https://review.opendev.org/c/openstack/releases/+/933578

Change-Id: Iaafcbd4ff858bf905b51d80bfda89e8a59b235e4
2024-10-28 21:06:00 +05:30
Ghanshyam Mann
273825d01d Remove default override for RBAC config options
RBAC config options enforce_scope and enforce_new_defaults
were disabled by default in oslo.policy and Glance had to override
the default value to enable those by default. Now oslo.policy
(4.4.0 onwards[1]) changed the default values[2] and enabled
by default for all the services. OpenStack service does not need
to override the default anymore.

As every job run with glance new defaults:
- Removing glance-tox-functional-py39-rbac-defaults
- Add new periodic job to test old defaults
  - tempest-integrated-storage-rbac-old-defaults

NOTE: There is no change in behaviour here, oslo.policy provides the
same configuration that Glance has overridden till now.

[1] https://review.opendev.org/c/openstack/releases/+/925032
[2] https://review.opendev.org/c/openstack/oslo.policy/+/924283

Depends-On: https://review.opendev.org/c/openstack/requirements/+/925464
Change-Id: Ib9a503783df6fb40058089319c7c8b7e9d89d3b8
2024-08-13 11:14:59 -07:00
Zuul
dfab4bc598 Merge "Revert "Fix import job to provide valid disk-formats list to tempest"" 2024-07-18 13:35:17 +00:00
Pranali Deore
57f0c93d25 Revert "Fix import job to provide valid disk-formats list to tempest"
This reverts commit 244ccb68dd9c1be8b8c6223c50998464a394b688.

Reason for revert: disk-format list not required to be passed to the import jobs after the tempest change [1].

[1]: https://review.opendev.org/c/openstack/tempest/+/924252

Change-Id: Id2548fad3e90144b47964b82bb4f702ad6407ae2
2024-07-18 09:07:53 +00:00
Dr. Jens Harbott
726b186e34 zuul: Drop openstack-tox-functional-py38-fips job
The openstack-tox-functional-py38-fips job is based on centos-8-stream,
which is no longer working and will soon be dropped completely, so
remove the job.

Change-Id: Ie419f2cf9f685bba770b6b2c88571e41758cb212
2024-07-06 19:36:01 +02:00
Zuul
d8ee31228d Merge "Revert "Make import jobs non-voting"" 2024-07-04 21:35:33 +00:00
Abhishek Kekane
6459f761e6 Revert "Make import jobs non-voting"
This reverts commit b75f3e4a4278f71d5379d40858df49c8920ca53d.

Reason for revert: Since we have landed all important patches on master branch, we can now revert this change and make jobs voting.

Change-Id: I2f5fa707a2cb7f6ffb38a8b919f224897684c795
2024-07-04 14:24:32 +00:00
frickler.admin
3d916f7de4 Merge "Increase timeout for tempest-integrated-storage-import job" 2024-07-04 07:17:42 +00:00
Rajat Dhasmana
9df48a3071 Increase timeout for tempest-integrated-storage-import job
The tempest-integrated-storage-import has been timing out
frequently around 2 hour 5 minutes mark and similarly one
of the jobs inheriting from it,
tempest-integrated-storage-import-standalone, also times
out around the same time. The timeout issue has increased
recently as can be seen in the job build history[1].

We had a similar issue with the glance-multistore-cinder-import
job for which we increased the timeout to 3 hours[2] but the
job completes successfully on average 2 hour 10 minutes
and has been completing in that time for more than 8 months
since the change to increase timout landed.

The underlying cause could be due to a lot of reasons:
1. Lower concurrency (3) as compared to parent job (6)
2. More number of tests being added to tempest
3. Slow Devstack installation
4. Slow tempest test execution
5. memory consumption of OpenStack services
increased making environment slow
6. no significant improvement in the hardware
specifications on which we run the job

This patch generalizes the timeout to the tempest-integrated-storage-import
job so all of it's child jobs also don't face similar timeouts.

Also we are updating timeout for tempest-integrated-storage-enforce-scope-new-defaults
job as we see similar time out issues in that job.

[1] https://zuul.opendev.org/t/openstack/builds?job_name=tempest-integrated-storage-import&skip=0
[2] 64e6da6fe1

Change-Id: I7165bb8c588659362b7b36394111c41772ac802d
2024-07-04 00:27:41 +05:30
Abhishek Kekane
b75f3e4a42 Make import jobs non-voting
Revert this once tempest fix is merged.

Change-Id: I93e8e71a20a858a3239d8c8ad99bd4b1d9da7fcf
2024-07-03 17:41:44 +00:00
Abhishek Kekane
244ccb68dd Fix import job to provide valid disk-formats list to tempest
Recent changes does not allow image conversion to convert an image
having AMI disk format for image. Passing list of disk-formats to
each import job which will now use qcow2 as default disk-format to
create the image.

Change-Id: I712b304ebe168705ec2793626f5d64135ad6d458
2024-07-02 19:27:49 +00:00
Zuul
cfc9c0eb1a Merge "Make functional-py312 voting and add it to the gate" 2024-06-21 01:21:23 +00:00
Pranali Deore
dfbfdad77f Move all periodic tips jobs from py38/39 to py311/312
Since the abstract base periodic tips jobs are now using
ubuntu-jammy by default [1], we can move the py3.8 jobs to
py3.11.

To move the py3.9 jobs to python 3.12, we follow what change
If42cb167c339 did for the the openstack-tox-py312 job and use
debian-bookworm with the pyenv flag set.

[1]: https://review.opendev.org/c/openstack/glance/+/894511

Depends-on: https://review.opendev.org/c/openstack/glance-tempest-plugin/+/916332
Change-Id: I113c098cb6b6c3b74414cbab3bf5c05ee69606d9
2024-05-29 20:48:10 +00:00
Cyril Roelandt
95abad115b Make functional-py312 voting and add it to the gate
Change-Id: If9238dc4243b1bd23ee0a61a1531ff784ad19655
2024-05-28 17:09:49 +02:00
Cyril Roelandt
9f4754cd80 Add non-voting functional-py312 job
Change-Id: I8acd8af259890533bc6420f8591af468759ef020
2024-05-21 18:12:49 +02:00
Zuul
462ac84445 Merge "Remove SQLAlchemy tips jobs" 2024-05-14 13:21:36 +00:00
Zuul
7c51a9ce44 Merge "Remove ubuntu focal job" 2024-05-14 09:41:48 +00:00
Stephen Finucane
513311f975 Remove SQLAlchemy tips jobs
The most recent SQLAlchemy and Alembic versions are now in
upper-constraints. As a result, this job has served its purpose and can
be removed. For more information, see [1].

[1] https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/RBHXHTO3GUOOXVSZXD4C2O3TKDOH2QSC/

Change-Id: I96ae5ba24a9e32994f4b7b111a8b56e56db33cbe
Signed-off-by: Stephen Finucane <stephenfin@redhat.com>
Depends-on: https://review.opendev.org/c/openstack/requirements/+/879743
2024-04-12 11:39:09 +01:00
Abhishek Kekane
c7cc706a15 New grenade job to upgrding cache driver
This job will verify that upgrading cache driver from sqlite to
centralized database will not have any impact.

Related blueprint  centralized-cache-db

Change-Id: Iafed7342753da73efee2c50079505d88fe8ac4d5
2024-03-06 12:43:28 +00:00
Abhishek Kekane
68c3a80291 Use centralized_db cache driver in tempest jobs
Related blueprint centralized-cache-db
Depends-On: https://review.opendev.org/c/openstack/tempest/+/901525
Change-Id: Icd6d79d563c6b5e8f2158bcad9b4f471d72def90
2024-03-01 05:23:55 +00:00
Pranali Deore
468ebdd2f0 Make openstack-tox-functional-py38-fips job non-voting
Temporarily make the openstack-tox-functional-py38-fips
job non-voting till we figure out why its failing.

Change-Id: I8b693a692fc1248c385cfa7d0808ae0283a33781
2024-02-26 08:16:13 +00:00
whoami-rajat
64e6da6fe1 Increase timeout for glance cinder multistore job
Currently the glance cinder multistore job times out from time to
time in 2 hours (and some minutes)[1].
The issue is not specific and generally points to a slow devstack
deployment or a slow tempest run[2] which exceeds the allocated time
provided for the job to complete.
Unless the job is checked thoroughly to determine the areas of
improvement, a short term fix would be to increase the timeout
of job (which might also be the ideal solution if the job is
landing on a system with inferior hardware).
This patch increases the timeout to 10800 seconds i.e. 3 hours.

[1] https://zuul.openstack.org/builds?job_name=glance-multistore-cinder-import&project=openstack%2Fglance&skip=0
[2] https://review.opendev.org/c/openstack/glance/+/899868/1#message-081c737d8747de44669acd1cdc322e347b09d390

Change-Id: I2d21d8b098355a6cc4ceb1de8f9d7fefa19be965
2023-11-30 12:10:25 +00:00
Pranali Deore
db41ce6728 Revert "Make glance-tox-functional-py39-sqlalchemy-tips job non-voting"
This reverts commit caa6e5d965c1467d7df51ceaa29660fe5140f1c3.

Reason for revert:
Sqlalchemy issue is fixed and upper-constraint change is also merged after oslo.utils 6.3.0 release.

Change-Id: I21e3911aaea363dfd2d46974431bf34efd72282d
2023-11-10 11:00:27 +00:00
PranaliD
caa6e5d965 Make glance-tox-functional-py39-sqlalchemy-tips job non-voting
Sqlalchemy issue[1] was breaking this job which is currently fixed
but in order to unblock the gate moving this job to non voting
until the new release for oslo.utils[2]

[1]: https://bugs.launchpad.net/oslo.utils/+bug/2042886
[2]: https://review.opendev.org/c/openstack/releases/+/900382

Change-Id: Idd36655f1e495fe40138b9245c8e4f1f81c89d19
2023-11-09 11:09:11 +00:00
Zuul
03a14a9b9c Merge "Unset VENV python_interpreter in fips job" 2023-09-25 20:04:51 +00:00
Dan Smith
359f902518 Unset VENV python_interpreter in fips job
This is set in the parent job, but will be wrong if we are not using
a venv.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/896123
Change-Id: Iab82ccb68821d7e56f7cdb64a3dbafe313f1928b
2023-09-22 08:07:19 -07:00
Stephen Finucane
0b29dc9beb zuul: Replace use of deprecated regex syntax
zuul now says:

  All regular expressions must conform to RE2 syntax, but an expression
  using the deprecated Perl-style syntax has been detected. Adjust the
  configuration to conform to RE2 syntax.

Do as we're told.

Change-Id: Iffa8ae6102c547184fab4ed0f6860a5a73da150c
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2023-09-22 12:30:02 +01:00
Zuul
551b15008b Merge "Add job to test with SQLAlchemy master (2.x)" 2023-09-22 03:01:15 +00:00
Zuul
46988556ee Merge "Set GLOBAL_VENV to false for centos" 2023-09-18 20:14:08 +00:00
likui
6a0b1455fa Remove ubuntu focal job
Ubuntu focal was in testing runtime as best effort
testing in 2023.1 cycle. In 2023.2, we do not need to
test the focal as such. Removing its testing to more
focus on making Jammy testing more stable.

[0] https://review.opendev.org/c/openstack/tempest/+/884952

Change-Id: I9f621ac4984d78e5e6a5ff0a0abc493cc9f7bf07
2023-09-11 18:03:16 +08:00
Abhishek Kekane
6d8f124874 Reduce concurrency for tempest jobs
Recently many jobs are failing with timeout and one of the suggestion
as per [1] is to reduce the concurrency of the jobs. Current concurrency
is 6, setting it to 3 now.

[1] https://wiki.openstack.org/wiki/CinderBobcatMidCycleSummary#Session_Two:_R-6:_23_August_2023

Change-Id: Ieb96eb6ceb6f2a9673dfee1d94397ba3c6c2a296
2023-09-07 07:57:19 +00:00
Abhishek Kekane
89fab96292 Set GLOBAL_VENV to false for centos
glance-multistore-cinder-import-fips which is using centos is
broken recently.

A temporary workaround is to set the GLOBAL_VENV to false
specifically for centos 9 stream distros where the issue
is encountered after changing the default value
of GLOBAL_VENV to True in Devstack:
https://review.opendev.org/c/openstack/devstack/+/558930

Change-Id: I5ea80c2708e5adf65129283bbf7d8826843d5c67
2023-08-31 17:04:01 +00:00
Abhishek Kekane
fb3aba94cd Fix post failures causing by image conversion failure
CI jobs tempest-integrated-storage-import-standalone,
tempest-integrated-storage-import and
glance-multistore-cinder-import were failing while converting
image from qcow2 to raw. The failures were caused by changing
default behavior of Devstack and installing everything in global
virtualenv patch [1].

This fixes import conversion in the affected jobs properly by setting
the python interpreter to the one in the venv. When we spawn external
commands they actually spawn a python interpreter to use an oslo
module to do the exec, and we need to do that with our venv's python.

Finally, this bumps the swap size for the storage-import jobs to 8G
to help account for the additional overhead of running another glance
worker, which is required for that configuration. This matches other
jobs with additional overhead (i.e. the ceph ones).

[1] https://review.opendev.org/c/openstack/devstack/+/891248

Co-Authored-By: Dan Smith <dansmith@redhat.com>
Depends-On: https://review.opendev.org/c/openstack/devstack/+/892571
Change-Id: I073216d1bbddbd3bdecd2b135e4c291f7a4d9abe
2023-08-24 06:48:03 -07:00
Stephen Finucane
02440705ba Add job to test with SQLAlchemy master (2.x)
We add a wholly new job rather than modifying one of the oslo-tips jobs
since these jobs are run periodically rather than in the check queue and
we want to prevent regressions.

Change-Id: I1036b7b0d64c91f0f64b37340490a2e52ee0baea
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2023-07-25 10:10:13 +01:00
Ghanshyam Mann
43b2116adb Test glance RBAC old defaults
Glance has enabled the scope checks and new defaults in
antelope release and now devstack is switching the testing
to new defaults by default (depends-on). With that all the
jobs will run the the new defaults.

As old defaults are still supported (as deprecated), we should
test those at least in a single integrated job. Enable the old
defaults in glance-multistore-cinder-import job.

Keeping existing job enabling the new defaults because other services
have not switched to new defaults yet to this job enable new defaults
for those service and test Glance against that.

Depends-On: https://review.opendev.org/c/openstack/devstack/+/883601/
Change-Id: I470e3b8c1106d88e85343508a8e5891c88861c98
2023-05-19 03:30:23 +00:00
Ghanshyam Mann
dca70d1ca8 Run integrated test if zuul.yaml file is changed
zuul.yaml file contain many jobs definition and base class.
Any change in this file can impact other job definition. Also,
many times we want to test the full integrated gate if this
file is changed or if depends-on is changing some global setting,
for example: https://review.opendev.org/c/openstack/glance/+/883602/1

Change-Id: I14abd88944407da17ca81b77c079262565ff71c6
2023-05-18 22:27:30 -05:00
Brian Rosmaita
084c8a32f5 Update functional jobs for 2023.2
Based on the python runtimes for 2023.2 [0], we should be running
functional jobs on python 3.9 and python 3.10.  This patch adds
functional testenvs for python 3.10 and 3.11 (the latter for local
testing) to tox.ini so the appropriate zuul jobs can be defined.

The functional-py38 testenv is not removed from tox.ini, as it may
be useful locally.

Functional py39 and py310 jobs are added to the check and the gate.

The current openstack-functional-py38-fips job is not removed; a
py39 job has not yet been defined to replace it [1].

[0] https://governance.openstack.org/tc/reference/runtimes/2023.2.html
[1] b3cad4f7a3/zuul.d/jobs.yaml

Change-Id: Ibc21b107878f5ba50137da4082a7cbc6342d2aa9
2023-04-17 18:00:24 -04:00
Ghanshyam
e53af9c3ce Revert "Make glance-secure-rbac-protection-functional job non-voting"
This reverts commit 1ae2ad39795a3b4c8e0d4f7169ead740b29ee033.

Reason for revert:
Test are fixed in depends-on and job is passing now

Change-Id: I94bc43b3e88e284fdc1158404c3ee3ee2b0125c0
Depends-On: https://review.opendev.org/c/openstack/glance-tempest-plugin/+/876235
2023-03-03 18:38:18 +00:00
Abhishek Kekane
1ae2ad3979 Make glance-secure-rbac-protection-functional job non-voting
Tempest change [1] has broken glance srbac tempest tests, so
in order to unblock the gate we need to turn the job non-voting and
once we fix those tests we will re-enable the same.

[1] https://review.opendev.org/c/openstack/tempest/+/871018

Change-Id: Ibbfd8904b3a87b870ed8cde26245176c5b8e74aa
2023-03-02 14:47:38 +00:00
Pranali Deore
8c04d19e88 Enabled new defaults and scope checks by default
Enabling the enforce scope and new defaults by default in glance

Related blueprint secure-rbac

Change-Id: I0808dc0b1b34b527e38aa137c1dd25e1fc06409f
2023-02-16 11:11:31 +00:00
Abhishek Kekane
d07187f710 Remove migration constant job and test
Since openstack release naming conventions has changed, current test
which check data migration version will not work as expected and same
is also blocking our gate. Removing this job and test to unblock the
gate.

NOTE: Going forward glance PTL/team needs to change the database
migration version without fail at the start of release cycle.

Change-Id: Idcb12a6c450d4ce4ee859e6e1f02fb71adf8c1d5
2023-01-16 14:40:29 +00:00
likui
4da0077d7b add openstack-python3-zed-jobs-arm64 job
This is a non-voting job to validate py3 unittests on ARM64

Change-Id: Ie229c57654a8827d2274f6ab812310bdd989db4b
Task: #40402
Story: 2007938
2022-10-10 09:38:19 +08:00
499257d2b6 Switch to 2023.1 Python3 unit tests and generic template name
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for antelope. Also,
updating the template name to generic one.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I9c3e19cf1a2c74381395d49ee3d792bbd92b603a
2022-09-14 17:19:29 +00:00
Abhishek Kekane
1ef06ef08b Enable Image cache tempest testing
This patch will enable new cache APIs tempest tests in glance gate.

Change-Id: I01e8550aef85d333a70392be83a964267e632c2d
2022-07-27 20:06:55 +00:00
Ade Lee
05543914a7 Fix fips job
The ecdsa usage for ssh is supposed to be the default right now.
Also, a new role paramter nslookup_target is required for the fips role

Depends-On: https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/847193
Change-Id: I795c751edd1403d23aa1de5cda194aada80d05b2
2022-06-22 20:49:23 +00:00