5476 Commits

Author SHA1 Message Date
Chuan Miao
5e01d9e292
[NetApp] Support NFS shares on windows
Set following 4 attributes when creating nfs shares:
    showmount:          enabled
    v3-ms-dos-client:   support
    v3-connection-drop: disable
    ejukebox-errors:    disable

Change-Id: I86c3de32d36940e85545fcb337723e4b3edce216
Closes-bug: 1901937
Co-authored-by: Maurice Escher <maurice.escher@sap.com>
2020-11-16 21:04:09 +01:00
Felipe Rodrigues
70f7859f98 [NetApp] Fix hard-coded CA cert path for SSL
NetApp driver is hard-coding the location of CA certificates for SSL
verification during HTTPS requests. This location may change depending
on the environment or/and backend.

This patch adds the `netapp_ssl_cert_path` configuration, enabling
each backend to choose the directory with certificates of trusted CA
or the CA bundle. If set to a directory, it must have been processed
using the c_rehash utility supplied with OpenSSL. If not informed,
it will use the Mozilla's carefully curated collection of Root
Certificates for validating the trustworthiness of SSL certificates.

Closes-Bug: #1900191
Change-Id: Idbed4745104de26af99bb16e07c6890637dfcfd1
2020-11-16 16:04:26 -03:00
Goutham Pacha Ravi
8a691d8631 Retry unmount operation on the LVM driver
When a share is mounted on the same host as the manila-share
process, the kernel prevents us from destroying the
mount directory until the share has been cleanly unmounted
from the host. Kernel mounts can take a few seconds to get
unmounted fully especially when there are a lot of
linux namespaces that the mountpoint has been shared to.

Add a retry on these operations to harden the deletion
process and prevent spurious failures.

Change-Id: I3c1a2ec19d6bc18638db0875519ce60f2c89f33a
Closes-Bug: #1903773
Related-Bug: #1896672
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-11-11 23:27:16 -08:00
Zuul
2d29368bd0 Merge "Replace deprecated UPPER_CONSTRAINTS_FILE variable" 2020-11-12 02:33:56 +00:00
wu.shiming
5e8b2a475d Replace deprecated UPPER_CONSTRAINTS_FILE variable
Change-Id: I1237998bfaf258cf645d34ad8b8609aa5f03381c
2020-11-12 09:35:10 +08:00
Goutham Pacha Ravi
e3fea14788 Retry unmount operation on the ZFSOnLinux driver
When a share is mounted on the same host as the manila-share
process, zfs prevents us from destroying the underlying
dataset until the share has been cleanly unmounted from
the host. Kernel mounts can take a few seconds to get
unmounted fully especially when there are a lot of
linux namespaces that the mountpoint has been shared to.

Add a retry on these operations to harden the deletion
process and prevent spurious failures.

Change-Id: I4aba76b72df274d0a8cb90fe0ab8799523c260ef
Closes-Bug: #1903773
Related-Bug: #1896672
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-11-10 13:35:21 -08:00
silvacarloss
136a89937c Update share replicas export location API ref
Moves the share replica export location API reference out of the
experimental features documentation.

Change-Id: I16cbad169d0c4f89428f17a317840750966d240f
2020-11-06 09:05:36 -03:00
Zuul
abfbfd5781 Merge "Remove the unused coding style modules" 2020-11-04 00:17:30 +00:00
Maurice Escher
074b083597
fix reno file location and indention
Change-Id: Ibdb7f5fb04c9f53cd8c156e87a1bd95376d80839
2020-11-03 09:17:28 +01:00
wu.shiming
55ef4999f9 Remove the unused coding style modules
Python modules related to coding style checks (listed in blacklist.txt
in openstack/requirements repo) are dropped from lower-constraints.txt
as they are not actually used in tests

Change-Id: Ia64180303af54c512610add2f55987efea97017a
2020-10-30 11:43:07 +08:00
Zuul
e5c165dc4f Merge "disable M325" 2020-10-29 20:36:18 +00:00
silvacarloss
21c731e733 Move shares filtering to database layer
Moves the manila shares filtering to the database in order to have
the queries performance improved.

Change-Id: I031a3b9775c50e78b6b86752ff8d1a4871a91c0c
Co-Authored-By: MaAoyu <maaoyu@inspur.com>
2020-10-23 20:37:58 +00:00
haixin
1b5771ef15 Fix logic that determines a share exists before manage
The share "manage" API checks whether
an existing/known share is being imported by
matching the export path provided to existing
shares.

This lookup does not consider the
fact that shares may have multiple export
locations, because it relies on an old/deprecated
"export_location" property on shares which
was added to provide backwards compatibility
to the API that presented only one export
location per share.

Further, it's possible to get a
"ERROR: Invalid share: Share already exists"
exception even when no such share exists in the
database.

Fix the lookup by using the "export_location_path"
based lookup which is faster, since it performs
a meaningful join on the export locations table;
and remove the parameters "protocol"
and "share_type_id" - these things make no
difference when there's a duplicated export
location. We'll consider "host" as a lookup
parameter since we can't be sure that export
locations are unique in a deployment - but they
ought to be unique for a given host.

Closes-Bug: #1848608
Closes-Bug: #1893718
Change-Id: I1d1aef0c2b48764789b43b91b258def6464b389f
Co-Authored-By: Goutham Pacha Ravi <gouthampravi@gmail.com>
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-10-19 15:25:07 +08:00
Zuul
179b26f5dc Merge "Add share server migration admin documentation" 2020-10-14 12:04:56 +00:00
haixin
cc33a4b23e disable M325
Since we don't support python2.x anymore, we don't
need to use six.text_type.

Change-Id: Id1647b55af476ab4559759a27498ede353dd10ba
2020-10-14 14:05:30 +08:00
Zuul
05a6c74800 Merge "Set Victoria max version in the api doc" 2020-10-13 19:27:23 +00:00
Zuul
e6de3ff813 Merge "[NetApp] Fix access rules for CIFS promoted replica" 2020-10-13 19:27:21 +00:00
Goutham Pacha Ravi
6d8c99a7fb Set Victoria max version in the api doc
Change-Id: I02c1062e543986a6d6eaa3187dbd90797899021e
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-10-09 11:41:58 -07:00
Douglas Viroel
2e27c71877 Fix 'update_share_replica' doesn't provide share server model to drivers
This patch fixes the 'update_share_replica' operation in the share manager
that wasn't getting the share-server model from the share replica model.
When the operation is executed, the current share replica object may
not have the 'share-server-id' information and need to be updated before
anything else.

Closes-Bug: #1898924
Change-Id: I1d9d69bbdaa27a68a425d959fa8c5da83a157548
Signed-off-by: Douglas Viroel <viroel@gmail.com>
2020-10-08 20:31:55 -03:00
Douglas Viroel
3ca9c7678e Add share server migration admin documentation
Partial-Bug: #1897903
Change-Id: Ia6dd260e6d2f9e2a7d9d381d345d952a3069f8c5
Signed-off-by: Douglas Viroel <viroel@gmail.com>
2020-10-08 09:43:09 -03:00
Felipe Rodrigues
0c4d1e3398 [NetApp] Fix access rules for CIFS promoted replica
This patch fixes the access rules for NetApp promote replica when
using CIFS protocol. When promoting a replica, the NetApp ONTAP
driver updates the access rules for the promoted CIFS share entity
before actually creating it, failing on having those rules
applied.

The bug is fixed by switching the order of updating the access
and creating the promoted CIFS share entity.

Change-Id: I60e4057dc962d96cff57dea88587a28c2043b499
Closes-Bug: #1896949
2020-10-03 12:32:43 -03:00
52c926e32c Add Python3 wallaby unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for wallaby.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: Iecdb1f467ec49a9cf5cf32aaf4e694390c720b7b
2020-09-25 08:37:40 +00:00
44fe2e5e76 Update master for stable/victoria
Add file to the reno documentation build to show release notes for
stable/victoria.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/victoria.

Change-Id: Id443501a3ddda27d38febebb7e4d6de96fd608c4
Sem-Ver: feature
2020-09-25 08:37:37 +00:00
Zuul
22823526c5 Merge "[NetApp] Improve Adaptive QoS functionality" 11.0.0 11.0.0.0rc1 2020-09-24 23:53:59 +00:00
Zuul
595c378b02 Merge "[DOC] Add admin and user documentation for share revert to snapshot" 2020-09-24 16:19:23 +00:00
debeltrami
c4617f4fff [DOC] Add admin and user documentation for share revert to snapshot
This patch adds the admin and user documentation for share revert to
the latest available snapshot.

Change-Id: Id35b99fdb47bb9de38f42034818fb4a29370bf36
Closes-Bug: #1657322
2020-09-24 15:40:14 +00:00
Zuul
d9cf48765e Merge "Remove unused "_migrate" API method" 2020-09-23 23:23:01 +00:00
Douglas Viroel
39b6a89b1e [NetApp] Improve Adaptive QoS functionality
This patch is a follow up from the main change[1] that adds support
for Adaptive QoS policies that have been pre-created in the storage.
Improvements added in this patch:
- Fail earlier when using this configuration with DHSS=True mode
  and for shares that support replication.
- Fail earlier if no cluster credentials where provided to configure
  volumes with QoS.
- Add support for migration and manage share operations.

Closes-Bug: #1895361

[1] https://review.opendev.org/#/c/740532/

Change-Id: I210994b84548ed6857e338c8e1f41667fa844614
Signed-off-by: Douglas Viroel <viroel@gmail.com>
2020-09-23 17:12:43 -03:00
Zuul
95e06fa7d8 Merge "requirements: Drop os-testr" 2020-09-23 19:59:30 +00:00
Zuul
5dd77622e0 Merge "[NetApp] Fix issues with share server migration" 2020-09-23 18:37:29 +00:00
Zuul
86fdfee94a Merge "Documentation for Share Migration Ocata Improvements." 2020-09-23 14:59:13 +00:00
Zuul
8caa7e3a63 Merge "Follow up change for share server migration" 2020-09-22 22:28:43 +00:00
vrushti
295adb71bf Documentation for Share Migration Ocata Improvements.
Implemented several improvements to share migration in documentation
according to https://review.opendev.org/#/c/406305/

Summary of changes:

 - Add driver-assisted mandatory parameters.
 - Removed previous API documentation because support for them isn't
   there anymore after the backwards incompatible changes were
   made via https://review.opendev.org/#/c/406305/.
 - Add force-host-assisted migration.

Change-Id: I6d446b4037a3a9991e375f0a8bfb1f6edce09c1f
Closes-Bug: #1658230
2020-09-22 19:24:16 -03:00
Goutham Pacha Ravi
ecf4383034 Remove unused "_migrate" API method
It's dead code and nothing refers to it

TrivialFix

Change-Id: I0c3cc4a233879bf471b6358907fda4c0af41ab9b
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2020-09-22 15:10:58 -07:00
wu.shiming
e30c8deb03 requirements: Drop os-testr
We've switched to stestr.

Change-Id: Ic27c1766db7e2b58e3e309db8fd5fa14a0151409
2020-09-22 21:42:44 +00:00
Zuul
6a05a2d922 Merge "Update api-ref for share groups graduation" 2020-09-22 20:16:34 +00:00
Zuul
5fbffb2ab8 Merge "Update share replicas api-ref" 2020-09-22 20:16:33 +00:00
Douglas Viroel
bf058a043e [NetApp] Fix issues with share server migration
This patch is a follow up patch of the main change[1] that adds
support for share server migration in NetApp driver.
It fixes two issues:
- Data motion 'get_backend_configuration' now avoids sending vserver
  configuration, available only in DHSS=False mode, when driver is
  configured with DHSS=True.
- After migrating a share server, all volumes appears with different
  autosize configuration and need to be manually updated to the
  original values. Provisioning options are also being updated in the
  same method.

[1] https://review.opendev.org/#/c/747048/

Change-Id: I28a47417ec5dda0ed1f6c64fae37f5af6ca057e6
Signed-off-by: Douglas Viroel <viroel@gmail.com>
2020-09-22 13:37:27 -03:00
Zuul
63da051929 Merge "[NetApp] Fix python-manila package version" 2020-09-22 15:58:21 +00:00
silvacarloss
346cebcbbb Follow up change for share server migration
Addresses few observed issues in the share server migration
core change.

Change-Id: Ib20faed6d8597f1b7a645f5674f5797e3d3e5ded
2020-09-22 11:14:51 +00:00
Zuul
d08f1ae5d9 Merge "[NetApp] Fix CIFS promote back issue" 2020-09-22 08:23:57 +00:00
Zuul
3bc8cf91e0 Merge "Fix capacity calculations in the CephFS driver" 2020-09-21 20:10:15 +00:00
debeltrami
b1c7c8d688 [NetApp] Fix python-manila package version
NetApp ONTAP Manila driver fails to get information from 'python-manila'
package in the periodic tasks, and logs INFO messages saying the package
was not found. It doesn't break anything, but the message might be scary.

Change-Id: I2e773f7cca0c95d18922281832afd93a99de5123
Closes-Bug: #1886232
2020-09-21 19:44:39 +00:00
Zuul
4f0a61af39 Merge "Fix manage share server for container in Focal" 2020-09-21 19:14:14 +00:00
Zuul
764bf1064f Merge "Modify share groups w/ manila-manage's update-host" 2020-09-21 19:14:12 +00:00
silvacarloss
c3aed22f94 [NetApp] Fix CIFS promote back issue
This change fixes the NetApp promote back issue when using CIFS
protocol. When promoting a replica, the NetApp ONTAP driver
attempts to create a new CIFS share entity (an access point as
defined in [1]) for the new active replica. This behavior
causes a failure since the storage identifies that a current
backend CIFS share with the same name exists, considering
that the reffered replica was once the active one.

This issue is addressed by removing the related CIFS share
entity when the replica gets promoted.

[1] https://library.netapp.com/ecmdocs/ECMP1401220/html/GUID-1898D717-A510-4B3D-B2E3-CCDDD5BD0089.html

Closes-Bug: #1879368
Change-Id: Id9bdd5df0ff05ea08881dd2c83397f0a367d9945
2020-09-21 17:55:12 +00:00
Zuul
2a3aaa9ead Merge "Fix manila OverQuota issue while managing shares" 2020-09-21 16:55:09 +00:00
silvacarloss
05d696c48b Update share replicas api-ref
Moves the share replicas API session out of the experimental
features documentation session.

Change-Id: I19031e0c3db3b0f678b3055d21161e7c5bb52ea7
2020-09-21 16:14:24 +00:00
silvacarloss
a5112a3f10 Update api-ref for share groups graduation
Moves the share group APIs documentation out of the experimental
session.

Closes-Bug: #1659025
Change-Id: Ib1970c34b6068fa7ef4f09027817c647091d6668
2020-09-21 15:43:14 +00:00
Douglas Viroel
40b12b23af Fix manage share server for container in Focal
While managing share server using newest versions of the
Open vSwitch, some of the interface external-ids are being
saved without quotation marks around the container name.
This causes the regex to fail on filtering the correct
network interface and fail on manage share server operation.

An alternative would be to always set the quotation mark
around the container name, but this is not accepted and dropped
by the Open vSwitch. Instead, the search regex was updated and
now it accepts both modes:
i) manila-container=manila_85fd0ad7_f614_46e3_bad3_f19eae36f6ea
ii) manila-container="manila_85fd0ad7_f614_46e3_bad3_f19eae36f6ea"

Closes-Bug: #1896322

Change-Id: Ia24e7cd186cfa23fdfb267ce9b6155ff3d93d5d2
Signed-off-by: Douglas Viroel <viroel@gmail.com>
2020-09-19 13:56:07 -03:00