820 Commits

Author SHA1 Message Date
Zuul
1a39505039 Merge "Add Pure Storage FlashBlade driver" 2021-07-16 18:49:03 +00:00
Zuul
a2d30e215e Merge "Filter shares by share type "extra_specs"" 2021-07-06 09:06:21 +00:00
Zuul
35af72a875 Merge "init_host should be called before RPC consumer is created" 2021-07-03 04:29:54 +00:00
Zuul
5c32178501 Merge "Handle service client authorization errors" 2021-07-02 14:08:29 +00:00
Zuul
b8be5f7f11 Merge "Fix ipaddress issues in the infinidat driver" 2021-07-02 00:54:34 +00:00
Goutham Pacha Ravi
1161a56a74 Fix ipaddress issues in the infinidat driver
In python3.8.11 and python3.9.6, the behavior of the
ipaddress.ip_network.hosts() method changed. Now /32
addresses are returned by that method as a single
element list. This was apparently done as a bugfix [1]

Change-Id: Iab6d96351fa21131d834ccf07ffddd70555f25a7
Closes-Bug: #1934345
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
[1] https://bugs.python.org/issue27683
2021-07-01 10:31:02 -07:00
Zuul
329e8528e1 Merge "Add Ceph version check" 2021-06-26 22:43:04 +00:00
Simon Dodsley
9eb37eca8b Add Pure Storage FlashBlade driver
Change-Id: I8de380bca1b55d4d0ee44a5e5d052a7dced467df
2021-06-25 23:38:10 -04:00
Victoria Martinez de la Cruz
3ed02db00e Add Ceph version check
CephFS drivers in OpenStack Manila are directing
mgr commands to the mgr by specifying mon-mgr as
the target [0]. This target (mon-mgr) was added
to Ceph in Octopus [1].

We would need a version check in order to set the
correct target while we wait on the backport on Ceph
to land [2].

[0] 3ea5d50a23
[1] 4000d500c0
[2] https://tracker.ceph.com/issues/51039

Closes-Bug: #1930459
Change-Id: I1a1079df8e104c5ddba29cb614eb4e02a304082e
2021-06-25 22:10:05 +02:00
Goutham Pacha Ravi
04e06968fd Handle service client authorization errors
Authorization errors when connecting
to nova/glance/neutron/cinder can be raised as
BadConfigurationExceptions in the logs. We shouldn't
be raising exceptions derived from the service client
libraries.

Change-Id: I2d47dbb1251dfa8d529f813724fb7fd97d7d3a0b
Closes-Bug: #1921927
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2021-06-24 15:45:04 +00:00
Tom Barron
a4765cff1e Remove duplicate line in release note
Goutham noted in review [1] that there is a duplicate line in a recent
release note, so let's remove it.

[1] https://review.opendev.org/c/openstack/manila/+/745206/9/releasenotes/notes/remove-deprecated-options-and-auth-4d497e03ad47e872.yaml@161

Change-Id: I59908509fc6714e6f0db1fdda27171a9390c4411
2021-06-22 07:22:38 -04:00
Zuul
fca72a2d23 Merge "Remove deprecated config and auth" 2021-06-22 01:46:56 +00:00
Kafilat Adeleke
4fbacf1df1 Filter shares by share type "extra_specs"
This change fixes the query being used to filter share
types. We were using an "or" clause instead of an "and" clause,
and that was causing all the extra specs to be shown instead of
the ones that the user specified. With this fix, manila users will
be able to filter shares by share type extra_specs accurately.

Closes-Bug: #1929121

Change-Id: I5cf9788dcafebdf88426617d2824f4be42dbb412
2021-06-21 16:43:07 +00:00
Maurice Escher
0339802a5d init_host should be called before RPC consumer is created
This change adds a new hook to Manager class called init_host_with_rpc()
to allow services like scheduler to do something once RPC is ready.

Copied from cinder 65fa80c361
and 60c563f72d

Change-Id: Iac6507a6e395c55f0fec453650009f08c2bb6563
Closes-Bug: #1271568
2021-06-17 07:22:44 -04:00
Zuul
37c43a1201 Merge "Fix api error message for snapshot creation failure" 2021-05-13 19:55:54 +00:00
Tom Barron
be29805859 Fix api error message for snapshot creation failure
when the source share has ``snapshot_support`` False.

The message said that the back end lacks snapshot support but this
is not necessarily the case.

Closes-bug: #1925342
Change-Id: I09a83b63528c0988f3601dfd07ad6972165cb855
2021-05-12 12:24:13 +00:00
LinPeiWen
63e255248b [Glusterfs] Fix create share from snapshot failed
1、After performing a snapshot clone of the glusterfs vol,
  the status of the vol is'Created', and the parameter
  "gluster volume set nfs.rpc-auth-reject'*'" is required for
  the vol in the'Started' state.
2、The cloned volume needs to activate the snapshot,
  if the snapshot is already activated, you need to skip the activation step

Closes-Bug: #1922075
Change-Id: I304bf59b3f8c0d5b847078a5752bac8ac4f21690
2021-04-27 09:23:13 +00:00
Tom Barron
5af3b8e68b Remove deprecated config and auth
Remove manila configuration options
and auth classes that were deprecated
before the Ussuri release.

Change-Id: I148225926cd249a0dd8d1f8c02b22ed06487f405
2021-04-26 11:53:58 -04:00
Zuul
7b521675ef Merge "Direct mgr commands to the mgr daemon" 2021-04-19 19:25:03 +00:00
Maurice Escher
29a943fde7
Reuse _set_instances_share_data for replicas.
Replicas are just special instances after all, no need for
duplicate code and missing on improvements like exception handling
on NotFound error.

Change-Id: I31fabebc6a60814a4cfc04ae0deb49dcb66cab0f
Closes-Bug: #1923566
2021-04-16 10:32:58 +02:00
Victoria Martinez de la Cruz
3ea5d50a23 Direct mgr commands to the mgr daemon
Commands in the Ceph driver are directed at the mon
daemon instead of at the mgr daemon.

The driver's rados_command() calls json_command() and,
by default, json_command() calls the python
rados client's mon_command() instead of mgr_command().

By passing the target as mon-mgr, the python rados
client's mgr_command() is called as desired, and we
avoid the need of extra MON write caps.

Closes-Bug: #1923181

Co-Authored-By: Victoria Martinez de la Cruz <victoria@redhat.com>
Co-Authored-By: Ramana Raja <rraja@redhat.com>
Co-Authored-By: Tom Barron <tpb@dyncloud.net>
Change-Id: I5bca68070ca1eb539d53dd31cb92588840e925e8
2021-04-13 20:10:48 +00:00
1522add3aa Update master for stable/wallaby
Add file to the reno documentation build to show release notes for
stable/wallaby.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/wallaby.

Sem-Ver: feature
Change-Id: I49803f627c4c580b41e7408b2b7e0452f3758831
2021-03-26 18:56:26 +00:00
Zuul
0c8e92e54a Merge "Add release note for secure rbac work" 2021-03-26 16:19:40 +00:00
Goutham Pacha Ravi
7a99c6a181 Add release note for secure rbac work
Call out the feature and its impact.

Change-Id: I3062950e7b9c5b7d93a8332b65881f83226cda4e
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>
2021-03-26 15:21:34 +00:00
Zuul
8a51e5e907 Merge "Filter storage protocol in the scheduler" 2021-03-26 10:52:04 +00:00
Zuul
bcab0515fa Merge "[NetApp] Follow up fixes for update security service" 2021-03-26 10:51:07 +00:00
Zuul
36672dcec6 Merge "Add exception for insufficient privileges when using security services" 2021-03-26 01:25:19 +00:00
Zuul
a411f521d4 Merge "Support host assisted share migration for Zadara manila driver" 2021-03-26 00:04:11 +00:00
Zuul
4617e20e7b Merge "Fix wrong totalcount returned by share listing query" 2021-03-25 21:36:36 +00:00
Douglas Viroel
7f0737b75e [NetApp] Follow up fixes for update security service
This patch is a follow up of [1] to address some comments
added in the review process. It also adds more unit tests to
validate the new code added.

[1] https://review.opendev.org/c/openstack/manila/+/775032

Change-Id: If7b8628fa05200363a129eb19d9dc80fb7e3bc36
Signed-off-by: Douglas Viroel <viroel@gmail.com>
2021-03-25 17:50:24 -03:00
Zuul
0c577864fb Merge "[NetApp] Implement cached status pool" 2021-03-25 20:09:54 +00:00
Zuul
33d8603b13 Merge "Add create share from snapshot in CephFS" 2021-03-25 19:52:04 +00:00
Zuul
24d41e8887 Merge "scheduler should ignore earlier time service capabilities" 2021-03-25 15:51:03 +00:00
Ratnakaram Rajesh
643083eefa Support host assisted share migration for Zadara manila driver
Closes-Bug: #1917980

Change-Id: I66371e6a8a1650ffebe5ffe482cde52660ccc000
2021-03-25 17:17:34 +02:00
Eduardo Santos
3d65f46d3e Add exception for insufficient privileges when using security services
When trying to create a share using a security
service while having insufficient privileges or
providing wrong credentials, manila raises a
generic user message that provides little
information to the end user on what exactly went
wrong.
Added a driver-agnostic exception for when this
happens, accompanied with a user message to
provide more useful information to end users.

Partial-Bug: #1900755
Change-Id: I2b0bc5c0715c225cd5b38b55fb3967ff7fc86fa8
2021-03-25 14:45:53 +00:00
maaoyu
268686c448 Fix wrong totalcount returned by share listing query
This bugfix [1] modified the totalcount returned by pagination
query when the argument 'limit' was specified. It caused
manila to do not return precise count of shares in a query that
satisfied the conditions.

This bug has been fixed and now manila is returning the precise
values of shares matched in a given query. Also, manila is now
performing filtering actions in the database to have more
performatic results.

[1] https://review.opendev.org/#/c/688542/

Closes-Bug: #1860061

Co-Authored-By: Carlos Eduardo <ces.eduardo98@gmail.com>

Change-Id: I6ddd919bbd5180593cc52bf986912f65a2dab3a7
2021-03-25 08:47:22 -03:00
Zuul
4f41f86ad1 Merge "fix unmange share with manage_error status will lead to quota error" 2021-03-25 03:04:59 +00:00
Victoria Martinez de la Cruz
5c81264346 Add create share from snapshot in CephFS
Adds create share from snapshot functionality to
CephFS drivers.

Depends-On: https://review.opendev.org/c/openstack/manila-tempest-plugin/+/778188

Co-Authored-By: Victoria Martinez de la Cruz <victoria@redhat.com>
Co-Authored-By: Ramana Raja <rraja@redhat.com>
Co-Authored-By: Tom Barron <tpb@dyncloud.net>

DocImpact
Partially-Implements: blueprint create-share-from-snapshot-cephfs

Change-Id: I825ab15af934cb37dfda48ea26ec1af9de8dd293
2021-03-24 22:24:30 +00:00
Victoria Martinez de la Cruz
a830710939 Update cephfs drivers to use ceph-mgr client
Use python rados client to talk to the ceph-mgr service.

A python rados client is created by the driver that lasts
during the driver's lifecycle.

The drivers can now work with multiple filesystem clusters.
The filesystem to be used by manila can be specified by the
driver option 'cephfs_filesystem_name'.

The removal of a share will be quicker for the manila user.
The ceph-mgr volumes module moves the share's content to
a trash folder and purges the trash's contents
(`rm -rf` of the backend CephFS subvolume/subtree) aysnchronously,
whereas the ceph_volume_client library moves the share's content
and purges the content synchronously.

Implements: bp update-cephfs-drivers

Co-Authored-By: Victoria Martinez de la Cruz <victoria@redhat.com>
Co-Authored-By: Ramana Raja <rraja@redhat.com>
Co-Authored-By: Tom Barron <tpb@dyncloud.net>

DocImpact

Change-Id: I1f81db1ba7724c0784d87f9cb92bb696f6778806
2021-03-24 10:50:05 -04:00
Zuul
7f6aa6dbd3 Merge "Fix generic share resize with 0.0.0.0/24 access" 2021-03-23 22:37:59 +00:00
Zuul
3ce8d978ad Merge "Put ensure_share into thread pool to speed up the startup of share service" 2021-03-22 12:33:04 +00:00
haixin
a8e25b858d Put ensure_share into thread pool to speed up the startup of share service
when we need to start or restart manila share service, will call
init_host().
and call ensure_driver_resources() in init_host(),
will call self.driver.ensure_shares or self.driver.ensure_share to
update all share instances in that host. Currently, only NetApp and LVM
implement self.driver.ensure_shares, Other manufacturers are using
self.driver.ensure_share.
   in large-scale environment, there are lot of share instances in one
host. this will lead to take much time to ensure_share.
   so we can put this operation into the thread pool to speed up the
startup of the service.

Closes-Bug: #1909847
Change-Id: I295d0de0958ebfedd89441f1a2c1b447b74693a0
2021-03-20 11:49:23 +00:00
haixin
73d0a74f3b fix unmange share with manage_error status will lead to quota error
if we failed to manage a share, we don't need to commit the quota usages. so
we should skip quota usages cuts when delete or unmange the share with
status of "error_manage". and the size of error_manage share should be
zero.

Closes-Bug:#1883506

Change-Id: I5c81dd6780890c55c8c6a92491c3f4f507531fdb
2021-03-20 10:45:23 +08:00
Elias Wimmer
2586252606 Fix generic share resize with 0.0.0.0/24 access
Add missing quotes to exportfs command to protect <world> being
interpreted as file redirect

Closes-Bug: #1911695
Change-Id: Ie95a476e9a81c58df998c3f44da137b023b53cc6
2021-03-19 13:18:38 +01:00
Goutham Pacha Ravi
f24fff9522 Filter storage protocol in the scheduler
The share protocol requested was being
ignored by the scheduler and this would
cause shares to get scheduled to hosts
that don't support the specified protocol.

Change-Id: I2e87264865b645781c481383c039fecbfd7c6eb1
Closes-Bug: #1783736
2021-03-17 18:18:56 -07:00
Felipe Rodrigues
b2e1797889 [NetApp] Implement cached status pool
In order to optimize the NetApp ONTAP driver, this patch is caching
the status of driver pools and reusing for the each share server,
given that the pool is not separated by share server.

The option `netapp_cached_aggregates_status_lifetime` is added
for controlling the time that the cached values is considered
valid.

Closes-Bug: #1900469
Change-Id: I14a059615fc29c7c173c035bb51d39e0bbb8b70a
2021-03-17 19:09:00 -03:00
Zuul
9b835f03d5 Merge "[NetApp] Implement security service update" 2021-03-17 04:19:37 +00:00
Zuul
e8810b2019 Merge "Fix traceback in scheduler-stats API" 2021-03-15 19:18:07 +00:00
haixin
70bb650e7f scheduler should ignore earlier time service capabilities
if rabbitmq is too much pressure or blockage.scheduler
will not received service capabilities, but once the
message queue(rabbitmq) returns to normal, scheduler
will received many service capabilities, these service
capabilities are acquired by manila share at different
times, so the timestamp of service capabilities shoud
added at share manage layer(before rpc), but not
scheduler layer(after rpc), once scheduler get an newer
service capabilities, there is no need to update an
earlier service capabilities.

Closes-Bug: #1908963
Change-Id: I6ce99ed4451c5d02cb4446861fa59e55a94951a5
2021-03-15 16:18:39 +00:00
Zuul
475eeafd8d Merge "Add security service update support to the container driver" 2021-03-15 14:03:31 +00:00