3157 Commits

Author SHA1 Message Date
Jenkins
fb264a4e5a Merge "Tox Upper Constraints - strip out reinstalls for remaining jobs" 2016-08-15 22:14:48 +00:00
Jenkins
2f047eb25a Merge "Container driver" 2016-08-15 21:04:11 +00:00
Jenkins
51a93d1ca8 Merge "NetApp cDOT: Apply network MTU to VLAN ports" 2016-08-15 16:26:11 +00:00
Alexey Ovchinnikov
ddf960a2d9 Container driver
This driver exploits a Docker container as a share server instead
of a virtual machine. The container acts as a CIFS server
and shares logical volume attached to it. The volume gets created
simultaneously to the container on a host in a volume group
specified by the user.

DocImpact
Change-Id: I711813a2022d765ab7a70ed670e34f68f9cf1399
Implements: blueprint manila-container-driver
2016-08-15 16:30:23 +03:00
Goutham Pacha Ravi
33374626db Tox Upper Constraints - strip out reinstalls for remaining jobs
releasenotes and venv tox jobs had redefined the install_command
to reinstall any packages from requirements/test-requirements files.

Since Infra started supporting constrained requirements for these
jobs as well, we can drop the reinstall command.

Ref:
http://lists.openstack.org/pipermail/openstack-dev/2016-August/101474.html

Change-Id: Ib4b8c6cef22a9911030c2e3e3f5281e7e22575fc
2016-08-14 11:52:05 -04:00
Clinton Knight
2d4e30bd21 NetApp cDOT: Apply network MTU to VLAN ports
Through change I9b4efae620ec9f6790547c8fffc58872d43277f5
we added support in manila to request the Maximum Transmission
Unit (MTU) from the network provider (neutron, standalone, etc.).

To honor this MTU, the NetApp cDOT driver needs to apply it
to the VLAN ports (via the broadcast domain) that the LIFs of the
newly created share servers are assigned to.

Co-Authored-By: Goutham Pacha Ravi <gouthamr@netapp.com>
Depends-On: I9b4efae620ec9f6790547c8fffc58872d43277f5
Change-Id: Ia01d982c7328feff292d54588d33a16df705f81e
Implements: blueprint netapp-cdot-honor-mtu-size
2016-08-14 15:35:15 +00:00
Jenkins
d43c8198a7 Merge "Fix typo in glusterfs driver comment" 2016-08-14 14:16:04 +00:00
Jenkins
647d133d29 Merge "[dev-docs] Changed small case letters to capital" 2016-08-14 05:11:54 +00:00
liujiong
fda0b07e9d Fix typo in glusterfs driver comment
TrivialFix

Change-Id: I9701c363eca58ca79846689cb480088c0859674c
2016-08-14 01:39:25 +08:00
Jenkins
a3087b309a Merge "Add MTU information in DB and API" 2016-08-13 01:47:21 +00:00
Jenkins
1143406ed4 Merge "NetApp cDOT driver configurable clone split" 2016-08-12 22:26:50 +00:00
Jenkins
ec3b72ee49 Merge "NetApp cDOT multi-SVM driver configurable NFS versions" 2016-08-12 22:20:28 +00:00
Jenkins
faef310caa Merge "cephfs_native: enhance update_access()" 2016-08-12 18:41:32 +00:00
Jenkins
1923f44aaa Merge "Updated from global requirements" 2016-08-12 17:04:09 +00:00
Prudhvi Rao Shedimbi
ff4a33aefb [dev-docs] Changed small case letters to capital
Changed small case letters to capital case at appropriate
places like beginning of the line.

TrivialFix

Change-Id: Ib7d219af2e531a8bb315377a177e233863759c5c
2016-08-12 16:13:08 +00:00
Jenkins
42843b0e8a Merge "TrivialFix: Change LOG.warn to LOG.warning" 2016-08-12 14:56:58 +00:00
Marc Koderer
e3afcd751f Add MTU information in DB and API
MTU value can be different for each neutron network.
E.g. for high-performance use-cases it's very important to also
support MTU's with jumbo frames.

This patch exposes this information to the drivers. Each driver
should setup its resources accordingly.

The tempest test actually just covers the api change. Better coverage will
be added when the container driver lands.

APIImpact
DocImpact

Change-Id: I9b4efae620ec9f6790547c8fffc58872d43277f5
Implements: bp add-network-mtu
Related-Bug: #1612528
2016-08-12 15:14:14 +02:00
Jenkins
6bae3006d9 Merge "Refactor GPFS driver for NFS ganesha support" 2016-08-12 13:02:40 +00:00
Goutham Pacha Ravi
dfbe3ea418 In-tree Install Guide
The OpenStack install guide team has recommended that projects
that are not part of the starter-kit:compute [1] (and a few other projects
like Cinder and Horizon) maintain their install guide in-tree. [2]

[1] http://governance.openstack.org/reference/tags/starter-kit_compute.html
[2] http://git.openstack.org/cgit/openstack/docs-specs/tree/specs/newton/project-specific-installguides.rst

Change-Id: I2b49fcfd99b3be40bb1ae7d7b8348abdb5b58b90
Co-Authored-By: Denis Cavalcante <dencaval@gmail.com>
Implements: blueprint manila-in-tree-install-guide
Partially-implements: blueprint projectspecificinstallguides
2016-08-12 08:06:38 -04:00
OpenStack Proposal Bot
1c1107d811 Updated from global requirements
Change-Id: I7268c6c9920db89583292e9a76c0fa7095285e4b
2016-08-12 08:51:43 +00:00
Ramana Raja
08ffd6bdb5 cephfs_native: enhance update_access()
During recovery/maintenance mode, the driver applied all the
rules it was expected to sync. It couldn't e.g., remove the
already existing but unwanted access rules from the backend.
This was because CephFSVolumeClient, the interface to Ceph
backend, did not have the ability to fetch the existing
access rules from the backend.

Since the following commits in Ceph,
master branch, https://github.com/ceph/ceph/commits/1c1d65a45f4574
Jewel branch,  https://github.com/ceph/ceph/commits/e1eb8afea9f202
the CephFSVolumeClient is versioned and can list the existing
access rules. Use this to more faithfully implement update_access()
and ensure backwards compatibility with earlier versions of
CephFSVolumeClient.

Also, when authorizing access for a ceph auth ID using
CephFSVolumeClient's authorize(), pass the project ID of the
share as an additional argument. This is required (since
the above mentioned commits) to retrieve the access key of
the ceph auth ID.

The driver's update_access() now returns access_keys as a
dictionary with access rule ID and access key as key, value
pairs. This would be useful once Manila can store the
access_keys in its DB and expose them to the user.

Partially Implements: bp cephfs-native-driver-enhancements
Change-Id: I49782d62c0a8382d985b9b08612cf5bc394837ae
2016-08-12 14:08:57 +05:30
Jenkins
4a9a07ea9f Merge "cephfs_native: add read-only share support" 2016-08-12 05:58:51 +00:00
Jenkins
b280413d2c Merge "Fix concurrent usage of update_access method for share instances" 2016-08-12 02:07:35 +00:00
Jenkins
d96ce2aa08 Merge "HPE3PAR make share from snapshot writable" 2016-08-11 22:55:03 +00:00
liujiong
c2bf4615c7 TrivialFix: Change LOG.warn to LOG.warning
logging.warn is deprecated in Python 3.
https://docs.python.org/3/library/logging.html#logging.warning

Change-Id: I702460a4535eab6ee6719a06f60c6f47daa3b199
2016-08-12 00:04:31 +08:00
zengyingzhe
5ea4911794 Fix the broken UT of huawei driver for py34/35
The cause of failing unit tests is a bug in huawei driver.
When huawei driver logins to backend, it reads username/password from
huawei configuration file. If the username/password are configured as
plain text, huawei driver'll encode them and overwrite the encoded text
to the configuration file.

The encoding logic code is like this:
  six.text_type(base64.b64encode("***"))

For py27, this code works fine. However, for py34, this text_type
converting adds some extra words to result unicode string, like
"b'***'"('***' is the actual encoded result string).
Once driver reads the username/password again, it'll get the incorrect
text and then fail while jsonutils.dumps.

All the failed unit tests tried to call login twice, and triggered the
error condition said above.

This patch is just a workaround, because those failed tests actually
no need to login twice, the redundant login calls are removed.

Another patch will be commited to fix the problem thoroughly in huawei
driver.  Bug https://launchpad.net/bugs/1612149 has been raised for
that work, and will also analyze what changed to trigger this issue
only recently.

Change-Id: Ia6bf7bbb9ffb9644085bbdf4f5576f09215a877f
Closes-Bug: #1612149
2016-08-11 15:53:05 +00:00
Alyson Rosa
9a178f5254 Add dedupe report in HNAS driver
HNAS backend has support for enabling dedupe in file systems. This
commit adds a report for this capability in Manila HNAS driver.

DocImpact
Closes-Bug: #1610956
Change-Id: I6f83da1e51cfdcd8d20b607619c131d13f9e513f
2016-08-11 09:39:33 -03:00
Ramana Raja
0f596c55df cephfs_native: add read-only share support
Add read-only share support for cephfs_native driver
using CephFSVolumeClient's enhanced authorize() interface.
Ensure backwards compatibility with older version of
CephFSVolumeClient by checking it's version attribute, or
lack thereof.

The support for read-only authorize() was added in
CephFSVolumeClient with the following commits in Ceph:

Master branch:
https://github.com/ceph/ceph/commit/011ea5e7fb35ee0

Jewel branch:
https://github.com/ceph/ceph/commit/2cd3ed8a59786be

Change-Id: I29eb45104c04da1706c3978441babe9c4a52ca02
DocImpact
Partially-Implements: bp cephfs-native-driver-enhancements
2016-08-11 14:58:47 +05:30
Jenkins
e7f62b11ef Merge "Updated from global requirements" 2016-08-10 15:52:00 +00:00
Jenkins
4b603499f0 Merge "Fix KeyError on err in unit test" 2016-08-10 12:06:28 +00:00
OpenStack Proposal Bot
1e8e33f521 Updated from global requirements
Change-Id: Ieb20be0f6d05dd43ada90deaee647bd793f823bf
2016-08-10 11:34:27 +00:00
Gaurang Tapase
a91fa6e154 Refactor GPFS driver for NFS ganesha support
Spectrum Scale supports NFS ganesha through CES protocol services. This
change replaces the current NFS ganesha support with the Spectrum Scale
CES infrastructure.

Implements: blueprint gpfs-ces-support

Change-Id: I8eb307c19761788ea71c15c889794f8b5f110253
2016-08-10 04:47:20 -04:00
Jenkins
bbe36a9ec1 Merge "Add support for CIFS shares in HNAS driver" 2016-08-10 03:30:51 +00:00
Clinton Knight
d42b3f801c NetApp cDOT driver configurable clone split
Define a NetApp extra spec that is used to define a share type
that selects whether an initial clone split will be processed
as part of the create-from-snapshot workflow.

Change-Id: I7370f8342b8a5a10861e6e8080555959b0c88d62
Implements: blueprint netapp-cdot-clone-split-control
2016-08-09 18:36:15 +00:00
Clinton Knight
ead05120ab NetApp cDOT multi-SVM driver configurable NFS versions
A customer has requested the ability to selectively enable NFS versions
3, 4, and 4.1 in the cDOT multi-SVM drivers. This can be accomplished
via a config option.

Change-Id: Ia16a3bde81568096c118d61e808614d630616d0d
Implements: blueprint netapp-cdot-configure-nfs-versions
2016-08-09 18:35:19 +00:00
Jenkins
5141448bff Merge "NetApp cDOT vserver deletion fails if no lifs present" 2016-08-09 18:04:49 +00:00
Alyson Rosa
dfb9e587b1 Add support for CIFS shares in HNAS driver
Updating Manila Hitachi HNAS driver to support shares using CIFS protocol.
It accepts 'user' as access type and both rw and ro as access level.

Change-Id: I18fd5afcea6f91d870bbfc256c71a92aad014c91
Implements: blueprint hnas-driver-cifs-support
2016-08-09 10:11:30 -03:00
zhongjun
c17d23a40a Fix KeyError on err in unit test
Add error info in EMCVnxXMLAPIError.

Change-Id: I3cab228d5fd61c1f71662dddde9e36a76f7429d0
Closes-Bug: #1611262
2016-08-09 16:33:21 +08:00
Valeriy Ponomaryov
d878826cf3 Fix concurrent usage of update_access method for share instances
In mitaka, update_access merged with a known concurrency issue.
This concurrency has been randomly failing in our CIs. This change
adds a lock mechanism to prevent that, while rules are being removed
by a thread, a parallel thread adds back or handle the same rules
that are being removed.

Also, a late mitaka update_access patch [1] broke share migration access
rules consistency, thus leaving stale access rule data on share server
that hosted the share prior to its migration. This patch addresses this
by preventing the refresh mechanism from adding back rules
that are removed.

[1] I0f863cbae4d8af0660114161deda7bf7aa60d71d

Change-Id: Ief3b15eefc0fc325a2a5418fc7ac2724c315cc21
Co-Authored-By: Rodrigo Barbieri <rodrigo.barbieri2010@gmail.com>
Co-Authored-By: Goutham Pacha Ravi <gouthamr@netapp.com>
Closes-Bug: #1566815
Closes-Bug: #1609414
2016-08-08 20:10:57 -03:00
Clinton Knight
bcd2855e8e NetApp cDOT vserver deletion fails if no lifs present
If no LIFs are present on a vserver (such as can happen if an error
occurs during share creation in driver_handles_share_servers=True
mode), the vserver deletion fails due to a recent change. This makes
the deletion path more resilient.

Change-Id: I475b7b00cd5ba6bb111e2002bb8faa49e4878592
Closes-Bug: #1607029
2016-08-05 20:40:56 +00:00
Jenkins
426646ef63 Merge "[Tempest] Fix concurrency in "test_show_share_server" test" 2016-08-05 15:27:53 +00:00
Jenkins
8907c93740 Merge "[ZFSonLinux] Fix replicated snapshot deletion error" 2016-08-04 17:16:33 +00:00
Jenkins
636a7b37e8 Merge "Fix ZFSonLinux driver prerequisites setup" 2016-08-04 15:00:06 +00:00
Valeriy Ponomaryov
88fb70f92b Fix ZFSonLinux driver prerequisites setup
We call "apt-get upgrade" to apply changes related to ppa
of ZFS on linux. But "grub"-related packaged started making
dialog that hangs forever in case of automatic setup.
So, exclude "grub" related packages from update as redundant
for unblocking ZFSonLinux driver prerequisites setup.

Change-Id: Ibb94604710b0d4199825e770194655653c26bf89
Closes-Bug: #1609696
2016-08-04 13:28:37 +03:00
Jenkins
22b7b10335 Merge "Check for usage of same Cephx ID as manila service" 2016-08-03 19:56:55 +00:00
OpenStack Proposal Bot
e305b117db Updated from global requirements
Change-Id: If063561330e26c7cbf1b77a26006bdb538c60d32
2016-08-03 09:02:25 +00:00
mark.sturdevant
18e3fcda0e HPE3PAR make share from snapshot writable
Use share mounting and copying to allow the
3PAR to export writable shares created from
snapshots. This version works without the
data service driver data helper.

Implements: blueprint hpe3par-rw-snapshot-shares
Change-Id: I6a15db0dea09e72e9d1de3c817852e5165eec956
2016-08-02 16:53:27 -07:00
Dustin Schoenbrun
bd21193dec Check for usage of same Cephx ID as manila service
There is an issue that happens when access is granted to a manila share
using the same Cephx ID that Manila uses when it is communicating with
the Ceph backend (e.g. the identity specified by the cephfs_auth_id
configuration option). When a request is made to revoke access to the
share with that Cephx ID, the share will become stuck in the
"deleting" state.

This commit adds logic to the _allow_access method in the CephFS Native
driver that checks to see if the Cephx ID given is the same that Manila
is using for its communication with the Ceph backend. If that is the
case, the creation of the access rule will fail with an error.

APIImpact
DocImpact

Change-Id: Ida89b0061db1c8780a19475510b830d013a5c154
Closes-Bug: #1608592
2016-08-02 12:06:01 -04:00
Rodrigo Barbieri
4c2a69c7e1 Fix share migration test with snapshot support
Test 'test_migrate_share_with_snapshot_v2_5' validates that
share migration returns an error when a share has a snapshot
created, but to do so, it tries to create a snapshot, which
would fail in a backend that does not support snapshot.
This fix adds a validation that skips the test in this situation.

Change-Id: Icd6b04266ac2de83747b99295cb3538967922d65
Closes-bug: #1608293
2016-08-02 10:54:36 -03:00
Jenkins
00f8908984 Merge "Replaces httplib with requests lib in Quobyte RPC layer" 2016-08-01 18:08:47 +00:00