3175 Commits

Author SHA1 Message Date
Thomas Bechtold
7578ad2df2 Remove enable_v1_api and enable_v2_api config opts
Both options are not used in the code and the help text already
mentioned that the variables will be removed.

Change-Id: I4b90080dde789b772323e1d93d5a08c4d9f342f5
2016-08-23 08:27:22 +02:00
Alex O'Rourke
5e0c233cac 3PAR: Add update_access support
This patch adds support for update_access, a required feature for
the Newton release. allow_access and deny_acess are removed as well.

Implements: blueprint hpe3par-update-access
Change-Id: Ibe908dca68e65e2bad86afe60c73b470e9ff4e44
2016-08-22 08:54:01 -07:00
Ramana Raja
0d4f2ee4e0 add access_key to share_access_map
For backends with internal authentication system,
e.g. Ceph, that return ``access_key`` (credential) for
client identities that are granted share access:

* Retrieve ``access_key`` as return value of driver's
  update_access()

* Store ``access_key`` in ShareAccessMapping model

* Expose it in access_list API

APIImpact

DocImpact

Partially implements bp auth-access-keys

Co-Authored-By: John Spray <jspray@redhat.com>

Change-Id: I486064f117cf3001dba7735ca92a7d89aee3ce5b
2016-08-22 20:41:19 +05:30
tpsilva
9814b50bad Add missing filter function in HSP driver
HSP driver merged without a filter function. Since the backend
does not support shares smaller than 128GB, this filter function
is needed so the scheduler does not choose its hosts for shares
of these sizes. This patch adds the default filter function to
the driver.

Change-Id: Ia00fb9540ac45992326e1d07c41a83a1d8a22a1e
Closes-bug: #1615616
2016-08-22 10:18:38 -03:00
Jenkins
ef9e231b19 Merge "Fix fallback share migration with empty files" 2016-08-19 22:14:55 +00:00
Graham Hayes
8210bf5310 Get ready for os-api-ref sphinx theme change
Change-Id: I1c13e4d92d0629361affb5dcd8ae793b33b33c9b
2016-08-19 16:44:03 +01:00
Rodrigo Barbieri
e4ddb090ae Fix fallback share migration with empty files
Fallback share migration fails with empty files. This patch fixes it
by performing additional checks to address this specific scenario.

Change-Id: I36d59740b4e52005e6025e5df5989bf55d6bade4
Closes-bug: #1613713
2016-08-19 12:11:20 -03:00
tpsilva
c314c3f400 Rename and move HNAS driver
Renamed HDS mentions on HNAS driver to Hitachi and moved the driver to
its own folder.

DocImpact
Change-Id: I03318a6e143e40b6f9186b58d47ef0618a6d152d
Implements: blueprint hnas-rename
2016-08-19 09:15:09 -03:00
OpenStack Proposal Bot
80330521de Updated from global requirements
Change-Id: I46dab2a829d2493f6887f1d6db55006770c1bb32
2016-08-19 09:05:01 +00:00
Jenkins
04d8ed79a1 Merge "Add dedupe report in HNAS driver" 2016-08-19 05:43:52 +00:00
Marc Koderer
78e10bc060 Add neutron driver for binding
Add new neutron plugin which enables port bind actions for network
fabrics. This driver waits until all ports are in state "active"
and sets the binding host flag. Default vNIC type is set to
"baremetal" in order to benefit from the code already in place for
Ironic. It's also possible to switch to 'normal' which assumes an
neutron agent in place.

The feature can be tested using the docker driver.

DocImpact

Co-Authored-By: Daniel Gonzalez <daniel@gonzalez-nothnagel.de>
Partially-Implements: bp manila-hpb-support

Change-Id: I3156d7468d48f84f1b46885780a2426f9b99a387
2016-08-17 15:20:11 +02:00
Jenkins
bb767e8ece Merge "Fix sample config generation for cinder, nova and neutron opts" 2016-08-17 00:04:48 +00:00
Jenkins
ee856954ed Merge "manila_tempest_tests: fix exception messages" 2016-08-16 19:50:39 +00:00
Jenkins
0a87493573 Merge "Add Hitachi HSP driver" 2016-08-16 17:15:28 +00:00
Thomas Bechtold
5c95e5cc10 Fix sample config generation for cinder, nova and neutron opts
While generating a sample config with "tox -egenconfig", some options
for the Nova, Cinder and Neutron client are not added to the [nova],
[cinder] and [neutron] section. I.e. "api_insecure" is not available for
all sections. Register the config options under the correct group while
generating the sample config.

Closes-Bug: #1613303
Change-Id: If54fd42f7a06c159bcb6df5f684dc1211a9b91e9
2016-08-16 08:45:16 -04:00
tpsilva
2a7d480d01 Add Hitachi HSP driver
This patch adds the Hitachi HSP driver.

Co-Authored-By: Marcus V R Nascimento <marcusvrn@gmail.com>

DocImpact
Implements: blueprint hsp-driver
Change-Id: Ie3028cbff56873721dc51ff4d7fccf7fb7e99611
2016-08-16 08:44:27 -03:00
Ramana Raja
641c74cf4e manila_tempest_tests: fix exception messages
TrivialFix

Change-Id: I6113e1663027535c3fe5b3b129bf270cebbad490
2016-08-16 17:09:29 +05:30
Jenkins
ea9748fa4b Merge "In-tree Install Guide" 2016-08-16 08:32:34 +00:00
Jenkins
fb264a4e5a Merge "Tox Upper Constraints - strip out reinstalls for remaining jobs" 2016-08-15 22:14:48 +00:00
Jenkins
2f047eb25a Merge "Container driver" 2016-08-15 21:04:11 +00:00
Jenkins
51a93d1ca8 Merge "NetApp cDOT: Apply network MTU to VLAN ports" 2016-08-15 16:26:11 +00:00
Alexey Ovchinnikov
ddf960a2d9 Container driver
This driver exploits a Docker container as a share server instead
of a virtual machine. The container acts as a CIFS server
and shares logical volume attached to it. The volume gets created
simultaneously to the container on a host in a volume group
specified by the user.

DocImpact
Change-Id: I711813a2022d765ab7a70ed670e34f68f9cf1399
Implements: blueprint manila-container-driver
2016-08-15 16:30:23 +03:00
Goutham Pacha Ravi
33374626db Tox Upper Constraints - strip out reinstalls for remaining jobs
releasenotes and venv tox jobs had redefined the install_command
to reinstall any packages from requirements/test-requirements files.

Since Infra started supporting constrained requirements for these
jobs as well, we can drop the reinstall command.

Ref:
http://lists.openstack.org/pipermail/openstack-dev/2016-August/101474.html

Change-Id: Ib4b8c6cef22a9911030c2e3e3f5281e7e22575fc
2016-08-14 11:52:05 -04:00
Clinton Knight
2d4e30bd21 NetApp cDOT: Apply network MTU to VLAN ports
Through change I9b4efae620ec9f6790547c8fffc58872d43277f5
we added support in manila to request the Maximum Transmission
Unit (MTU) from the network provider (neutron, standalone, etc.).

To honor this MTU, the NetApp cDOT driver needs to apply it
to the VLAN ports (via the broadcast domain) that the LIFs of the
newly created share servers are assigned to.

Co-Authored-By: Goutham Pacha Ravi <gouthamr@netapp.com>
Depends-On: I9b4efae620ec9f6790547c8fffc58872d43277f5
Change-Id: Ia01d982c7328feff292d54588d33a16df705f81e
Implements: blueprint netapp-cdot-honor-mtu-size
2016-08-14 15:35:15 +00:00
Jenkins
d43c8198a7 Merge "Fix typo in glusterfs driver comment" 2016-08-14 14:16:04 +00:00
Jenkins
647d133d29 Merge "[dev-docs] Changed small case letters to capital" 2016-08-14 05:11:54 +00:00
liujiong
fda0b07e9d Fix typo in glusterfs driver comment
TrivialFix

Change-Id: I9701c363eca58ca79846689cb480088c0859674c
2016-08-14 01:39:25 +08:00
Jenkins
a3087b309a Merge "Add MTU information in DB and API" 2016-08-13 01:47:21 +00:00
Jenkins
1143406ed4 Merge "NetApp cDOT driver configurable clone split" 2016-08-12 22:26:50 +00:00
Jenkins
ec3b72ee49 Merge "NetApp cDOT multi-SVM driver configurable NFS versions" 2016-08-12 22:20:28 +00:00
Jenkins
faef310caa Merge "cephfs_native: enhance update_access()" 2016-08-12 18:41:32 +00:00
Jenkins
1923f44aaa Merge "Updated from global requirements" 2016-08-12 17:04:09 +00:00
Prudhvi Rao Shedimbi
ff4a33aefb [dev-docs] Changed small case letters to capital
Changed small case letters to capital case at appropriate
places like beginning of the line.

TrivialFix

Change-Id: Ib7d219af2e531a8bb315377a177e233863759c5c
2016-08-12 16:13:08 +00:00
Jenkins
42843b0e8a Merge "TrivialFix: Change LOG.warn to LOG.warning" 2016-08-12 14:56:58 +00:00
Marc Koderer
e3afcd751f Add MTU information in DB and API
MTU value can be different for each neutron network.
E.g. for high-performance use-cases it's very important to also
support MTU's with jumbo frames.

This patch exposes this information to the drivers. Each driver
should setup its resources accordingly.

The tempest test actually just covers the api change. Better coverage will
be added when the container driver lands.

APIImpact
DocImpact

Change-Id: I9b4efae620ec9f6790547c8fffc58872d43277f5
Implements: bp add-network-mtu
Related-Bug: #1612528
2016-08-12 15:14:14 +02:00
Jenkins
6bae3006d9 Merge "Refactor GPFS driver for NFS ganesha support" 2016-08-12 13:02:40 +00:00
Goutham Pacha Ravi
dfbe3ea418 In-tree Install Guide
The OpenStack install guide team has recommended that projects
that are not part of the starter-kit:compute [1] (and a few other projects
like Cinder and Horizon) maintain their install guide in-tree. [2]

[1] http://governance.openstack.org/reference/tags/starter-kit_compute.html
[2] http://git.openstack.org/cgit/openstack/docs-specs/tree/specs/newton/project-specific-installguides.rst

Change-Id: I2b49fcfd99b3be40bb1ae7d7b8348abdb5b58b90
Co-Authored-By: Denis Cavalcante <dencaval@gmail.com>
Implements: blueprint manila-in-tree-install-guide
Partially-implements: blueprint projectspecificinstallguides
2016-08-12 08:06:38 -04:00
OpenStack Proposal Bot
1c1107d811 Updated from global requirements
Change-Id: I7268c6c9920db89583292e9a76c0fa7095285e4b
2016-08-12 08:51:43 +00:00
Ramana Raja
08ffd6bdb5 cephfs_native: enhance update_access()
During recovery/maintenance mode, the driver applied all the
rules it was expected to sync. It couldn't e.g., remove the
already existing but unwanted access rules from the backend.
This was because CephFSVolumeClient, the interface to Ceph
backend, did not have the ability to fetch the existing
access rules from the backend.

Since the following commits in Ceph,
master branch, https://github.com/ceph/ceph/commits/1c1d65a45f4574
Jewel branch,  https://github.com/ceph/ceph/commits/e1eb8afea9f202
the CephFSVolumeClient is versioned and can list the existing
access rules. Use this to more faithfully implement update_access()
and ensure backwards compatibility with earlier versions of
CephFSVolumeClient.

Also, when authorizing access for a ceph auth ID using
CephFSVolumeClient's authorize(), pass the project ID of the
share as an additional argument. This is required (since
the above mentioned commits) to retrieve the access key of
the ceph auth ID.

The driver's update_access() now returns access_keys as a
dictionary with access rule ID and access key as key, value
pairs. This would be useful once Manila can store the
access_keys in its DB and expose them to the user.

Partially Implements: bp cephfs-native-driver-enhancements
Change-Id: I49782d62c0a8382d985b9b08612cf5bc394837ae
2016-08-12 14:08:57 +05:30
Jenkins
4a9a07ea9f Merge "cephfs_native: add read-only share support" 2016-08-12 05:58:51 +00:00
Jenkins
b280413d2c Merge "Fix concurrent usage of update_access method for share instances" 2016-08-12 02:07:35 +00:00
Jenkins
d96ce2aa08 Merge "HPE3PAR make share from snapshot writable" 2016-08-11 22:55:03 +00:00
liujiong
c2bf4615c7 TrivialFix: Change LOG.warn to LOG.warning
logging.warn is deprecated in Python 3.
https://docs.python.org/3/library/logging.html#logging.warning

Change-Id: I702460a4535eab6ee6719a06f60c6f47daa3b199
2016-08-12 00:04:31 +08:00
zengyingzhe
5ea4911794 Fix the broken UT of huawei driver for py34/35
The cause of failing unit tests is a bug in huawei driver.
When huawei driver logins to backend, it reads username/password from
huawei configuration file. If the username/password are configured as
plain text, huawei driver'll encode them and overwrite the encoded text
to the configuration file.

The encoding logic code is like this:
  six.text_type(base64.b64encode("***"))

For py27, this code works fine. However, for py34, this text_type
converting adds some extra words to result unicode string, like
"b'***'"('***' is the actual encoded result string).
Once driver reads the username/password again, it'll get the incorrect
text and then fail while jsonutils.dumps.

All the failed unit tests tried to call login twice, and triggered the
error condition said above.

This patch is just a workaround, because those failed tests actually
no need to login twice, the redundant login calls are removed.

Another patch will be commited to fix the problem thoroughly in huawei
driver.  Bug https://launchpad.net/bugs/1612149 has been raised for
that work, and will also analyze what changed to trigger this issue
only recently.

Change-Id: Ia6bf7bbb9ffb9644085bbdf4f5576f09215a877f
Closes-Bug: #1612149
2016-08-11 15:53:05 +00:00
Alyson Rosa
9a178f5254 Add dedupe report in HNAS driver
HNAS backend has support for enabling dedupe in file systems. This
commit adds a report for this capability in Manila HNAS driver.

DocImpact
Closes-Bug: #1610956
Change-Id: I6f83da1e51cfdcd8d20b607619c131d13f9e513f
2016-08-11 09:39:33 -03:00
Ramana Raja
0f596c55df cephfs_native: add read-only share support
Add read-only share support for cephfs_native driver
using CephFSVolumeClient's enhanced authorize() interface.
Ensure backwards compatibility with older version of
CephFSVolumeClient by checking it's version attribute, or
lack thereof.

The support for read-only authorize() was added in
CephFSVolumeClient with the following commits in Ceph:

Master branch:
https://github.com/ceph/ceph/commit/011ea5e7fb35ee0

Jewel branch:
https://github.com/ceph/ceph/commit/2cd3ed8a59786be

Change-Id: I29eb45104c04da1706c3978441babe9c4a52ca02
DocImpact
Partially-Implements: bp cephfs-native-driver-enhancements
2016-08-11 14:58:47 +05:30
Jenkins
e7f62b11ef Merge "Updated from global requirements" 2016-08-10 15:52:00 +00:00
Jenkins
4b603499f0 Merge "Fix KeyError on err in unit test" 2016-08-10 12:06:28 +00:00
OpenStack Proposal Bot
1e8e33f521 Updated from global requirements
Change-Id: Ieb20be0f6d05dd43ada90deaee647bd793f823bf
2016-08-10 11:34:27 +00:00
Gaurang Tapase
a91fa6e154 Refactor GPFS driver for NFS ganesha support
Spectrum Scale supports NFS ganesha through CES protocol services. This
change replaces the current NFS ganesha support with the Spectrum Scale
CES infrastructure.

Implements: blueprint gpfs-ces-support

Change-Id: I8eb307c19761788ea71c15c889794f8b5f110253
2016-08-10 04:47:20 -04:00