Commit Graph

823 Commits

Author SHA1 Message Date
Janie Richling
06ff865d19 Allow DLO manifest to be updated when using post-as-copy
Currently when using fast-post, the manifest is updated with the given
'x-object-manifest' header on a POST.  If no such header is supplied,
then the manifest will change to a regular object.
This is not currently true when using post-as-copy.

This patch changes the DLO POST using post-as-copy behavior to match
that of using fast-post.  It was also documented that
'x-object-manifest' must be provided on a POST to a manifest file.

Change-Id: Ie1143ab1a2c8f8c21e258a36badbff5d947769d4
Closes-bug: 1612991
2016-08-21 00:09:09 -05:00
Jenkins
5e0178d75b Merge "Documantation enhancements of nice/ionice feature" 2016-08-19 08:36:40 +00:00
Peter Lisák
8bf2233b40 Documantation enhancements of nice/ionice feature
Based on comments from patch #238799.

Change-Id: I9455cf6dc7fd12fee62439ff3c5f3255287ab1be
2016-08-19 07:39:49 +02:00
Jenkins
c643c261d1 Merge "Improve doc for using container-sync with large objects" 2016-08-19 03:56:51 +00:00
Jenkins
4992c7d399 Merge "Change schedule priority of daemon/server in config" 2016-08-18 08:34:48 +00:00
Alistair Coles
cc2b2cf9c8 Improve doc for using container-sync with large objects
Clarify that synced segment container names must be the same
when syncing large objects.

Also add multipart-menifest query string option to API ref
for object GETs.

Change-Id: Ib2d2a1e6c1e5eff215fc75c2b49e7d6758b17b7e
Partial-Bug: #1613681
Closes-Bug: #1613316
2016-08-16 16:35:53 +01:00
Jenkins
9c859ccfee Merge "add reminder how to run debug func tests" 2016-08-15 08:35:14 +00:00
Jenkins
1d5048a293 Merge "Add encrypter and decrypter links to middleware.rst" 2016-08-11 23:26:44 +00:00
Nakul Dahiwade
7e2cb23f88 Grammer error : swift/doc/source/overview_ring.rst
Changed sentence: "Regions can be used to describe geo-graphically
systems characterized by lower-bandwidth"
To: "Regions can be used to describe geographical
systems characterized by lower-bandwidth"

Change-Id: I0f614a4c53dd31459f1b6297dd32a8c0f609d9ce
Closes-Bug: 1612302
2016-08-11 16:10:35 +00:00
Peter Lisák
ed772236c7 Change schedule priority of daemon/server in config
The goal is to modify schedule priority and I/O scheduling class and
priority of daemon/server via configuration.
Setting is optional, default keeps current behaviour.

Use case:
Prioritize object-server to object-auditor, because all user's requests
needed to be served in peak hours and audit could wait.

Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
DocImpact
Change-Id: I1018a18f4706daabdb84574ffd9a58d831e68396
2016-08-10 23:56:15 +02:00
Thiago da Silva
ddbab05094 add reminder how to run debug func tests
added comments on how to run in_process and specific
test cases

Change-Id: I485755996b15753323d30de09914d35e262fcedc
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2016-08-09 15:42:20 -04:00
Jenkins
4521eb6e2e Merge "Enable in-process func tests to optionally use encryption" 2016-08-01 21:14:18 +00:00
Jenkins
fc1ee6773c Merge "Add doc entry to check partition count" 2016-07-29 19:38:09 +00:00
Janie Richling
66520146cf Enable in-process func tests to optionally use encryption
Running functional tests in the in-process mode uses
the default value for the pipeline.  This patch adds support
to specify the SWIFT_TEST_IN_PROCESS_CONF_LOADER variable
to point to a labeled function that changes the proxy
configuration for the functional test.

The patch also adds a new tox environment
func-in-process-encryption
which runs with the environment variable
SWIFT_TEST_IN_PROCESS_CONF_LOADER=encryption

The motivation for this change is to put support in place for an
upstream CI job that will functionally test using encryption
middleware in the pipeline.  The gate job is proposed at:
https://review.openstack.org/#/c/348292/

Change-Id: I15c4b20f1d2be57ae21c69c614f6a9579145bee9
2016-07-28 14:19:48 -05:00
Jenkins
a2c548b2af Merge "Fix broken link in associated projects doc" 2016-07-28 12:36:32 +00:00
Alistair Coles
8bf28c869d Fix broken link in associated projects doc
Change-Id: I6f0cc1004a40e77345c641c0e5076f2f5dadb891
2016-07-28 11:09:48 +01:00
Jenkins
1717f2cbcb Merge "Add region in ring structure & deployment guide" 2016-07-28 02:20:16 +00:00
Jenkins
9501d9617c Merge "Document how to run a single functional test" 2016-07-27 10:46:05 +00:00
Jenkins
557b330c9b Merge "Mention SWIFT_TEST_DEBUG_LOGS in development guide" 2016-07-27 10:44:46 +00:00
Jenkins
f978133cfd Merge "Added quotes to example echo in swift-temp-url" 2016-07-26 18:57:08 +00:00
Alistair Coles
7cc2392611 Document how to run a single functional test
Change-Id: Icabc5a8316f5e8fd887bb42358ad03e9c43d0765
2016-07-26 18:14:06 +01:00
Alistair Coles
77e476376c Mention SWIFT_TEST_DEBUG_LOGS in development guide
Change-Id: If764de0a28f5afb858b3e892b35fe5fa147a0650
2016-07-26 17:48:48 +01:00
Ellen Leahy
7958638e8f Added quotes to example echo in swift-temp-url
If the curl command is used exactly as in the help, the ampersand
in the signature is interpreted as an operator and the curl
command breaks. I am aware of developers who have wasted a lot of
time because of this.

Change-Id: I6468c9a098b56db8242a2cf2c23b7a4857bd8574
2016-07-26 13:47:24 +00:00
Christian Schwede
699953508a Add doc entry to check partition count
An high or increasing partition count due to storing handoffs can have
some severe side-effects, and replication might never be able to catch
up. This patch adds a note to the admin_guide how to check this.

Change-Id: Ib4e161d68f1a82236dbf5fac13ef9a13ac4bbf18
2016-07-26 12:23:54 +02:00
Jenkins
4bb98bcfe6 Merge "Avoid docs warning: Duplicate explicit target name" 2016-07-22 02:54:13 +00:00
Mohit Motiani
90627f903a Add region in ring structure & deployment guide
Deployment guide does not talk about the region. Also, it does not
specify that regions and zones need to be ints.

This patch adds brief description about region and changes numbers
to int. Also, adds region in the document that talks about ring data
struture.

Change-Id: I04ce42fb3e5c1f08e7f7ff6be23482cee8bdeb71
Partial-Bug: #1583551
2016-07-12 15:18:56 +00:00
Jenkins
521ec6b9b1 Merge "Add region in swift-ring-builder add" 2016-07-08 23:12:39 +00:00
Mohit Motiani
54ed084234 Add region in swift-ring-builder add
In the swift deployment guide, region is missing from the syntax of
adding a new device to the swift-ring-builder.

This patch adds region in the syntax.

Change-Id: I43e247c92d461efd530c0f82ca3daddcb9e2ba5b
Closes-Bug: #1584127
2016-07-08 15:55:49 +00:00
Alistair Coles
ffaef489c6 Add encrypter and decrypter links to middleware.rst
Drive-by fix for crypto filter_factory test.

Add note to encryption doc to highlight that root secret
should not be changed (follow up on earlier review comment).

Co-Authored-By: Tim Burke <tim.burke@gmail.com>

Change-Id: I9776cddd4d045408325342983e285a00c992bfae
2016-07-08 11:50:55 +01:00
Nandini Tata
6f230c7ea0 Fixed inconsistent naming conventions
Fixed naming conventions of Keystone, Swift and proxy servers in
the docs.

Change-Id: I294afd8d7bffa8c1fc299f5812effacb9ad08910
2016-07-07 21:40:21 +00:00
Alistair Coles
bfc8c59a08 Add encryption package requirements to SAIO instructions
libssl-dev/openssl-devel are already listed in other-requirements.txt;
add them to installation instructions in the SAIO docs.

Change-Id: I3dc07213ff8dac1299d3eb68d3448a77e15c79af
2016-07-07 18:40:10 +01:00
Alistair Coles
9045f33869 Merge at-rest encryption feature into master
Co-Authored-By: Christian Cachin <cca@zurich.ibm.com>
Co-Authored-By: Mahati Chamarthy <mahati.chamarthy@gmail.com>
Co-Authored-By: Peter Chng <pchng@ca.ibm.com>
Co-Authored-By: Tim Burke <tim.burke@gmail.com>
Co-Authored-By: Thiago da Silva <thiago@redhat.com>
Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
Co-Authored-By: Jonathan Hinson <jlhinson@us.ibm.com>
Co-Authored-By: Samuel Merritt <sam@swiftstack.com>
Co-Authored-By: Janie Richling <jrichli@us.ibm.com>
Co-Authored-By: Hamdi Roumani <roumani@ca.ibm.com>
Co-Authored-By: Kota Tsuyuzaki <tsuyuzaki.kota@lab.ntt.co.jp>

Change-Id: I1d8b030b9c8f81a232da5d6f93f442e46e331af2
2016-07-01 00:34:33 -07:00
Alistair Coles
f36bc513c5 Add encryption overview doc
Include a note in container-sync docs pointing to specific
configuration needed to be compatible with encryption.

Also remove the sample encryption root secret from
proxy-server.conf-sample and in-process test setup. Remove encryption
middleware from the default proxy pipeline.

Change-Id: Ibceac485813f3ac819a53e644995749735592a55
2016-06-30 23:31:20 -07:00
Janie Richling
96a0e07753 Enable object body and metadata encryption
Adds encryption middlewares.

All object servers and proxy servers should be upgraded before
introducing encryption middleware.

Encryption middleware should be first introduced with the
encryption middleware disable_encryption option set to True.
Once all proxies have encryption middleware installed this
option may be set to False (the default).

Increases constraints.py:MAX_HEADER_COUNT by 4 to allow for
headers generated by encryption-related middleware.

Co-Authored-By: Tim Burke <tim.burke@gmail.com>
Co-Authored-By: Christian Cachin <cca@zurich.ibm.com>
Co-Authored-By: Mahati Chamarthy <mahati.chamarthy@gmail.com>
Co-Authored-By: Peter Chng <pchng@ca.ibm.com>
Co-Authored-By: Alistair Coles <alistair.coles@hpe.com>
Co-Authored-By: Jonathan Hinson <jlhinson@us.ibm.com>
Co-Authored-By: Hamdi Roumani <roumani@ca.ibm.com>

UpgradeImpact

Change-Id: Ie6db22697ceb1021baaa6bddcf8e41ae3acb5376
2016-06-30 23:31:15 -07:00
Alistair Coles
3ad003cf51 Enable middleware to set metadata on object POST
Adds a new form of system metadata for objects.

Sysmeta cannot be updated by an object POST because
that would cause all existing sysmeta to be deleted.
Crypto middleware will want to add 'system' metadata
to object metadata on PUTs and POSTs, but it is ok
for this metadata to be replaced en-masse on every
POST.

This patch introduces x-object-transient-sysmeta-*
that is persisted by object servers and returned
in GET and HEAD responses, just like user metadata,
without polluting the x-object-meta-* namespace.
All headers in this namespace will be filtered
inbound and outbound by the gatekeeper, so cannot
be set or read by clients.

Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
Co-Authored-By: Janie Richling <jrichli@us.ibm.com>

Change-Id: I5075493329935ba6790543fc82ea6e039704811d
2016-06-28 11:00:33 +01:00
Christian Schwede
029c2782dd Add swiftbackmeup to associated projects
Change-Id: I99f7a38d9b26605324408f1d200bf08da1e2772f
2016-06-27 14:38:04 +02:00
Kota Tsuyuzaki
29b8d2da20 Avoid docs warning: Duplicate explicit target name
When we add two (or more than) different links as same target name,
we need to set two underscore[1] instead of one. This avoids "Duplicate
explicit target name" warnings.

1:
http://docutils.sourceforge.net/docs/ref/rst/restructuredtext.html#hyperlink-references

Change-Id: I8a493e7a1deeece33ee1b3fb3f5c848f3cc31d06
2016-06-14 19:20:07 -07:00
Jenkins
11c5ef7d22 Merge "[Docs] Document prevention of disk full scenarios" 2016-06-08 21:51:02 +00:00
Thiago da Silva
886fa0822a update pyeclib and liberasurecode links
Change-Id: Ic6d04083618362778363fea1570caaa865e44557
Signed-off-by: Thiago da Silva <thiago@redhat.com>
2016-06-02 23:03:26 -04:00
Nelson Almeida
daae74ca65 Adding sorting_method to admin_guide
Change-Id: I1162f154e3a577a95f9f5ea0e0f723b7df5a4baf
2016-06-01 17:29:10 -03:00
John Dickinson
86e9e827ba add explicit HA info to the deployment guide
Change-Id: I7614952c523080fe50eaf839b54a8064439817ce
2016-05-31 11:27:43 -07:00
Jenkins
12022385fb Merge "Clarify overload best practices in admin guide" 2016-05-26 02:42:00 +00:00
Jenkins
9fd96966d0 Merge "Add dispersion --verbose example to admin guide" 2016-05-25 18:57:20 +00:00
Clay Gerrard
b52eccb3b1 Clarify overload best practices in admin guide
Change-Id: Ib7c08bdeab6374771bb8e2b05053e7e16973524d
2016-05-25 11:21:25 -07:00
Jenkins
b9e49ce636 Merge "Add ring-builder dispersion command to admin guide" 2016-05-25 08:14:20 +00:00
Christian Schwede
f1fd50723b Add dispersion --verbose example to admin guide
Change-Id: I5f9cacedde2a329332ccf744800b6f2453e8b28e
2016-05-25 09:53:33 +02:00
Matthew Oliver
b3ab715c05 Add ring-builder dispersion command to admin guide
This change updates the admin guide to point out the dispersion command
in swift-ring-builder and mentions the dispersion verbose table to make
it more obvious to operators.

Change-Id: I72b4c8b2d718e6063de0fdabbaf4f2b73694e0a4
2016-05-25 14:35:54 +10:00
Tim Burke
fb7a8e9ab7 Add links to mitaka install guides
Change-Id: I62331923751c521daded4468b5cc5f03655226bc
2016-05-24 13:38:43 -07:00
Jenkins
4a7731875b Merge "disable_fallocate also disables fallocate_reserve" 2016-05-19 23:13:15 +00:00
Matthew Oliver
876df35f84 disable_fallocate also disables fallocate_reserve
Currently when disable_fallocate is true it disables calling the
fallocate syscall, but it doesn't disable fallocate_reserve. This
patch fixes this.

This problem has caused functional tests to fail in our SAIOs, since
SAIOs have disable_fallocate set but the fallocate_reserve space free
checking was still being run creating 507 responses. This is thanks
to the change in fallocate_reserve default changing from 0 to 1%.

Because fallocate_reserve and disable_fallocate causes SAIO functional
tests to fail a section called 'Known Issues' has been added to the
SAIO developer documentation which includes a warning about
using fallocate_reserve on SAIOs.

Change-Id: I727bfb0861ea26fe2f16ad55f4d36ae088864d8f
2016-05-19 11:56:29 +10:00