3867 Commits

Author SHA1 Message Date
Zhao Chao
29362a18a4 Remove support of creating volume from Nova.
Current Nova server volume support is broken. Nova also declared the
'os-volumes_boot' will be deprecated in the future. As creating volumes
by cinderclient has been supoorted for a long time, we could just drop
support of Nova server volume.

This patch also migrate to the new block_device_mapping_v2 parameter of
Nova servers creating API.

Closes-Bug: #1673408
Change-Id: I74d86241a5a0d0b1804b959313432168f68faf89
Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>
2018-02-09 14:30:50 +08:00
Zhao Chao
9e5186b95b Remove unused optparse code in trove.db
add_options in trove.db is not used for a long time, and this is the
same situation fofr optparse in python 2.7, so we can safely remove
this part from trove.db.

Closes-Bug: #1553030
Change-Id: I17228eed5c122bce49ce80ec665fe73d6caa1e04
Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>
2018-02-07 17:04:10 +08:00
Zuul
cdc7b37cae Merge "Zuul: Remove project name" 2018-02-07 05:13:10 +00:00
James E. Blair
e8cdc26f42 Zuul: Remove project name
Zuul no longer requires the project-name for in-repo configuration.
Omitting it makes forking or renaming projects easier.

Change-Id: Id890fde91a7e2b3ec9a6cf5ebe540d4fd65938bc
2018-02-05 23:43:27 -08:00
Zuul
e8df4126f5 Merge "Update the validation template for postgresql" 2018-02-04 04:56:03 +00:00
Zuul
1c51017ade Merge "Unable to grow/shrink Vertica 9.x cluster" 2018-02-03 19:24:19 +00:00
Zuul
d8ae6464a8 Merge "Unable to perform backup on DB2 instance" 2018-02-02 23:18:22 +00:00
Zuul
692100db17 Merge "Accept the IBM DB2 license during the DIB process" 2018-02-02 23:04:18 +00:00
Gaetan Trellu
4d747a997f Unable to grow/shrink Vertica 9.x cluster
During the Vertica cluster growing/shrinking,
the "update_vertica" command tries to get AWS
metadata even if --ignore-aws-instance-type is
specified.

The only way to avoid the "_get_macs error" is to
define --ignore-install-config option.

This is very similar to this bug[1] but this time
this for the "trove cluster-grow" and "trove
cluster-shrink" commands.

[1] https://bugs.launchpad.net/trove/+bug/1745493

Change-Id: I35f2035039f72b3aa2d9beb665096d4fb57e1c4c
Closes-Bug: #1747050
2018-02-02 16:12:20 -05:00
Zuul
4b95da49cb Merge "Improve Vertica 9.x support" 2018-02-02 18:13:38 +00:00
Gaetan Trellu
c334c5e46d Accept the IBM DB2 license during the DIB process
During the DB2 installation, the db2_install
process asks a question about the license. Disk
Image Builder will hang until "yes" or "no" is
manually entered.

db2_install script provides the "-y" option to
accept automatically the license.

From db2_install help:
  Specifies that you have read and agreed to the
  license agreement file in the db2/license
  directory on the CD. This parameter is mandatory
  when -n is specified.

Change-Id: I8a8330adc41cbed60c8472f925b10cf816aed44e
Closes-Bug: #1747031
2018-02-02 11:12:02 -05:00
Zuul
9a6f476785 Merge "[api-ref] Add sections for instance logs." 2018-02-02 11:48:32 +00:00
Zuul
278c100240 Merge "Remove hardcoded version in DB2 install path" 2018-02-02 04:51:20 +00:00
Gaetan Trellu
770e311075 Remove hardcoded version in DB2 install path
The DB2 path needs to be changed to something
basic and not using a version number because we
don't want to update the code every time than a
new DB2 version is released.

Updated DB2 version from 10.5 to 11.1, version
10.5 is no more available on IBM website.

Closes-Bug: #1746351
Change-Id: I4fd7c66c3cd5ff8d540e994ada979b59c7def35e
2018-02-01 12:41:48 -05:00
Gaetan Trellu
3bc8a63c33 Improve Vertica 9.x support
During the Vertica installation, the install script try to get AWS
metadata even if --ignore-aws-instance-type is specified.

The only way to avoid the _get_macs error is to define
--ignore-install-config option.

During the cluster creation, if the process is too long, Vertica
ask a question:
  Do you want to continue waiting? (yes/no) [yes]

From the adminTools documentation there is no non-interactive or
timeout options. The only way to have this question answered is
to run "echo yes | " before the "adminTools -t create_db" command.

The only available version from Vertica website is 9.0.1.

Closes-Bug: #1745493
Change-Id: I94472082fac606f4ff14f26c2ca2b620ef0a3bbb
2018-02-01 12:32:38 -05:00
Zuul
3e88cea5f4 Merge "Revert Cassandra version to 2 on ubuntu element" 2018-02-01 06:51:13 +00:00
Pierre Blanc
902bf78128 Update the validation template for postgresql
Add some configuration options on valuation rules file,
these options are availables from the release 9.5 and 9.6

New options from 9.5:
 - gin_pending_list_limit
 - idle_in_transaction_session_timeout
Changelog:
https://www.postgresql.org/docs/10/static/release-9-5.html

New options from 9.6:
 - log_min_duration_statement
 - backend_flush_after
 - bgwriter_flush_after
 - checkpoint_flush_after
 - force_parallel_mode
 - parallel_setup_cost
 - parallel_tuple_cost
 - replacement_sort_tuples
Changelog:
https://www.postgresql.org/docs/10/static/release-9-6.html

Closes-bug: #1745238
Change-Id: I89d793ccc7fa43deb3c1da7b23ce10cdf1e85c4d
2018-02-01 02:20:17 +00:00
Gaetan Trellu
932c6756e3 Unable to perform backup on DB2 instance
models.DatastoreSchema() needs to be initialized
with a database name.

This change fix the backup on DB2 instance

Change-Id: I95a9c60cd2406d4aa3b6ee52c654b2590a8d7e03
Closes-Bug: #1746626
2018-01-31 19:23:10 -05:00
jiansong
21dcb414e5 Fix gate error
Looks like SQLAlchemy in version 1.2.x checks if the boolean value
is None, True, False, 1, or 0. We used a "1" in our test, which
does not seem to meet the requirements. In the meantime, if we
change it to 1 here, our function section needs to be changed
as well.

Change-Id: I8df2118fee12fd9dd02caf96a23bc59652efbed7
2018-01-31 01:51:18 -08:00
Zhao Chao
e4f181e424 [api-ref] Add sections for instance logs.
Change-Id: I3b0eb2103c89610ec494ac33407e8a7969af1164
Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>
2018-01-29 11:01:34 +08:00
Zuul
393c5f8c00 Merge "Updated from global requirements" 2018-01-27 22:12:39 +00:00
Zuul
67c9ed395e Merge "Add innodb rules for mysql validation template" 2018-01-27 19:19:23 +00:00
Pierre Blanc
c4ac70a428 Add innodb rules for mysql validation template
Add some nodb configuration options on valuation rules file,
these options are availables from the release 5.6 and 5.7

https://dev.mysql.com/doc/refman/5.6/en/innodb-parameters.html
https://dev.mysql.com/doc/refman/5.7/en/innodb-parameters.html

Closes-bug: #1745477
Change-Id: I2636f4fae06e50be9cfee1a344b3d1f094b2173d
2018-01-26 16:05:39 -05:00
Pierre Blanc
c1b82ffa9c Revert Cassandra version to 2 on ubuntu element
The element is configured to use version 3 of cassandra, unfortunatly
trove is actually not compatible with version 3.

Closes-Bug: #1745056
Change-Id: Ic22202eeae6f404433a84def8cf5da0e5dc28c7b
2018-01-26 11:47:15 -05:00
Zuul
0781e2972d Merge "[api-ref] Update style and instances api." 2018-01-26 11:31:06 +00:00
Zuul
d5186ca06f Merge "Fix Cassandra element" 2018-01-26 06:10:47 +00:00
Luke Browning
2ae9da7623 Fix Cassandra element
The pip command was not installed.  Added a couple of
prerequisites (snappy, Cython) and db management package.
The cassandra-tools package provides commands for enabling
and disabling incremental backup, snapshots, and many other
features.  It is provided by the cassandra community.

Change-Id: If0f807878d6f3da17e33bc9e40ecb9563de61a25
2018-01-25 18:18:07 -06:00
Luke Browning
264f8be347 Change file permissions on element script
Needs to be executable to run

Change-Id: I1302d8ea805f3dc023ef7224ed4aa9b4d06ff371
2018-01-25 16:13:18 -06:00
Zhao Chao
b0577ae97e [api-ref] Update style and instances api.
Doc style:
* use tildes for heading 2 (following the rst convention);
* break source lines exceeded 79 characters (rst convention);
* remove unneccessary blank lines:
  * 4 blank lines between sections;
  * 2 blank lines between sub-sections;
  * 1 blank line between paragraphs in a section/subsection;
  * no blank lines at the bottom of a source file.
* add a space after commas in the middle of a line;

Instances API:
* change the order to match the description at the begin;
* add "Update instance name";
* add "Upgrade datastore version".

Change-Id: I3520e42f6ad97cb30632cf05241cec316409c9be
Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>
2018-01-25 22:55:13 +08:00
Zuul
fd5ad7f112 Merge "Use neutronclient to get networks." 2018-01-25 10:06:06 +00:00
Zuul
19b70eb8d7 Merge "[api-ref] Add fault names for the error response codes" 2018-01-25 08:09:54 +00:00
Zuul
0cf77d4294 Merge "Remove log translations" 2018-01-25 07:46:19 +00:00
Pierre Blanc
4d6345a433 Use neutronclient to get networks.
Trove now uses novaclient v2, this patch removes novaclient 1.1 calls.

Closes-bug: #1744059
Change-Id: Id7f626cd4ba53dbbb675d38e4dd27db95405f249
2018-01-24 21:39:16 -05:00
Zuul
808182b56c Merge "Missing element-deps files for xenial" 2018-01-25 01:42:17 +00:00
shangxiaobj
e54c46e312 [api-ref] Add fault names for the error response codes
Error response codes with fault names will be easier for understanding.

Change-Id: I5970cb6d40cf5793f024fd5d46b0da8f24bee0d6
2018-01-25 00:25:55 +00:00
Zhao Chao
2fd8c66f64 Remove log translations
According to discussions on the ML, log messages should not be
translated any more. This patch also:
* removes all usage of _LI, _LW, _LE, _LC;
* updates log translation hacking rule.

ML discussions:
http://lists.openstack.org/pipermail/openstack-i18n/2016-November/002574.html
http://lists.openstack.org/pipermail/openstack-dev/2017-March/113365.html

The original commit messages are kept as following to make a historic
note:

remove unwanted log translations

recent discussions on the ML have led to the decision to eliminate all
translations for messages that are destined for log files but retain
them for messages that are going to be returned as exceptions and
potentially shown to end users via an API. see [1], [2].

This change does that as follows.

1. If a string is being used to generate an exception, it will still
be translated. Still Trove used both _LE and _ for these translations,
there are some cases where _LE has been simply changed to _, and not
removed.

2. If a string is used for a logging message, remove the use of _,
_LE, _LW, _LI.

Also, I have long felt that we have had a creep of checks in the pep8
tests that apparently make the code easier to read. I strongly believe
that these kinds of "easier to read" things make sense if they are
followed across all projects and not just gratuitously added one
project at a time.

I've taken this opportunity to reduce the merge mess caused by this
change, to sync up our ignore flags with a long list of ignores from
Nova. When they made the change for removing log translation, they
could do it in an automated-way like I have because they didn't have
to deal with under and overindented lines for visual edit (E127). Same
for Cinder.

Changes 448443 [3] and 447839 [4] were inadequate because they only
addressed a little part of the problem, namely removing the use of
_LE, _LI, and _LW, and I think this is a change we don't need to
dribble in a few files at a time. The changes are straightforward and
should be taken in a single lump to make it easy to deal with the
merges coming.

[1] http://lists.openstack.org/pipermail/openstack-operators/2017-March/012887.html
[2] http://lists.openstack.org/pipermail/openstack-dev/2017-March/113365.html
[3] https://review.openstack.org/448443
[4] https://review.openstack.org/447839

Co-Authored-By: Amrith Kumar <amrith@amrith.org>
Co-Authored-By: Valencia Serrao <vserrao@us.ibm.com>
Change-Id: I5f86c982469e625997fc8bd15c6fae0fc77a8c64
2018-01-24 17:21:26 +00:00
Zuul
a70d6b9cbe Merge "Fix api exception with unicode tenant name." 2018-01-24 17:09:41 +00:00
Zuul
bd9b36bdf4 Merge "Remove checkpoint_segments validation rules" 2018-01-24 03:07:10 +00:00
OpenStack Proposal Bot
8c42942216 Updated from global requirements
Change-Id: I875406e1a64dc9f2ed04e6bf3721daf803254f3f
2018-01-24 01:40:25 +00:00
Zuul
e6164ef468 Merge "Adding missing dependencay" 2018-01-24 01:26:26 +00:00
Zuul
08ee487b0b Merge "Fix a error exception code" 2018-01-24 00:04:44 +00:00
Manoj Kumar
3934e301ac Missing element-deps files for xenial
The dependency files for cassandra, couchbase and couchdb
were missing. Added them.

Change-Id: Ib7684dabe41f505c34a598678037cebb4526cae0
2018-01-23 22:38:25 +00:00
Gaetan Trellu
9a20f6154b Remove checkpoint_segments validation rules
The checkpoint_segments option has been deprecated in
PostgreSQL 9.5.

Change-Id: Ibc879c0733fb2312d466c592cac2c446fcbf7657
Closes-Bug: #1745034
2018-01-23 16:38:10 -05:00
Manoj Kumar
61832ea5e0 Adding missing dependencay
For percona on xenial, the element-deps file was missing.

Change-Id: I1e44986a5caaab8ddf0a2891a3d692d6f4684153
2018-01-23 20:08:50 +00:00
ghanshyam
51883d9ca9 Remove use of unsupported TEMPEST_SERVICES variable
TEMPEST_SERVICES global variable is not supported
by devstack since long back.
- I380dd20e5ed716a0bdf92aa02c3730359b8136e4
- I9c24705e494689f09a885eb0a640efd50db33fcf

Service availability of tempest known services will be
set by devstack with local check.
- I02be777bf93143d946ccbb8e9eff637bfd1928d4

This commit removes the unused TEMPEST_SERVICES setting
Related-Bug: #1743688

Change-Id: Iccbc833d821a2d7b2bc34860170ce1817fbecead
2018-01-23 16:27:42 +03:00
Zhao Chao
08ea56b21c Fix api exception with unicode tenant name.
There are a lot request debug logging in Trove, when some values of
headers are encoded in utf8, UnicodeEncodeError will be raised by
webob.Request. Override how webob.Request is represented will fix.

Closes-Bug: #1720121

Change-Id: I91683b8dd24262b0f643e8d2bc7886a7c03be40a
Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>
2018-01-23 20:06:40 +08:00
Zuul
de547c2e71 Merge "Unable to build cassandra images" 2018-01-23 10:02:22 +00:00
jiansong
6770f99f47 Fix a error exception code
403 should be representative of HTTPForbidden ,not
HTTPUnauthorized, it should be a paste error

Change-Id: I1e20f88de57f1338eb3fdb76eb6368fc752645a9
2018-01-22 19:38:11 -08:00
Zuul
980577ee5b Merge "Always kill all child processes when backup runner exits." 2018-01-23 01:19:10 +00:00
Zuul
19253e2c89 Merge "Add missing permission on 10-fix-mycnf for Percona" 2018-01-22 21:25:45 +00:00