1750 Commits

Author SHA1 Message Date
Zuul
3384d68c78 Merge "Ceph-Client: allow helm test to proceed with 80% of osds avialble" 2019-07-01 23:28:38 +00:00
Chinasubbareddy Mallavarapu
a20e7177c6 Ceph-osd: Fix static osd id to variable
This is to fix static osd id logic to variable as we have an issue
in our current logic.
this is happening only when we have file backed journals and
block backed data as shown below.

ex:

 storage:
    osd:
      - data:
          type: block-logical
          location: /dev/vdb
        journal:
          type: directory
          location: /var/lib/openstack-helm/ceph/osd/journal-one
      - data:
          type: block-logical
          location: /dev/vdc
        journal:
          type: directory
          location: /var/lib/openstack-helm/ceph/osd/journal-two

Change-Id: I36d08b1b7aa5925831a64c03259098f6c4753c3e
2019-07-01 12:34:46 -05:00
Chinasubbareddy Mallavarapu
961a58dada Ceph-Client: allow helm test to proceed with 80% of osds avialble
This is to adjust helm test logic to  proceed the deployment if 80% of
osds are up  and running in the cluster .

Change-Id: I128266fd374426f75928332690e275b7f0175318
2019-07-01 15:11:43 +00:00
Zuul
24841d6dea Merge "Adding hostname to the node details" 2019-06-29 16:39:09 +00:00
John Lawrence
27ef45017b Adding hostname to the node details
Change-Id: I558c100cbb70475d55122b194ef18287c76a68b3
2019-06-28 13:20:06 +00:00
Zuul
b37405dbe6 Merge "Ceph-Clients: Explicity set prom exporter params" 2019-06-27 16:58:52 +00:00
Zuul
d187f6d234 Merge "Ceph-Mgr: update how we set config params" 2019-06-27 16:51:18 +00:00
Pete Birley
57e1e3ce40 Ceph-Clients: Explicity set prom exporter params
Occasionally the default config can result in attempts
to bind to ipv6 which fail - so we explicity set the
host to ipv4.

Change-Id: I3c01ed0ef7c84cf779d88386c14f7c7bd2003310
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-27 14:03:58 +00:00
Zuul
d5655e95ea Merge "[Kibana] Add improvements to Selenium tests for Kibana" 2019-06-27 07:07:14 +00:00
Pete Birley
248df772fd Ceph-Mgr: update how we set config params
This PS updates the start script to use `config set`, rather
than `config-key set` which has been depricated in Mimic.

Change-Id: I97d0c4385b016d73aa362c0fc293d235b532810c
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-27 01:37:02 +00:00
Zuul
8edc3b4286 Merge "fix host-specific overrides incorrectly overwriting previous values" 2019-06-26 09:44:30 +00:00
Zuul
fd0952df1a Merge "Fluentd: Fix whitespace chomps for volumes and volume mounts" 2019-06-26 08:42:19 +00:00
Zuul
5e79f20c3e Merge "Add node selector to Ceph test pods" 2019-06-26 05:18:12 +00:00
Zuul
6565f8782c Merge "Gate: Store helm values for release" 2019-06-26 05:14:26 +00:00
Kabanov, Dmitrii (dk370c)
1db1ddf0ba [Kibana] Add improvements to Selenium tests for Kibana
This PS adds several fixes to Selenium tests (for Kibana) and adds
role which allows to collect the results.

Change-Id: If9fb5f50e395379fdd3ccc46e945a93606dcbabe
2019-06-25 20:51:01 -07:00
Steve Wilkerson
29fc716cf3 Fluentd: Update Clusterrole verbs
This updates the Fluentd clusterrole to allow for getting
namespaces, as this is required for the fluentd kubernetes
plugin to function correctly

Change-Id: Id9d735310c53a922a62c6a82121edd332e7df724
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-25 23:31:19 +00:00
Steve Wilkerson
9e33cc2c19 Fluentd: Fix whitespace chomps for volumes and volume mounts
This fixes the whitespace chomps for adding extra volumes and
volume mounts via values.yaml for the Fluentd chart, as currently
too much whitespace is removed and the extra volumes and mounts
are not added correctly

Change-Id: I9cf67c3321339078ac795a7290f441b16cc41d41
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-25 23:31:09 +00:00
Drew Walters
5e3f729ffe CI: Make openstack-support and keystone-auth jobs nonvoting
Change-Id: I17e7a6a499f8e7c86c5359452c3317fc4cbfe533
2019-06-25 22:46:39 +00:00
Zuul
73bc44bc32 Merge "Fluentd: Remove readOnly flag from /var/log mount" 2019-06-25 19:57:58 +00:00
Zuul
edf41fe792 Merge "Fluentd: Add deployment conditional for probes" 2019-06-25 19:57:56 +00:00
Pete Birley
e80c7f8aac Gate: Store helm values for release
This PS stores the applied helm values for releases in the gate.

Change-Id: I6563104ded6631b63d9fced775b9b9dba7fd00ef
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-25 18:54:09 +00:00
Zuul
a35ded2efc Merge "Gate: Simpler multiple distro/over-ride support" 2019-06-25 16:41:25 +00:00
Steve Wilkerson
6321a01c1e Fluentd: Add deployment conditional for probes
This adds a conditional check on the deployment type of the
Fluentd chart to determine whether to enable the current liveness
and readiness probes or not.  The current probes are designed
around using fluentd as an aggregator and do not function properly
when fluentd is deployed as a daemonset.  When run as a daemonset
and configured to tail files via the tail input plugin, fluentd
will prioritize reading the entirety of those files before
processing other input types, including opening the forward source
socket required for the current probes to function correctly. This
results in scenarios where the current probes will fail when in
fact fluentd is functioning correctly.

Daemonset focused probes to come as a follow on once a proper path
forward has been determined

Change-Id: I8a164bd47ce1950e0bd6c5043713f4cde9f85d79
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-25 06:32:25 -05:00
Zuul
0952475aed Merge "Open openvswitch_db_server port 6640 to interact with SDN controller" 2019-06-25 03:28:06 +00:00
Zuul
28d3cb538b Merge "Remove fluent-loggin from network-policy" 2019-06-25 03:28:05 +00:00
Zuul
0267c8fa77 Merge "Ingress: Update config to be compatible with k8s schema validation" 2019-06-25 03:25:17 +00:00
Jugwan Eom
833d426da8 fix host-specific overrides incorrectly overwriting previous values
root_conf area is used for host-specific configuration and overwritten in
each round of loop. It causes that all hosts will share same properties.
This makes use each host's own area in the loop.

Task: 34282
Story: 2005936

Change-Id: I0afb0b32ab80456aa3439b4221f2a95ca05ddf24
2019-06-25 02:34:02 +00:00
Zuul
9e95a497c0 Merge "Trivial typo fixes" 2019-06-25 00:49:00 +00:00
Pete Birley
d60fe161a5 Ingress: Update config to be compatible with k8s schema validation
This PS updates the ingress controller configmap to be valid with
k8s schema validation turned on.

Change-Id: Ibbc82be62398ee63eb353aa58f1ebdf98e66b30d
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-24 23:54:23 +00:00
Pete Birley
2bb0dcb5b0 Gate: Simpler multiple distro/over-ride support
This PS indroduces a simpler way to incorp over-rides into gate
runs, and also ensures that they are scoped to a single chart, rather
than all of the charts deployed within a gate run.

Change-Id: Iba80f645f33c6d5847fbbb28ce66ee3d23e4fce8
Signed-off-by: Pete Birley <pete@port.direct>
2019-06-24 14:16:17 -05:00
Kabanov, Dmitrii (dk370c)
44c1dcc4c9 [etcd] Move etcd storage to tmpfs
The PS allows to use tmpfs for etcd during the gates.
There is an assumption that it will improve the performance and
will allow to get rid of weird issues.

Change-Id: Id68645b6535c9b1d87c133431b7cd6eb50fb030e
2019-06-24 11:14:21 -07:00
Dejaeger, Darren (dd118r)
083956e37b Add node selector to Ceph test pods
This PS looks to add a node selector into the Ceph test pod's
specs.

Change-Id: If73a5036c5e6a651393f81a136874b9e8a52b4f1
2019-06-24 17:41:09 +00:00
MegHeisler
d5af61b751 Remove fluent-loggin from network-policy
This removes the old fluent-logging chart from network
policy and replaces it with the new fluentbit and fluentd
charts. This will return the network policy gate back to
passing

Change-Id: I060c6c3034fa798a131a053b9d496e5d8781c55d
2019-06-24 16:14:05 +00:00
Steve Wilkerson
1df9cee5c1 Fluentd: Remove readOnly flag from /var/log mount
This removes the readOnly flag from the /var/log mount for the
fluentd pod to allow for using the file buffer mechanism when
desired

Change-Id: I23f0f03824eec5b142d3f2e8e42e8d07cddfe618
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-06-24 11:11:52 -05:00
Alexander Noskov
e315c90de3 Trivial typo fixes
Change-Id: I255f76aa4ff253452d39d89850dfd75488dc6b38
2019-06-24 06:31:31 +00:00
Jian Li
0146cf98ba Open openvswitch_db_server port 6640 to interact with SDN controller
This change allows the openvswitch to interact with SDN controller
(e.g., ONOS, ODL) through 6640 port.

Story: 2005763
Task: 33473

Change-Id: Ifcbb6a157c230fa729d295ef0d3fb9a16fff60a2
2019-06-24 09:33:11 +09:00
Zuul
3d3f74de69 Merge "[Ceph] Update helm tests for ceph-provisioners" 2019-06-23 04:34:38 +00:00
Zuul
65f78190ba Merge "Add zuul-jobs roles to job job that uses them" 2019-06-22 12:19:09 +00:00
Zuul
49bb4ed703 Merge "add docker-default apparmor profile for prometheus-alertmanager Add in prometheus-alertmanager gate script as a script" 2019-06-22 12:01:01 +00:00
Kostiantyn Kalynovskyi
0e0858a7c7 Add zuul-jobs roles to job job that uses them
Job openstack-helm-infra uses role named "start-zuul-console" that is part
of another project named "zuul/zuul-jobs". If this job is
ever used by another project as "parent job", it would fail, because
wouldn't find the role in any of the default pathes. This patch adds the
roles from zuul/zuul-jobs project, to the job that uses these roles from
the project

Change-Id: Ib3b7e0e43008b7a4f394b49b75529bfde9780d2f
2019-06-22 10:13:45 +00:00
Randeep Jalli
1c4084bdc0 add docker-default apparmor profile for prometheus-alertmanager
Add in prometheus-alertmanager gate script as a script

Change-Id: I3c10f9a9d4403fd91da292a50d204f73a9295611
2019-06-22 10:13:18 +00:00
Hussey, Scott (sh8121)
9b00075a72 (helm-toolkit) Optionally b64 encode TLS keys
- When using the TLS certificate generation macro, optionally
  support base64 encoding values for direct inclusion in a Kubernetes
  secret. The default is to maintain current behavior for backward
  compatibility.

Change-Id: Ib62af4e5738cbc853a18e0d2a14c6103784e7370
2019-06-22 10:12:49 +00:00
Zuul
736995c1d2 Merge "Fix indentations" 2019-06-22 01:26:32 +00:00
Zuul
4b609516f2 Merge "[Ceph] Implement pool quotas on pools as they are created/managed" 2019-06-21 19:59:24 +00:00
Zuul
c893836808 Merge "[Ceph] Modify CRUSH map for changes to existing deployments" 2019-06-21 19:45:16 +00:00
Kabanov, Dmitrii (dk370c)
e580e0204b [Ceph] Update helm tests for ceph-provisioners
The changes allow to provide more information in case of failure.

Change-Id: Ie03cafac33ef9b2cf457e0d483d838170eadaef4
2019-06-20 11:19:51 -07:00
Taylor, Stephen (st053q)
d74b579f1d [Ceph] Implement pool quotas on pools as they are created/managed
This patch set implements pool quotas on each pool in the Ceph
cluster by obtaining the total capacity of the cluster in bytes,
multiplying that by the defined percentage of total data expected
to reside in each pool and by the cluster quota, and setting a
byte quota on each pool that is equal to its expected percentage
of the total cluster quota.

Change-Id: I1686822a74c984e99e9347f55b98219c47decec1
2019-06-20 10:16:47 -05:00
Taylor, Stephen (st053q@att.com)
810026f342 [Ceph] Modify CRUSH map for changes to existing deployments
This adds the ability for the ceph-osd osd-directory.sh script to
handle existing deployments that place data in hosts via CRUSH and
modify those deployments to place data in racks instead. The
existing data remains intact but is redistributed across the new
rack-level failure domains by updating the CRUSH map and assigning
new rules to existing pools.

Change-Id: Ida79f876d0cae3d99e796e4de1aac55a7978986c
2019-06-20 10:14:30 -05:00
Hussey, Scott (sh8121)
3844f4af77 (postgresql) Support update strategy snippet
- Add support for the update strategy helm-toolkit snippet

Change-Id: I7abedec017cb043a38f4e176028d76fdc505de12
2019-06-20 13:15:53 +00:00
Venkata, Krishna (kv988c)
50889f8643 Fix indentations
Found incorrect indentations in YAML. This
PS redresses the indentation issue.

Change-Id: Id8d00e07a209a0fd1c98823deb59dc15a87ba16d
2019-06-19 17:11:37 -05:00