21 Commits

Author SHA1 Message Date
Steve Wilkerson
bdaf866a4e Fluentd: Support Daemonset deployment
This adds required changes to the Fluentd chart to allow for
deploying Fluentd as either a deployment or a daemonset. This
follows the pattern laid out by the ingress chart. This also
updates the single and multinode jobs to deploy fluentd as both
a daemonset and a deployment for validation

Change-Id: I84353a2daa2ce56ff59882a8d33203286ed27e06
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-05-28 08:23:44 -05:00
Steve Wilkerson
abb5e0f713 Separate fluentbit and fluentd charts
This begins to split the fluent-logging chart into two separate
charts, one for fluentbit and one for fluentd. This is to help
isolate each chart and its dependencies better, and to treat each
service as its own entity.

This also moves the job for creating Elasticsearch templates to
the Elasticsearch chart, as the elasticsearch chart should have
ownership of creating the templates for its indices.

This also performs some general cleanup of values keys that are
not currently used

Change-Id: I827277d5faa62b8b59c5960330703d23c297ca47
Signed-off-by: Steve Wilkerson <sw5822@att.com>
2019-05-24 06:31:09 -05:00
Tin Lam
cf2e776946 Fix OSH-infra docs job
Removing and updated docs dependencies to make the docs job work again.

Change-Id: I8ebaef2776d4d54c6b60dc6bbbcbb2fe4e49addc
Signed-off-by: Tin Lam <tin@irrational.io>
2019-03-30 17:32:35 +00:00
John Haan
432c7a5801 Fix wrong indentation of multinode docs
This simple patch is for correcting wrong indentation error
in multinode document.

Change-Id: Idc5f3c948947419359860eb68cddd05a31201c8d
2019-02-12 11:31:24 +00:00
Zuul
1509383894 Merge "Foundation for LMA docs" 2019-01-14 08:10:03 +00:00
lijunjie
32b3ac3723 Fix the misspelling of "argument"
Change-Id: If78a27fe0d28a60d3dbbe0ee21d8209b2cfd633c
2019-01-10 16:41:17 +08:00
Steve Wilkerson
eab9ca05a6 Foundation for LMA docs
This begins building documentation for the LMA services included
in openstack-helm-infra. This includes documentation for: kibana,
elasticsearch, fluent-logging, grafana, prometheus, and nagios

Change-Id: Iaa24be04748e76fabca998972398802e7e921ef1
Signed-off-by: Steve Wilkerson <wilkers.steve@gmail.com>
2019-01-07 21:02:54 +00:00
Matthew Heler
b18dd351d2 Update documentation for recent failure domain options in Ceph
Change-Id: Id6707566753b834da598b62f630f4caafe8ee234
2018-12-13 13:05:52 -06:00
Matthew Heler
cfc2d4abd8 Document howto recover from a Ceph namspace deletion
Change-Id: Ib1b03cd046fbdad6f18478cfa9c9f0bf70ec9430
2018-11-14 13:31:16 -06:00
Chinasubbareddy M
26991ad182 Ceph: A script to check object replication across the hosts
this script will  create  an object and see if the object is
getting replicated across diffrent hosts  or not.

Change-Id: Ic5056c1a07dc5d5b6a5d6fc24e3d9a75fa46458f
2018-10-21 15:38:26 +00:00
Steve Wilkerson
538d51e991 Organize aio gates by function
This organizes the single node gates for osh-infra by function.
This organization aims to improve the single node gates in the
following ways:

1. Reduce number of services deployed in single node jobs
2. Only deploy Ceph for logging job, as Elasticsearch requires
   RGW for snapshot repositories.
3. Use NFS for storage for monitoring job, as Ceph is not a
   requirement for any of the services here.
4. Remove duplicate services deployed to multiple single node jobs
5. Remove storage from openstack-support job, as the only service
   requiring storage is rabbitmq. Rabbitmq is deployed with
   storage enabled in the openstack-helm checks/gates.

This also removes the documentation for the single node deployments,
as those deployments do not make sense with this change. This should
be revisited as a follow-on once we have a clear path forward for
the larger gate refactoring work

Change-Id: I46951f76904fa2ab245a202d55f76019b7503362
2018-10-19 12:28:18 -05:00
Steve Wilkerson
a084769410 Elasticsearch S3 repo
This ps adds the ability to use the ceph radosgw s3 api for
snapshot repositories. It removes the ability to use a RWM pvc, as
the radosgw solution provides a more robust approach for storing
index snapshots

Change-Id: Ie56ac41ccdc61bfadcac52b400cceb35403e9fae
2018-09-19 15:53:21 -05:00
Steve Wilkerson
bc6e22f392 Gate: Trim dev-deploy gates
This attempts to trim down the dev-deploy gates until further
gate refactoring is complete. This disables the elasticsearch and
fluentd exporters and removes the openstack exporter from the
single node deployment gates to ease the load on nodepool vms

Change-Id: If211511e8f52fe39d293966abbd7e62b45b65970
2018-09-17 13:56:51 +00:00
Zuul
8df4402bec Merge "A script to check the failure domains of OSDs in PGs" 2018-09-06 19:30:10 +00:00
Al Lau
d6cfd78c4d A script to check the failure domains of OSDs in PGs
The checkPGs script is implemented to check the Object Storage
Daemons (OSDs) in Placement Groups (PGs) of ceph pools to make
sure OSDs were not allocated from the same failure domain.  This
script is intended to run from any one of the ceph-mon pods.

Invoke the checkPGs script with --help to get the details on how
to run it.

A Kubernetes cron job is created to schedule the execution of
this script at a regular interval.  The execution frequency is
defined in the ceph-mon/values.yaml file.

Change-Id: I5d46bc824e88545cde1cc448ae714d7d3c243817
2018-09-06 06:06:28 -07:00
Zuul
40e0ddba33 Merge "Gate: Add process exporter to gate deployments and docs" 2018-09-05 20:52:24 +00:00
Steve Wilkerson
93630ac6e3 MariaDB: Move chart to openstack-helm-infra
This moves the mariadb chart to openstack-helm-infra as part of
the effort to move charts to the appropriate repositories

Change-Id: Ife56e28de46c536108cebb4f4cdf6bad2a415289
Story: 2002204
Task: 21725
2018-09-04 18:57:53 -05:00
Steve Wilkerson
0aae608aa0 Gate: Add process exporter to gate deployments and docs
This adds the process exporter to both the developer and multinode
gates, along with adding the relevant deployment steps to the docs

Change-Id: I85d5c398fbbb62145c9bb4e3a885e9a774725e5a
2018-09-04 15:54:25 -05:00
Steve Wilkerson
8037bf4ca9 Add Ceph to osh-infra gates
This adds a ceph developer gate to openstack-helm-infra, which
depends on ceph moving to openstack-helm-infra. This also replaces
the NFS backed storage for the multinode gate with ceph instead

Change-Id: I11268463aa037a2e037217a2dbc89c7432c0d277
2018-08-28 15:39:03 -05:00
Steve Wilkerson
9fd4cd0917 Deploy ingress in osh-infra dev and multinode gates
This deploys the ingress chart in the openstack-helm-infra dev
and multinode gates, which allows for enabling ingresses in the
charts where defined

Change-Id: I055c7b02d9af68f6e3c5eda33d69dd0b8b1b70ca
2018-07-30 07:14:00 -05:00
Steve Wilkerson
e7d32fb51e Add docs to openstack-helm-infra
This aims to introduce documentation to openstack-helm-infra,
similar to what exists in openstack-helm

Change-Id: If6a850d555c9bd4ddae36763733a47e795961a50
2018-05-15 13:04:28 -05:00