4 Commits

Author SHA1 Message Date
Duncan Martin Walker
33d3822f99 Expose Elasticsearch data path configuration
Currently the location where elasticsearch stores its data is hardcoded
in the elasticsearch.yml configuration template to /var/lib/elasticsearch.
This commit allows the option to be configured, and exposes the value as a
default variable. This not only allows the data directory to be changed,
but also for elasticsearch to be configured to use multiple data directories
through a comma separated list. The default behaviour is unchanged.

Change-Id: I21dbcaeab997362f94e245434cc5aa35136aeee9
2020-02-05 16:41:24 +00:00
Duncan Martin Walker
8d865b7736 Expose interface configuration options for beat install
This update exposes options for configuring beats to communicate on non-standard
interfaces, i.e. not those used by ansible itself, where proxies are enabled.
This includes allowing the elasticsearch and logstash node/bind addresses to be
overridden to use different interfaces, and letting no_proxy environment variables
be specified when the required interface does not match the kibana ansible_host
address. The default behaviour has not changed, these configurations are purely
optional.

Change-Id: I3e2230ce3de349f219306c11d476e46ae3ed8f65
2020-01-23 15:33:34 +00:00
Georgina Shippey
68664a9dc1 Config updates for elk 7.x
Updated ELK config files to elk 7.x reference samples, bringing over
existing customisation from elk_metrics_6x.

Removed deprecated use of --pipeline in elastic_beat_setup/tasks/main.yml,
--pipeline is no longer a valid cli argument.

Updated logstash-pipelines and removed the dynamic insertion of the date into
index names. This function is now done with the new ILM feature in elasticsearch
rather than logstash.

Installation of each beat creates an ILM policy for that beat and this patch
does not change the default policy. It is possible that the default policy
will exhaust the available storage and future work needs to be done to address
this.

The non-beat elements of the logstash pipeline (syslog, collectd and others)
are not yet updated to be compatible with ILM.

Change-Id: I735b64c2b7b93e23562f35266134a176a00af1b7
2019-08-05 07:47:35 +00:00
Georgina Shippey
5e96844123 Duplicate of elk_metrics_6x to elk_metrics_7x
Change-Id: I92a894e31f725a20c684165f93dd4c34b9c8b450
2019-07-10 17:52:49 +01:00