This change introduces grafana into the stack which gives us a great
way to visualize the data. The grafana role from cloudalchemy is being
used for the bulk of the deployment.
Because the grafana deployment playbook is now standalone the mentions
of grafana in the other ops directories have been removed.
Change-Id: I23e1c96cd1fda7ece9b86a69f9f0326913de714d
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
This change adds all of the filebeat support we'd need to ingest data
throughout an environment.
Change-Id: I27a4ee678f020805bbc0adc72081685fbe9cecb4
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
Beat set is using a loop to ship both templates and dashboards using
different commands. This is being done to ensure no data is lost or
mis-setup during index creation.
Packetbeat only needs to be installed on hosts
All of the beats are now using standard field templates.
Change-Id: Ie6220eb94a12780ad122ba367bf7654d97c212e8
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
Most of the changes in this PR are for style and to adapt the playbooks
so that the system can operate on a multi-node cloud.
Functional change includes the removal of mainline Java 8 in favor of
OpenJDK 8.
A site playbook was add to allow an operator to just run everything.
Old tools that no longer function within the stack have been removed.
Packetbeat was added to the install list
Auditbeat was added to the install list
All of the config files have been updated for the recent ElasticStack
6.x changes.
Change-Id: I01200ad4772ff200b9c5c93f8f121145dfb88170
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
We have received complaints that the openstack-service-setup.yml
playbooks will try to overwrite flavors and images of the same
name that may have different attributes. This is due to them
requiring some unique configurations that just so happen to
have been using the same name in tests. The tag additions
will allow them to work around this by skipping the ones
conflicting with existing entries.
Change-Id: I3eef87f522a219d094181fa64933f86142b060ef
Closes-Bug: 1760219
The top mirror(http://mirror.veracruz.co/ubuntu/) is currently broken.
We can override the defaults by editing the override file
(/etc/apt-cacher-ng/backends_ubuntu) with valid mirrors.
Change-Id: I35f7efa665030282c9630d7423413e8bd3628ba5
Closes-Bug: 1759903
Now that run_tests.sh handles the tests repo clone, we can
remove the use of the older tests-repo-clone.sh script.
Change-Id: I7e3426e483e0a312ae838155788c1ec4b960559a
mnaio uses LVM as default VM disk backend but that
requires a lot of available disk space.
A alternative option, the qcow2 file based backend
is added to take benefit of thin provisioning.
This backend can be triggered by setting the override
`default_vm_disk_mode` to `file`
Change-Id: Iaf97fef601f656901b6913eaafb9a6c28d4b7ba6
In order to allow the use of the environment variable which informs
Ansible which user executed the playbook, we pass the USER env var
into the environment that tox builds.
Change-Id: Id6d47779821d101bc504fd9e23e7a7ec29da3f7b
Implements: blueprint python-build-install-simplification
Signed-off-by: Jesse Pretorius <jesse.pretorius@rackspace.co.uk>
Dhcp is disabled by default for the provider network. We are getting
complaints as teams using the mnaio env are expecting to be able to
attach devices to the provider network as well as the private network.
This change is to allow the setting of a 'enable_provider_net_dhcp' bool
variable to enable it during the service setup playbooks if needed.
Closes-Bug: 1755295
Change-Id: I46b22635fd8eece5528afecc76310f3c116b9e89
When playbook-influx-telegraf.yml runs, it uses roles from mgrzybek
openstack-ansible-telegraf repo. Playbooks from that repo loads
search scripts in different dirs and reading a source path.
Change-Id: Ib1ca9f60ad5e686790b56e1c66ab53ed9cc490b7
InfluxDB is usually already installed at this point
(running playbook-influx-db.yml playbook), so in most cases using
such host as default output avoids to specify additional information.
Change-Id: Iac5e16c3d24a74119ea2179ecc3e5273de20676e
It looks like the host_bind_override isn't being set for the flat network.
This results in the neutron linuxbridge agent to error out when trying to
attach to br-flat instead of eth2. If attaching a device to the GATEWAY_NET
network, they will be unable to communicate.
Change-Id: Ia8de61011677ec1a7d9683fdff3c3d5848e85c2e
Closes-Bug: 1754097
This addition is an updated of the curent elk_metrics which will install Elasticsearc, Logstash and Kibana 6.x.
It also include configuration guide for haproxy endpoints
Change-Id: Iac4dec6d17bc75433e5fe672f3b9781536b8e619
We normally see ssh connection issues during the lxc container setup
portion of OSA builds. Most people usually end up tweaking ansible ssh
pipeline and retry settings or nerfing the build via ansible fork lowering
to work around it. This is an old issue that we normally put a more
permanent fix in our physical environments by setting the ssh maxsessions
and maxstartups. On the mnaio builds I have been working around this by
stopping the build before deployment and making the changes in a script.
Change-Id: I54c223e1fb9edf6947bc7f76ff689bad22456420
Closes-Bug: 1752914
This allows the setting of an ansible osa_disable_serial variable
that drops in a config to set all of the serial settings to 100%
to disable throttling. The exception being keystone as it has a
race condition that prevents it. The default is 'false' and can
be set in the MNAIO_ANSIBLE_PARAMETERS var before running the
build.sh script.
Change-Id: I5850d882d465b7ef10b317076bb135934f1ceba2
Closes-Bug: 1752475
It looks like bash was throwing single qoutes around the variable
default if the var was empty causing ansible to think it is the
play. Thanks to Matt Thompson's help, we pulled that out into
a separate export to remove the single quotes.
Change-Id: Id04f840871f3371cf8258a8135536d37738e4e12
Closes-Bug: 1752357
add force: true to avoid dirty git repo, which will do a hard reset from
upstream, this is related to you ansible version, if it's not working,
please try this way -> https://goo.gl/2Sg2Eq
Change-Id: I7e21921d0812cb143a2e2c3f794667354791c8db
change the default value assiagment for container_tech from - to :- in
case the the parameter has been declared, but is null.
The extra : makes a difference only when parameter has been declared,
but is null.
Change-Id: I9be9df155c1db5b390f6b664c0f3046efb4a4d1b
This change allows someone to modify the vcpu count settings
similar to how the ram is currently done. It also allows for
custom ansible parameters via an MNAIO_ANSIBLE_PARAMETERS var
to add custom ansible parameters for the vpcu overrides as well
as other settings.
Change-Id: I3c1fa7b55a87931eff586c0e983bb9b8c6f34fc3
Closes-Bug: 1750402
This change updates the preseed files and the default
openstack-user-config file so that deployers can use and test nspawn
type containers using the in-built automation.
Change-Id: I2ec3bd284540fa9f79490a350f016ca594fb5f98
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>
Instead of passing all things to the client, and forgetting some,
we should directly load the config, and use the cloud
configuration for creating connections.
Change-Id: I8e66ff033b6d49537b161710e983750f40d5e93d
