1415 Commits

Author SHA1 Message Date
Jenkins
08101fd465 Merge "Make Heka send logs to Elasticsearch" 2016-03-05 15:36:44 +00:00
Éric Lemoine
491aff0b88 Make Heka send logs to Elasticsearch
This patch includes changes relative to integrating Heka with
Elasticsearch and Kibana.

The main change is the addition of an Heka ElasticSearchOutput plugin
to make Heka send the logs it collects to Elasticsearch.

Since Logstash is not used the enable_elk deploy variable is renamed
to enable_central_logging.

If enable_central_logging is false then Elasticsearch and Kibana are
not started, and Heka won't attempt to send logs to Elasticsearch.

By default enable_central_logging is set to false. If
enable_central_logging is set to true after deployment then the Heka
container needs to be recreated (for Heka to get the new
configuration).

The Kibana configuration used property names that are deprecated in
Kibana 4.2. This is changed to use non-deprecated property names.

Previously logs read from files and from Syslog had a different Type
in Heka. This is changed to always use "log" for the Type. In this
way just one index instead of two is used in Elasticsearch, making
things easier to the user on the visualization side.

The HAProxy configuration is changed to add entries for Kibana.
Kibana server is now accessible via the internal VIP, and also via
the external VIP if there's one configured.

The HAProxy configuration is changed to add an entry for
Elasticsearch. So Elasticsearch is now accessible via the internal
VIP. Heka uses that channel for communicating with Elasticsearch.

Note that currently the Heka logs include "Plugin
elasticsearch_output" errors when Heka starts. This occurs when Heka
starts processing logs while Elasticsearch is not yet started. These
are transient errors that go away when Elasticsearch is ready. And
with buffering enabled on the ElasticSearchOuput plugin logs will be
buffered and then retransmitted when Elasticsearch is ready.

Change-Id: I6ff7a4f0ad04c4c666e174693a35ff49914280bb
Implements: blueprint central-logging-service
2016-03-05 11:51:49 +01:00
Jenkins
8976263153 Merge "Bump ansible version to head of devel" 2016-03-05 01:24:39 +00:00
Jenkins
32ce37cb8f Merge "Fix horizon with ssl" 2016-03-04 23:17:52 +00:00
Jenkins
b91f84b968 Merge "Retry token retrival in keystone bootstrap script" 2016-03-04 22:51:00 +00:00
SamYaple
d83cb3c473 Retry token retrival in keystone bootstrap script
TrivialFix

Change-Id: I83da0298067d5f37603c52fb312828ea1fbbb00c
2016-03-04 18:14:33 +00:00
Jenkins
82c426ce3a Merge "Set mongodb log file to shared volume by heka" 2016-03-04 17:01:24 +00:00
SamYaple
6f23746177 Bump ansible version to head of devel
bcoca has asked we use head of devel to fix the loader issue

TrivialFix

Change-Id: Ie6f4b6bbdffed9a85c840a4f425d866fc5402f4b
2016-03-04 16:06:36 +00:00
Hui Kang
ef24d9e597 Set mongodb log file to shared volume by heka
TrivialFix

Change-Id: I085ef2884749bb4ecc546b78052a5688e8b36ad3
2016-03-04 11:04:23 -05:00
SamYaple
dd8e1cb2ee Fix horizon with ssl
Ubuntu did not have mod_headers enabled by default

Remove unused variable and adjust 'when' conditional positioning

TrivialFix

Change-Id: I82b8724526c24f4481a80165520d624f6a02c336
2016-03-04 14:51:50 +00:00
Jenkins
7f9ba5a477 Merge "Reconfigure cinder service" 2016-03-04 14:28:39 +00:00
Jenkins
ebc1bbb081 Merge "When ansible fails it still reads chaged key" 2016-03-03 23:34:50 +00:00
Jenkins
67864c318b Merge "Make Heka collect Manila logs" 2016-03-03 22:42:31 +00:00
SamYaple
69c33ce2fe When ansible fails it still reads chaged key
Add changed key failure as well.
Closes-Bug: #1552405

Change-Id: Ic25a57ba20928bee136932cc422713e76dcbe2a1
2016-03-03 22:26:14 +00:00
Jenkins
a94d537aab Merge "Fix Keystone v3 and Horizon" 2016-03-03 18:51:09 +00:00
Jenkins
6b0258abe3 Merge "Bump to latest ansible and deps" 2016-03-03 16:59:10 +00:00
Jenkins
ea15697aa8 Merge "Libvirt needs openvswitch to connect br-int" 2016-03-03 16:31:31 +00:00
Jenkins
e235f6cc57 Merge "ADD user neutron to the neutron-openvswitch-agent docker file" 2016-03-03 16:00:15 +00:00
Mauricio Lima
285e42a99c Make Heka collect Manila logs
Partially implements: blueprint heka

Change-Id: I3fadbf29f5219a293b8b1114d192e27888be2c59
2016-03-03 10:53:59 -05:00
SamYaple
57124620ab Fix Keystone v3 and Horizon
After our switch to keystone-manage bootstrap Horizon is not happy
due to v3 not being setup correctly. This patch fixes that

This also includes removal of unused variables (transforms them into
endpoint url variables)

TrivialFix
Change-Id: I1e04db8c24049f80e974c063f03068a2ab32a563
2016-03-03 15:44:53 +00:00
SamYaple
a2fe37fe89 Bump to latest ansible and deps
Ansible is pinned to single commit in devel branch to pull in the
latest shade module we need (domain control). It will be available in
ansible 2.1

TrivialFix
Change-Id: I4c21fa1d2cec30d4aeb80e050ef4a62332f9ed45
2016-03-03 15:19:00 +00:00
Ryan Hallisey
930737efae Libvirt needs openvswitch to connect br-int
Libvirt is trying to create a port on br-int and is
failing because ovs is not installed.

Co-authored-by: Ian Main <imain@redhat.com>
Closes-bug: 1552717
Change-Id: I6ed0c1ae5b27b58e4c22bcbe7e674f66cde48990
2016-03-03 05:00:50 -05:00
Jeffrey Zhang
e878da0412 Reconfigure cinder service
Change-Id: I8d207d1782acfebf5c07de39df3257fd9bdbbada
Partially-implements: bp kolla-reconfig
2016-03-02 23:52:49 +00:00
Jenkins
5139a1442d Merge "Sanity check for swift" 2016-03-02 11:00:55 +00:00
Hui Kang
55b50b121c ADD user neutron to the neutron-openvswitch-agent docker file
Neutron containers share the same log directory. So all containers
should use same username to create directories.

Change-Id: Id95a3205b53dd87ba21d55ebecada89d9f86d37b
Closes-Bug: #1551829
2016-03-01 13:51:16 -05:00
Jenkins
a07855bc07 Merge "Fix missing libraries for ceilometer" 2016-03-01 18:10:13 +00:00
Hui Kang
cd735fd0a7 Fix missing libraries for ceilometer
Change-Id: I5571a5639f9f1b5cb0c8ea87188c3d0b9557cba7
Closes-Bug: #1551407
2016-03-01 10:01:44 -05:00
Jenkins
3aedf52489 Merge "Move ironic-discoverd to ironic-inspector" 2016-03-01 13:00:24 +00:00
SamYaple
4edd0baf8d Remove keystone admin token
Admin token has been deprecated upstream. It will be removed in O. We
switch over to the new `keystone-manage bootstrap` method for creating
the initial admin user, role, and project.

Co-Authored-By: Sam Yaple <sam@yaple.net>
Change-Id: I6ca90e8d4c3b71009e24b049b2efbc08c05ebfbf
2016-03-01 00:14:06 +00:00
Eugene Bagdasaryan
790675be4f Sanity check for swift
This runs first sanity check for swift. Once
swift is deployed it checks list()

Change-Id: I613bf9f2893d66814863893ec5acde5aa252548d
Partially-Implements: blueprint sanity-check-container
2016-02-29 18:23:13 +03:00
Allen Gao
235e95885b Move ironic-discoverd to ironic-inspector
Closes-Bug: #1551052
Change-Id: Ic226287bbf1f1e8d5cc2e1d80ce2975448b1f95c
2016-02-29 11:47:52 +08:00
Jenkins
559b63332b Merge "Sanity check for cinder" 2016-02-28 22:35:36 +00:00
Jenkins
a238fb5d3e Merge "Reconfigure keystone service" 2016-02-28 19:39:46 +00:00
jvora
c31729cdaf Sanity check for cinder
This runs first sanity check for cinder. Once
cinder is deployed it checks volumes.list()

Change-Id: I1b4cc57f21cf0fa52a391229c2c2b3fa995d32a8
Partially-Implements: blueprint sanity-check-container
2016-02-27 16:22:34 -08:00
Jeffrey Zhang
3a10f2d6e9 No need the keystone-dist-paste.ini file
This file is in the expected path when using CentOS binary install

TrivialFix

Change-Id: Ic64d2bed4791250065464b6bdb6cc0992c858aaf
2016-02-28 00:01:36 +08:00
Jeffrey Zhang
72ac7a5541 Reconfigure keystone service
Partially-implements: bp kolla-reconfig

Change-Id: Ied293e59bf4531e88a0e5e5bf9a5f5f495d2a0e7
2016-02-27 02:15:48 +00:00
Éric Lemoine
95cf542f8d Fix parsing of RabbitMQ logs
Currently Heka fails to parse the RabbitMQ logs. There are two
problems:

1. The rabbit-sasl.log file is ignored but the file_match expression
   does not match.
2. The delimiter used in the RegexSplitter makes Heka stop on the
   very first log entry. '\n\n(=[^=]+====' (with two \n's) is
   a better delimiter. deliver_incomplete_final is used to get the
   final log entry.

TrivialFix

Change-Id: I94720340d5b2d6fd5d7641b9ff58733f6cd882ee
2016-02-26 14:50:32 +01:00
Jenkins
f650adf0af Merge "nova-libvirt is not a child of nova-base" 2016-02-26 01:40:17 +00:00
Jenkins
f1eb20d58a Merge "Import module rather than funciton in the set_configs.py file" 2016-02-25 21:53:13 +00:00
SamYaple
06f1519b7a nova-libvirt is not a child of nova-base
The permissions fix was not applied due to a recent patch.

Related-Id: I37d737509bc7cf3dc74bb13ecb0a6ae68080556e

TrivialFix

Change-Id: Ica737a8e51cdb66b06a09b5484a4915d6e26ee06
2016-02-25 16:28:49 +00:00
Jenkins
317224fa38 Merge "Pin ceph-radosgw" 2016-02-25 15:44:13 +00:00
Jeffrey Zhang
2eaf65a1e1 Import module rather than funciton in the set_configs.py file
TrivialFix

Change-Id: I352ef1176407edf093667644ce6adbd48eb63865
2016-02-25 08:20:09 +08:00
Martin André
8d49c703d8 Pin ceph-radosgw
Change-Id: I9ff2e9d1e682f3d6b206568863d4bac3900fc03a
Closes-Bug: #1549538
2016-02-25 09:00:58 +09:00
Jenkins
e9c6d3a05a Merge "Add manila_sudoers file" 2016-02-24 23:36:53 +00:00
Jenkins
fb5773f100 Merge "Switch ceph to use storage network" 2016-02-24 18:44:15 +00:00
Mauricio Lima
f85386085d Add manila_sudoers file
All manila rootwrap calls are failing in
source build because lack of sudoer setting

Change-Id: I301fd7b6ff3721328828c2e0384f7e320146731b
Partially-Implements: blueprint enable-manila-containers
2016-02-24 13:30:29 -05:00
SamYaple
1e2dfad50b Switch ceph to use storage network
Ceph was not properly using storage network.

TrivialFix

Change-Id: Ibf3da5d19cd2ca874d251b455a7eb856154fc3f7
2016-02-24 17:19:52 +00:00
Jenkins
989e9da68b Merge "Allow cinder-volume to be configured to use nfs on Centos" 2016-02-24 17:03:03 +00:00
Jenkins
edaf162ead Merge "Remove duplicate code in neutron extend_start.sh" 2016-02-24 15:59:02 +00:00
Jenkins
bbed8e92c3 Merge "Remove duplicate code in murano extend_start.sh" 2016-02-24 15:58:10 +00:00