9751 Commits

Author SHA1 Message Date
Mark Goddard
54965c878b Improve standalone ironic support
Adds a new flag, 'enable_openstack_core', which defaults to 'yes'.
Setting this flag to 'no' will disable the core OpenStack services,
including Glance, Heat, Horizon, Keystone, Neutron, and Nova.

Improves the default configuration of OpenStack Ironic when used in
standalone mode. In particular, configures a noauth mode when Keystone
is disabled, and allows the iPXE server to be used for provisioning as
well as inspection if Neutron is disabled.

Documentation for standalone ironic will be updated separately.

This patch was developed and tested using Bikolla [1].

[1] https://github.com/markgoddard/bikolla

Change-Id: Ic47f5ad81b8126a51e52a445097f7950dba233cd
Implements: blueprint standalone-ironic
2019-02-22 17:22:48 +00:00
Zuul
fe8ccc65e3 Merge "Fix location of hostdirs for Murano services" 2019-02-22 11:53:13 +00:00
Zuul
d1ef5061c6 Merge "Allow nova services to use independent hostnames" 2019-02-22 09:03:17 +00:00
Zuul
6533044600 Merge "Add haproxy stats to gate logs" 2019-02-22 09:03:16 +00:00
Zuul
af0347acec Merge "Make Kafka maintenance easier" 2019-02-22 09:03:15 +00:00
Zuul
a67d0b0ea1 Merge "Parse Monasca Log API timestamps correctly" 2019-02-22 09:03:14 +00:00
Michal Nasiadka
3f01c7c7cd Add haproxy stats to gate logs
Change-Id: Iebd98acf03418817d3707c4a117771b73da80166
2019-02-21 12:55:54 +01:00
Mariusz
ff28cf5069 Fix location of hostdirs for Murano services
Use "{{ node_config_directory }}/murano-api/" for `murano-api` and
"{{ node_config_directory }}/murano-engine/" for `murano-engine`, so
correct `config.json` are mounted in containers.

Change-Id: I824ff00f6b86aac3eab5dc6fd01728653b4661d1
Closes-Bug: 1811716
2019-02-20 14:46:35 +00:00
Doug Szumski
e2ed302312 Parse Monasca Log API timestamps correctly
By parsing the creation_time timestamp in Logstash, Elasticsearch
can parse it correctly. This closes a bug where the creation_time
timestamp was shown as a date shortly after the epoch (1970) when
viewed in Kibana.

Closes-Bug: #1816585

Change-Id: I00decfe94607845ef0eae9bec631a0e729aac3fa
2019-02-19 14:06:52 +00:00
Doug Szumski
10ec566f56 Make Kafka maintenance easier
This commit enables two settings which are useful when restarting a Kafka node
as part of a cluster. The first supports moving partitions for which a node
being restarting is the leader to another broker, and the second supports
automatically rebalancing partitions when the node rejoins the cluster. See
the documentation for more details:

https://kafka.apache.org/10/documentation.html#basic_ops_restarting

Change-Id: I0718fca08ea116db926b348e3e6e3bc2373db1fb
2019-02-19 11:13:08 +00:00
Kien Nguyen
f77c67fa0e [Vitrage] Add Prometheus datasource configuration
Vitrage supports new Prometheus configuration now [1].
Kolla should allow user to configure this configuration
file.

[1] https://review.openstack.org/#/c/630514/

Change-Id: I84072d90b0342c6d460ee733ba646a5fb787faa9
2019-02-19 10:31:11 +00:00
Maciej Kucia
4a127d4bd9 designate: Correctly match hostnames
'in' expresion matches substrings, therefore it is possible
that following expression will fail:
    inventory_hostname in groups['groupname'][0]
for example when:
    inventory_hostname = 'my-host-a'
    groups['groupname'][0] = 'my-host-a1'

The result is running task on multiple hosts rather than single one.
Such action might result in playbook failure

Change-Id: Ibe2d5ca2f9502a8140a895ab3ac7abc5076ce2ff
Signed-off-by: Maciej Kucia <m.kucia@partner.samsung.com>
2019-02-18 17:28:15 +00:00
Zuul
23c439db0a Merge "Automate Monasca documentation for configuring Kafka" 2019-02-18 13:31:52 +00:00
Zuul
78b5739019 Merge "Fix MariaDB bootstrap issues on CentOS" 2019-02-18 09:23:29 +00:00
Zuul
5c68239f1c Merge "Karbor providers managed from deployment node" 2019-02-18 09:07:58 +00:00
Zuul
cdc664b7f7 Merge "Fix link to Manila Guide" 2019-02-15 06:00:39 +00:00
Michal Nasiadka
38c0a4f2d2 Fix MariaDB bootstrap issues on CentOS
Those issues intermittently show up in various branches,
in all cases it's wrong path used to resolveip binary.
Similar to the recent kolla-ansible-ubuntu-source job failures.

Change-Id: I8cce42b60897e4ceb8d3b0bd5181fda88b10c2b8
2019-02-15 02:32:05 +00:00
Doug Szumski
ecf0009608 Automate Monasca documentation for configuring Kafka
Until the Monasca Kafka client fork is removed it is currently required
to run Kafka in compatibility mode. It is also necessary to disable
an optimisation in the Kafka brokers to clean up idle connections. This
is because the optimisation was added after the Monasca Kafka client was
forked, and the client hasn't been updated since. These settings are now
applied automatically when Monasca is enabled.

Change-Id: I6935f1fb29f4f731cf3c9a70a0adf4d5812ca55e
2019-02-14 18:10:52 +00:00
Mohamed El Gindi
e65f4ec7cd Karbor providers managed from deployment node
Karbor provider configs can be injected/managed from 'node_custom_config' var

openstack-infra.conf will still be created if no custom providers present

Closes-Bug #1814464

Change-Id: I500daae80596cb7b7342fd8d4affa8f901b24a13
2019-02-14 08:52:33 -08:00
Zuul
efa9bdee5e Merge "disable cinder-backup caused deploy failed" 2019-02-14 15:02:42 +00:00
Pedro Alvarez
6c6759e9a0 Fix link to Manila Guide
Change-Id: I3defe0c38f41d7335e1cbafb75523c3cd44323ee
2019-02-14 13:50:23 +00:00
wu.chunyang
cdfc0442e9 add debug option to ceph mon or osd start command
when ceph_mon and ceph_osd start failed, add debug option will
print more info. now when ceph_mon and ceph_osd containers start
failed, docker logs ceph_mon print none log

Closes-Bug: #1815707

Change-Id: I3c5086019808a9738714f5279ec74cbb9b7a8587
2019-02-14 11:28:53 +00:00
wu.chunyang
13589484d4 disable cinder-backup caused deploy failed
when customize policy.json,disable cinder-backup caused deploy failed

Change-Id: I50bf72e52bff27dc4abc7b13436b2115f6a9e955
Closes-Bug: #1802221
2019-02-14 11:28:25 +00:00
Michal Nasiadka
189af13ba6 Fix py35/py36 and k-a-ubuntu-source gate jobs
- py35/py36 jobs are failing
python 3.6 pycache also includes links - so those also
need to be removed by tox testenv

- kolla-ansible-ubuntu-source job is failing
Without basedir set in galera.cnf - mysql_install_db looks for resolveip
in /usr/sbin, instead of /usr/bin, thus complains about cannot resolving
neither $HOSTNAME, nor localhost.

Change-Id: I40514c0a7c43ae01c7680aac81123942be1cdef9
2019-02-14 09:11:54 +01:00
Zuul
c2f3ba3d5d Merge "hinese quotes" 2019-02-12 14:32:11 +00:00
Jim Rollenhagen
51c9e1b633 Allow nova services to use independent hostnames
This allows nova service endpoints to use custom hostnames, and adds the
following variables:

* nova_internal_fqdn
* nova_external_fqdn
* placement_internal_fqdn
* placement_external_fqdn
* nova_novncproxy_fqdn
* nova_spicehtml5proxy_fqdn
* nova_serialproxy_fqdn

These default to the old values of kolla_internal_fqdn or
kolla_external_fqdn.

This also adds the following variables:

* nova_api_listen_port
* nova_metadata_listen_port
* nova_novncproxy_listen_port
* nova_spicehtml5proxy_listen_port
* nova_serialproxy_listen_port
* placement_api_listen_port

These default to <service>_port, e.g. nova_api_port, for backward
compatibility.

These options allow the user to differentiate between the port the
service listens on, and the port the service is reachable on. This is
useful for external load balancers which live on the same host as the
service itself.

Change-Id: I7bcce56a2138eeadcabac79dd07c8dba1c5af644
Implements: blueprint service-hostnames
2019-02-08 10:25:02 -05:00
Zuul
114521ccba Merge "Option "scheduler_default_filters" from group "DEFAULT" is deprecated." 2019-02-08 08:10:24 +00:00
Maciej Kucia
0d32b76a33 haproxy: Support for external IPv6 (VIP)
This change allows usage of IPv6 as public address

Change-Id: Ie82ec5fb0ac9106b39948c67d34d5ef611a8fa21
Signed-off-by: Maciej Kucia <m.kucia@partner.samsung.com>
2019-02-07 15:56:35 +01:00
caowei
cce2c53ebb Option "scheduler_default_filters" from group "DEFAULT" is deprecated.
Use option "enabled_filters" from group "filter_scheduler".

Change-Id: I042f0b011c060f9dbc645dbdbb60068cb41c0cc8
2019-02-07 10:20:23 +00:00
confi-surya
ae8d085ea7 Add missing dirs
We can see some contribution directory is missing which
exist parallel to other directories. Adding this information
to README is helpful for new contributors to understand
high level directory structure.

Change-Id: I4ed50b49aac1e9ab21957f4ec3da1b33883ad9b1
2019-02-05 19:10:14 +05:30
Zuul
23c555d9c5 Merge "remove pep8 from lower-constraints.txt" 2019-02-05 10:09:49 +00:00
Zuul
02e58e6dac Merge "Set [pxe] tftp_server in ironic.conf" 2019-02-04 12:04:49 +00:00
confi-surya
6fbc9008f8 remove pep8 from lower-constraints.txt
Older hacking version depends on pep8, but pep8 module is replaced
by pycodestyle. This is already resolved by updating hacking
version in https://review.openstack.org/#/c/627149/

pep8 is dropped, so no longer require in lower-constraints.txt.

Change-Id: I585e94098de20e0f541d4182367e904fc13d2ae6
2019-02-04 16:56:22 +05:30
Mark Goddard
4d64646699 Set [pxe] tftp_server in ironic.conf
The ironic TFTP server should be accessed via the internal API network.
For ironic inspector, dnsmasq.conf advertises this correctly:

dhcp-option=option:tftp-server,'api_interface_address'
dhcp-option=option:server-ip-address,'api_interface_address'

However, ironic conductor does not set the [pxe] tftp_server variable.
This means the TFTP server advertised gets the default value of $my_ip,
which is set by
https://docs.openstack.org/oslo.utils/latest/reference/netutils.html#oslo_utils.netutils.get_my_ipv4,
typically the source IP for the default route.

This change sets [pxe] tftp_server to 'api_interface_address'.

Change-Id: Ic3e688b3f2b92ad9515322f49cd5f4f29d763e49
Closes-Bug: #1808347
2019-02-04 09:48:52 +00:00
confi-surya
f32ea96cd2 Add zookeeper info to README
README is always a first point of interaction for users/operators.
So adding zookeeper info to it will help to understand its support
in Kolla.

Change-Id: I4829847b95575b6e83b3001e0d377ad1dd71ecfb
2019-02-04 09:36:30 +00:00
Scott Solkhon
9dbd300786 updating Designate docs with Infoblox configuration
Change-Id: I12af64725c0beec2ece0367c3773230c57908254
2019-02-01 13:08:50 +00:00
Zuul
dab5e74649 Merge "Add support for Infoblox in Designate role" 2019-01-28 15:21:38 +00:00
Zuul
45ee749a6a Merge "Link kolla_log volume dir to /var/log/kolla" 2019-01-28 10:40:59 +00:00
Zuul
da98030909 Merge "add ulimit support for kolla_docker" 2019-01-27 10:17:30 +00:00
Zuul
67d496b0e6 Merge "[prometheus] Support the prometheus openstack exporter" 2019-01-24 15:12:42 +00:00
Zuul
58772d53d5 Merge "Remove Vitrage Collector" 2019-01-24 09:34:52 +00:00
binhong.hua
93e5e8e631 Link kolla_log volume dir to /var/log/kolla
The path /var/lib/docker/volumes/kolla_logs/_data/ is too long
shorter log path will help to debug from log.
The volume path is compatible with docker-engine and docker-ce.

Change-Id: I9195d5f24d938f5060fe748aac3ae58c79ec5abf
2019-01-24 11:02:48 +08:00
binhong.hua
3d3f5f1613 add ulimit support for kolla_docker
By default, docker containers inherit ulimit from limits of docker
deamon. On CentOS 7, docker daemon default NOFILE is 1048576.
It can found in /usr/lib/systemd/system/docker.service.
The big limit will cause many problem. we should control it in
production environment.

Change-Id: Iab962446a94ef092977728259d9818b86cfa7f68
2019-01-24 10:54:14 +08:00
Zuul
0cbf0a6c7a Merge "Wait for volume attachment in CI before detach" 2019-01-23 07:21:54 +00:00
Zuul
29cc6d9dd7 Merge "Fix missing transport_url for ironic inspector" 2019-01-23 07:21:53 +00:00
Zuul
78375d548f Merge "repair ceph_nfs container start failed" 2019-01-23 07:21:51 +00:00
Bartosz Zurkowski
7e85677020 Remove Vitrage Collector
Vitrage Collector service has been removed from Vitrage in change:
Ie713456b2df96e24d0b15d2362a666162bfb4300.

Change-Id: I45023940c1d2573bfed49d4ce3fac16ed2d559e4
Signed-off-by: Bartosz Zurkowski <b.zurkowski@samsung.com>
Co-Authored-By: Kien Nguyen <kiennt65@viettel.com.vn>
2019-01-23 09:39:49 +07:00
Scott Solkhon
2520a421bc Add support for Infoblox in Designate role
This change adds support for Infoblox as a backend for Designate.

Change-Id: I7ae038befa88f5a1b3a1187a0e9037ed30f94b17
2019-01-22 14:29:40 +00:00
Dai, Dang Van
19edefaf9a Fix missing transport_url for ironic inspector
Change-Id: I81d56dd850c18298987376740ccfea05fe59267f
Refer: https://storyboard.openstack.org/#!/story/2001842
2019-01-22 16:55:06 +07:00
caoxufeng
7f839d7258 oslo.config>=5.2.0 which is a dependency of kolla-ansible requires rfc3986>=1.2.0
Change-Id: I43cc9be3df6ae99942f1862171512a300fcf926f
2019-01-22 17:33:38 +08:00