298 Commits

Author SHA1 Message Date
Borne Mace
42c2419353 Fixed pep8 failures in all tools/ scripts
Change-Id: Ie6e77a4d45210122746b544a1aa8da563833e395
Partially-Implements: blueprint enable-flake8
2015-07-07 08:34:43 -07:00
Jenkins
b65892310a Merge "Add new build script" 2015-07-07 08:22:09 +00:00
Sam Yaple
0e0b7e77ab Add new build script
This new build script is written entirely in python and supports
multithreading to speed up the builds.

Partially-Implements: blueprint build-script
Change-Id: Ia630e5a83951ec37706a9596427024f3b7c10ba7
2015-07-07 07:19:49 +00:00
Jenkins
d5a9040f70 Merge "Sort variables and remove duplicates for min env doc" 2015-07-06 15:12:21 +00:00
Jenkins
a13e52d4e8 Merge "Make tools/min-env.sh portable" 2015-07-06 15:12:15 +00:00
Jenkins
5992cb86f2 Merge "Add validation script for min env vars documentation" 2015-07-06 15:11:50 +00:00
Jenkins
cb7115241b Merge "Fix CONFIG_STRATEGY var in bash scripts" 2015-07-05 03:12:04 +00:00
Martin André
36eab6a1c3 Sort variables and remove duplicates for min env doc
The script generating docs/minimal-environment-vars.md now sorts
variables alphabetically per service and remove duplicates.

Update minimal-environment-vars.md.

Change-Id: I30cc674b6e9834f2a6c771bd30539a21af39b228
Closes-Bug: #1470504
2015-07-05 09:07:46 +09:00
Martin André
a082d38b97 Make tools/min-env.sh portable
We had different issues here.

First, sort command used to sort variables and services names is
dependent on the local, so fix it to C to have consistent
results. C local is available on all systems.

Second, awk doesn't recognize \s escape char for space on OSX. This
resulted in indented check_required_vars calls being ignored. In fact,
all variables checked via indented check_required_vars calls (i.e. in
a fuction or conditional block) are actually *optional* variables, so
I changed the behavior to ignore those.

Change-Id: I6fc4cca9567cb712609d0fe0a20dfe21ed6df151
Closes-Bug: #1470683
2015-07-05 08:48:41 +09:00
Martin André
97e8dc5e20 Add validation script for min env vars documentation
Change-Id: I46ffa01d0097916055857c3f968e716e0229795f
Partially-implements: blueprint add-min-env-vars-gate
2015-07-05 08:36:21 +09:00
Jenkins
1054ccbb8c Merge "Add new script to fetch tarballs for source installation" 2015-07-04 20:11:00 +00:00
Jenkins
0d26ed0a0a Merge "Add validation script for broken symlinks" 2015-07-04 03:26:25 +00:00
Harm Weites
2c8ca64856 Fix CONFIG_STRATEGY var in bash scripts
It should read KOLLA_CONFIG_STRATEGY.

Change-Id: I1819b4b1b6e28e8f83ad01c078d4c6e4c502587e
Partial-bug: #1471326
2015-07-03 21:16:35 +02:00
Paul Bourke
7b4eedb563 Add new script to fetch tarballs for source installation
This script will be sourced from the build scripts to provide alternate
ways to fetch/generate a source tarball. This tarball can then be
provided to a Dockerfile for source installation.

Change-Id: I0212a83d098b8d83446f69b92c2b07ef39a93c10
Partially-Implements: blueprint install-from-source
2015-07-03 17:20:57 +00:00
Jenkins
0dbf3e2e11 Merge "Remove duplicate PUBLIC_IP entry from tools/genenv" 2015-07-02 21:27:10 +00:00
Martin André
e6ef6218da Add validation script for broken symlinks
Change-Id: Iae6d9f26e1a8dd7d565e9dbd815816c26cb92b74
Partially-implements: blueprint add-broken-symlink-check
2015-07-02 09:09:41 +09:00
Paul Bourke
5afdab4787 Remove duplicate PUBLIC_IP entry from tools/genenv
Change-Id: I385638f4b633aa74fa617f66ab0329556fa314ea
Closes-Bug: #1470456
2015-07-01 11:36:44 +01:00
Sam Yaple
3ac7da64d1 Add initial config function and keystone support
Add set_configs function that implements the flow from the proposed
ansible-multi spec. Move start.sh to config-internal.sh to preserve existing
behaviour.

config-externall.sh copies the appropriate configs in from the bind'd
location and sets permissions and ownership appropriately.

Partially Implements: blueprint ansible-multi

Change-Id: I53fca0660451087f273fefc3c63e0d8cf1a2c096
2015-06-30 17:26:23 +00:00
Harm Weites
73a6ba90c4 Properly set MAGNUM_API_SERVICE_PORT
While at it, place this var in the same place as the other MAGNUM scoped vars.

Change-Id: I7f142415d7fb1874d77778d3d1301956f9799a83
Closes-bug: #1469561
2015-06-28 21:27:32 +02:00
Sam Yaple
62e02fdbf4 Partially revert thin neutron containers
Due to a revert in the Docker code, thin neutron containers do not work
at this time. The neutron plugin agents do not need to exist in the same
container as the other agents however. This allows for using either
linuxbridge or openvswitch

The docker commit that did the revert:
ff770d33cd

Closes-Bug: 1469307
Change-Id: Idf79c31c74c34b93f5a9bac49730aca49bbdb861
2015-06-27 16:39:34 +00:00
Jenkins
a48900bc1c Merge "Liberty requires Cinder to use the v2 API" 2015-06-26 22:13:55 +00:00
Ryan Hallisey
3935cbafa3 Liberty requires Cinder to use the v2 API
The Liberty release of Cinder will remove the v1 api so we
need to disable it in the cinder_api container and use v2.

Change-Id: I5dab7214d4d39afdf92555e3ffbd7f4a6194cd45
Closes-bug: #1469177
2015-06-26 17:17:34 -04:00
Jenkins
8708de74fb Merge "Add missing Magnum vars" 2015-06-26 21:03:55 +00:00
inc0
552effa0d1 Add missing Magnum vars
Add missing vars to genenv and integration guide Magnum requires.

Co-Authored-By: Jeff Peeler <jpeeler@redhat.com>

Change-Id: I615098cffc081a53127275a07e95fecc924a862c
Closes-Bug: #1468997
2015-06-26 16:21:23 -04:00
Michal Stachowski
1d9c5f914c Add missing openstack.env vars and export to heat
Heat failed on heat-keystone-setup-domain because it requires openrc
style of env vars. Also, genenv missed Keystone port env vars.

There are several openrc instances that are using the keystone public
port, bug filed: https://bugs.launchpad.net/kolla/+bug/1469209

Change-Id: I03b57c43c38fb3ebded4d6f206161cf02fb4883d
Closes-Bug: #1469003
Co-Authored-by: Jeff Peeler <jpeeler@redhat.com>
2015-06-26 15:34:23 -04:00
Ryan Hallisey
258d6ae3f3 Allow /dev/pts proper permissions so cinder and libvirt work
We need to mount /dev both Libvirt and Cinder containers and
/dev/pts is not correctly mounted.  The /dev/pts recieves no
permissions from the host so it becomes inacessable.
We need to change the permissions of /dev/pts in the container
to 666.

Change-Id: Id197a766adc3aecb24e6b10aa84f51c23124b488
Closes-bug: #1468951
2015-06-25 22:02:32 -04:00
Jenkins
aa0c8b5fe9 Merge "Add retry parameter to build-docker-image" 2015-06-25 14:45:12 +00:00
Martin André
f370edfb70 Add retry parameter to build-docker-image
Partial-Bug: #1466677
Change-Id: I2fc2ded47bb2ed34fb1e272d35b0758f098ce0ac
2015-06-25 11:59:02 +09:00
Harm Weites
24577bdeac Check if tools/genenv binary dependencies are met.
The check is using the bash-native 'type' instead of which, because which
is not always available on all environments.

Current implementation only checks for the availability of openssl but
this can be easily expanded.

Change-Id: I97e8f52ea664ef80901deae9dea8acc93b6e1ca4
Closes-Bug: #1463101
2015-06-25 11:21:09 +09:00
Daneyon Hansen
4a4cf92eb9 Fixes MariaDB to support Heat
When spawning Heat stacks, the DB reaches the max_connections
limit. This causes MariaDB to block all traffic by source IP,
essentially blocking all services. This patch introduces the
MARIADB_MAX_CONNECTIONS parameter to make the max_connections
configurable. The default of 151 max_connections is maintained.

Closes-Bug: #1465422

Change-Id: I869aa9f117c6fa959b1c6948dfc379f30a6bc1d7
2015-06-24 19:57:31 +00:00
Harm Weites
f23a35651e Configure Heat service domain
Change-Id: Iefc2dfea4bf4ce2fa9a5d1f013594929d218b9fc
Closes-Bug: #1463970
2015-06-24 20:38:37 +02:00
Jenkins
b9d8dc63fd Merge "Auto generate minimal environment variables doc" 2015-06-24 15:35:02 +00:00
Jenkins
6766632b9c Merge "Change fat neutron container into thin containers" 2015-06-24 15:28:59 +00:00
Ryan Hallisey
01e90ec2e5 Auto generate minimal environment variables doc
This script will generate the minimal-environment-variables doc
based on the what each services has in the check_required_var field.
Anytime that field is changed run this script and commit the changes.
Since Neutron is a thick container, the script will get a few duplicates
in the neutron-agents field.  When Neutron is thinned out, this script
will function normally.

Closes-bug: #1459347

Co-Authored-By: Lon Hohberger <lhh@redhat.com>
Change-Id: I1ba6bd5148af12cacfd872591b3c7b84a8dccba2
2015-06-24 10:47:21 -04:00
Sam Yaple
98460af04d Change fat neutron container into thin containers
Key difference here is the ip_wrapper.py file. This file and docker 1.7
allow for the network namespaces to be created in the host mount
namespace and propogated into the containers.

Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>
Change-Id: I73bcd1c97bbaf742af883dbf281a8d76aff8aebf
2015-06-24 14:41:23 +00:00
Michal Stachowski
214ac7e608 RabbitMQ container with HA support
This is new RabbitMQ container with support for HA. It's next step for
provide HA support in Kolla project. RabbitMQ is supporting now
active/active model and It's ready for active/passive model.

Change-Id: I2eb6c65f6268ee96d377e72cf880a01c8042559e
Implements: blueprint rabbitmq-ha
2015-06-24 14:10:10 +02:00
Jenkins
54aa5d2fd1 Merge "Keepalived container" 2015-06-24 06:01:40 +00:00
Jenkins
2336ba39d4 Merge "Fix Heat container env vars and dependencies" 2015-06-24 05:58:50 +00:00
Jenkins
93d124693b Merge "Add --prefix to override .buildconf" 2015-06-23 12:12:00 +00:00
Ryan Hallisey
2dbde4ad8e Add option to not run db sync
Database syncs should not be required every time a container starts.
We can default database startup to true, but give the option
to set it to false.

Change-Id: Ib76876b2671f6c31f4511412efd3a438ec78f01f
Closes-bug: #1467576
2015-06-22 16:37:14 -04:00
Michal Jastrzebski (inc0)
52f4909435 Keepalived container
This patch contains keepalived container for yum-based distros.

Change-Id: I8e3ea7a61ad6c27b25b635e7aeeff5ef04a807b4
Implements: blueprint keepalived-container
2015-06-22 17:18:44 +02:00
Jenkins
4fdaf6a1ce Merge "Fix 'unsupported locale setting' errors in init-runonce" 2015-06-21 12:18:33 +00:00
Sam Yaple
4a899d754f Add --prefix to override .buildconf
Add in the ability to override the prefix in .buildconf files removing
the requirement to set the prefix in a .buildconf to limit the number
of images built.

Partially Implements: blueprint refactor-base-image-layout

Change-Id: I1da1559e660adc2fe9eaf5e17ce427c89645a8b7
2015-06-20 09:09:58 +00:00
Jeff Peeler
1962bfb16e Fix Heat container env vars and dependencies
This commit adds a few dependencies (that are actually packaging errors)
present in all of the containers, as well as specifically in
heat-engine. Some of the environment variables were not set correctly in
the heat-api-cfn container. The environment variables have also been
correctly added to the genenv script.

Also removed duplicated compose file data already present in
heat-api-engine.

Closes-Bug: #1461872
Change-Id: I9631d1bc6ea42425272570a9dda8cbf5edcef4f3
2015-06-19 17:33:32 -04:00
Ryan Hallisey
72d1ef47dd Add cinder into the docker compose setup
This patch adds the docker-compose files, updates the docs,
and adds cinder to the start command.

Implements: blueprint container-set-storage-operation

Change-Id: I5386851e2247c00696704dc26a8a286451d4bf59
2015-06-19 13:15:48 -04:00
Paul Bourke
018a07984a Fix 'unsupported locale setting' errors in init-runonce
Keystone requires a valid LC_ALL environment variable to be set, if left
empty the following output is shown:

"""
$ tools/init-runonce
Downloading glance image.
Creating glance image.
[=============================>] 100%
<snip>
Configuring neutron.
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
unsupported locale setting
Could not find any suitable endpoint. Correct region?
<snip>
"""

A similar problem occurred in devstack
(https://bugs.launchpad.net/devstack/+bug/1249131), apply the same patch
they use to to sanitize language settings
(https://github.com/openstack-dev/devstack/blob/master/stack.sh#L27).

Closes-Bug: #1466548

Change-Id: I8e86a4466181d6dd1c1749915c1c43521af805b7
2015-06-19 16:10:47 +00:00
Jenkins
037b8c4d46 Merge "Add designate-sink service" 2015-06-19 15:54:54 +00:00
Jenkins
f3d47fe965 Merge "Fixed indentation issues to meet bashate compliance" 2015-06-19 15:40:37 +00:00
Michal Rostecki
1420d63c7f Add designate-sink service
Container for Designate Sink, automatic domain creation for
enabled notification handlers (nova and/or neutron).

Change-Id: I41118cb149e7f39a17bff49123d82905b51b7939
Blueprint: designate-container
2015-06-19 17:08:47 +02:00
Michal Stachowski
abbee7dbca Galera container
This changes are providing support for galera cluster. It's important for
project to has got support for database cluster as a one of the steps to
providing High Avability(HA) in Kolla project

Change-Id: If51bb88ab05972d3b8aa8abbbbd2a5480213a10e
Implemented: blueprint galera-container
2015-06-19 16:14:34 +02:00