298 Commits

Author SHA1 Message Date
Jeff Peeler
485e1b2539 Improve logging and prepare for gate
Switched all print statements to use logger

Added ability to halt operations via Ctrl-C, needs cleanup handler

Added realtime logging when using only one thread (matches bash building
scripts behavior)

main is now returning all the build image statuses, so a quick test
script would look like:

import build
res = build.main()
if len(res[0]):
    LOG.error('failure')

Change-Id: Ic8000a96573b011490dc330a4512c77c602ac3d2
Partially-Implements: blueprint build-script
2015-08-11 11:24:22 -04:00
akwasniewska
310627890c Added initial template for base image
Added new method generating Dockerfiles from templates as well as the
appropriate code to support this in build.py

Co-Authored-By: Sam Yaple <sam@yaple.net>
Partially-implements: bp dockerfile-template

Change-Id: Id14d10d31cb4aac957e04fbc129de4043d98e033
2015-08-11 05:56:15 +00:00
Paul Bourke
a6454f15f2 Implement Murano source images
* Both api and engine start up without error, but can't test properly
until Horizon is fixed (bug #1482196)

* These are source installs are there no RPMs available for Murano
that I can find.

* Also requires a plugin for horizon that will be made as a
separate commit

Co-Authored-By: Mick Thompson <michael.a.thompson@oracle.com>
Implements: blueprint enable-murano-container

Change-Id: Ia46985b21bb5f6d7690501e7199800c8c7fcb51f
2015-08-10 15:52:21 +00:00
Jenkins
b6d3f61760 Merge "Remove validate-min-env-vars gating" 2015-08-09 15:38:21 +00:00
Jenkins
0b63b64d05 Merge "Set curl as the default source install method" 2015-08-08 06:13:27 +00:00
Steven Dake
33d8d32381 Remove validate-min-env-vars gating
We don't use config-internal anymore, so remove validate-min-env-vars
from being gated upon.  This is becuse there is no minimum
environment variables required.  While we are at it we remove
min-env.

Partially-Implements: blueprint remove-config-internal

Change-Id: Ibe2947b35e4dc1549e82acc66c01153495a91882
2015-08-07 20:18:33 -07:00
Jenkins
10164f06d8 Merge "Adds push to build script" 2015-08-06 20:25:41 +00:00
Paul Bourke
4a2ef1f21d Set curl as the default source install method
As much faster than git clone

Change-Id: I173592f1efceac61b49c37f994004cc41c641ae0
Closes-Bug: #1481670
2015-08-05 10:40:41 +00:00
Sam Yaple
fca1e0658a Adds push to build script
This works as is, but could use some cleaning up and threading needs
to be confirmed broken. If it isn't broken, it should be implemented.

Co-Authored-By: Swapnil Kulkarni <me@coolsvap.net>
Change-Id: I708406dcff8aa9b2f4064f03bda07873ce97d994
Paritally-Implements: blueprint build-script
2015-08-05 04:50:21 +00:00
Paul Bourke
07460f88f2 Add missing vars for Keystone
Got removed as part of a refactor

Change-Id: I7dc47f4af316188803fe2fc654316540b8d23cf8
Closes-Bug: #1480465
2015-08-04 12:24:31 +00:00
Paul Bourke
853fa53929 Re-add executable bit to tools/genenv
Change-Id: Icf845822735babc78ca427c00a2a125c8f0cca32
Closes-Bug: #1481293
2015-08-04 11:43:47 +00:00
Jenkins
119a60b926 Merge "Remove service_hosts.sh" 2015-08-04 10:21:32 +00:00
Swapnil Kulkarni
b396395df4 Temporary remove gnocchi from kolla-compose & functional tests
Current with due to LP#1478145 the kolla-compose script
fails to create gnocchi containers. Temperory fix to skip
gnocchi till we have gnocchi packges in delorean.

Change-Id: I7dc6aef82908a846a8b632f86a16de47c1a2eef9
Partial-Bug: #1478145
2015-08-03 09:56:05 +00:00
Swapnil Kulkarni
fd92ad8a27 Remove service_hosts.sh
* Remove service_hosts.sh file
* Add all the required variables to tools/genenv

Change-Id: I23954bf148923fbe785f51012fc9c9da909fa380
Closes-Bug: #1447867
2015-08-03 05:10:35 +00:00
Jenkins
8ffa0f5333 Merge "Adds an example openrc file" 2015-08-01 19:29:55 +00:00
Paul Bourke
1ecb7a82e2 Fix missing quotes in tools/genenv
Change-Id: Idc5f8aef80a65fea13fecd62b6b40c8ef7458354
Closes-Bug: #1480296
2015-08-01 00:33:03 +00:00
Sam Yaple
7a25b6bea3 Adds an example openrc file
Change-Id: Ie056a8347f6b72ffb647bfb79ee4449ca45f3fef
Closes-Bug: #1476294
2015-07-31 23:58:36 +00:00
Borne Mace
76cdc9fe49 Initial kolla-ansible command - deploy support only
Change-Id: I4f6f38b2a202b41a9dec839fa0222585b49fc06c
Partially-Implements: blueprint kolla-ansible-script
2015-07-31 14:39:05 -07:00
James McCarthy
5e28eb8496 Implement Swift Containers
Known bugs/TODOs at this time of this patch update:

https://bugs.launchpad.net/kolla/+bug/1477990
https://bugs.launchpad.net/kolla/+bug/1477993

Implements: Blueprint swift-container
Closes-bug: #1477992
Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>
Change-Id: I031f88a7cd1867104fef12df6ab3ffcc06cb65d6
2015-07-31 09:36:11 +00:00
Jenkins
731d5205cb Merge "Update service helper scripts for variable changes" 2015-07-30 18:54:43 +00:00
Swapnil Kulkarni
d4c7129dc3 Remove not required echo
- tools/validate-links.sh has a echo which
  is not necessary. Removed it.

Change-Id: I122c995bc5d99592212505ce23256e27685b4af4
Closes-Bug: #1479647
2015-07-30 06:57:27 +00:00
Swapnil Kulkarni
1c147e4def Update service helper scripts for variable changes
- Updated the required variables to be sorted so
  that they are better visible one on each line

- Removed variable defaults from each service scripts
  and added them to tools/genenv file which holds
  all default values

Change-Id: Ia7b1b08ba3f963b46b81434ce84f476d56890a93
Closes-Bug: #1476494
Closes-Bug: #1467652
2015-07-29 18:08:50 +00:00
Jenkins
062388fca9 Merge "Make variables in OVS container configurable" 2015-07-28 21:41:41 +00:00
Jenkins
521a671ef9 Merge "Implement kolla-compose script" 2015-07-27 10:54:35 +00:00
Jenkins
9219cefbaf Merge "Update init-runonce" 2015-07-27 10:50:58 +00:00
Swapnil Kulkarni
dd2e2ad8e2 Make variables in OVS container configurable
Change-Id: I8d216ca20c97428e3b27d48d0a5249282dcb8c18
Closes-Bug: #1468509
2015-07-27 07:47:39 +00:00
digambar
e245eb2ff5 Implement kolla-compose script
Renamed kolla script to kolla-compose
Update change in the dev guide also

Change-Id: I6cae3d13752ecb4bb3deeb91c5e0f827fde80c2a
Implements: blueprint kolla-compose-script
2015-07-27 12:18:56 +05:30
Jenkins
0718429344 Merge "Add Gnocchi service to kolla" 2015-07-24 12:02:06 +00:00
Sam Yaple
005ec9ee70 Update init-runonce
This makes some changes to init-runonce to allow using Ansible as well as
updating it to use the openstack-client where applicable since the
keystone-client is not usable with keystone v3 api at all.

Change-Id: I6b9d6beb04df7724b1967638e98042ab03221cd1
Closes-Bug: #1477725
2015-07-23 21:05:11 +00:00
Daneyon Hansen
171a64bcd8 Removes Host Cleanup from Container Cleanup Script
Split the content of cleanup-containers into containers cleanup and host
cleanup. This allows to run the cleanup-containers from OSX clients,
while keeping needed code to delete host artifacts left behind by the
neutron agents container.

In addition, cleanup-containers may disappear in the future, replaced by
a docker-compose wrapper.

Co-Authored-By: Martin André <martin.andre@kvhasia.com>
Co-Authored-By: Swapnil Kulkarni <me@coolsvap.net>
Change-Id: I3aa731e7e0f9eb3dad9c363bb5d4a575d84a2fae
Closes-Bug: #1477383
2015-07-23 04:24:05 +00:00
Swapnil Kulkarni
870ec615d6 Add Gnocchi service to kolla
Co-Authored-By: Swapnil Kulkarni <me@coolsvap.net"
Change-Id: I81e5e6bfde3323e6917e3d61e3db760e2fec2019
Implements: blueprint gnocchi-containers
2015-07-23 03:43:04 +00:00
Jenkins
e70b08b662 Merge "Fix checking out custom refs in gen-source-tar" 2015-07-17 21:05:38 +00:00
Jenkins
a6ccb90922 Merge "Start tgtd in cinder-volume container" 2015-07-17 15:32:42 +00:00
Jenkins
a5b6b2f0d7 Merge "Parttially implement ceilometer container code" 2015-07-17 11:33:45 +00:00
Paul Bourke
58678fb2b4 Fix checking out custom refs in gen-source-tar
It seems using --git-dir to execute commands on a repo different to
where you currently are also inexplicably requires --work-tree
(https://stackoverflow.com/questions/1386291/git-git-dir-not-working-as-expected)

Change-Id: I42806e7d8a169ad9fc1878a0f4e0c03c57beb88b
Closes-Bug: #1475385
2015-07-17 11:28:32 +00:00
Christian Berendt
57093e8dfe Only use default values for MY_IP/MY_DEV in genenv if not set
This way it is possible to manually specify MY_IP/MY_DEV when running
the genenv script.

Closes-bug: #1475572

Change-Id: I291815a4ed1ea15adbddf94905706c77c8bb5a09
2015-07-17 10:14:19 +00:00
Swapnil Kulkarni
08a1414738 Parttially implement ceilometer container code
Added the compose yaml file
Added the genenv
Added fixes to run the containter

Change-Id: Ied3ea92e495fc0fc0274a0da736394d2ab52a754
Partially Implements: blueprint ceilometer-container
2015-07-16 15:27:19 +00:00
Steven Dake
4008ca8619 Start tgtd in cinder-volume container
The tgtd process was not being started in the cinder-volume container.
This results in iSCSI not being avialable for Cinder to operate
against.  Unfortunately cinder doesn't report the problem because LVM
is responsible for the iSCSI mapping.

Co-Authored-By: Ryan Hallisey <rhallise@redhat.com>

Closes-Bug: 1473090
Closes-Bug: 1469323
Change-Id: Ie3403c5c3f81beb48960e838b4274e0c5796e387
2015-07-15 10:35:31 -04:00
Jenkins
1699910851 Merge "Improve build.py" 2015-07-15 11:20:54 +00:00
Sam Yaple
2a6437efdd Improve build.py
Fixed docker client to use ENV if exists to support boot2docker.

Fixed booleans not working as thought with argParser.

Change-Id: I232ed78443199ce20f4b38e12c861c0f97d55c99
Partially-Implements: blueprint build-script
2015-07-14 12:20:04 +00:00
Swapnil Kulkarni
1f0acbd0cd Update scripts to check if docker is usable for $USER
Added new script for checking user permissions on
docker command execution

Change-Id: I3b727590d9a29f416f5b847912b7250c555c2333
Closes-Bug: #1473554
2015-07-14 09:38:49 +00:00
Jenkins
69338a94ba Merge "Remove requirement for root user in scripts" 2015-07-13 04:08:36 +00:00
Jenkins
9b9923fa71 Merge "Fixed additional OpenStack pep8 issues" 2015-07-10 21:01:22 +00:00
Jenkins
61a5d91f5b Merge "Properly wait for Openstack services to be ready" 2015-07-10 20:47:01 +00:00
Swapnil Kulkarni
aff8e49af6 Remove requirement for root user in scripts
The following files had requirement for root user
which can be removed as long as as the the user
executing script is part of docker group

Scripts updated
tools/kolla
tools/cleanup-containers

Closes-Bug: #1473551
Change-Id: Ia4aea205f5da20fb1ded4f7a5d11eeebe5f40aa9
2015-07-10 20:33:18 +00:00
Borne Mace
fa63119f96 Fixes the last of the hacking based pep8 errors
Change-Id: I628c6cd493c112b00d8202725456c3fb863f5446
Partially-Implements: blueprint enable-flake8
2015-07-10 12:56:56 -07:00
Borne Mace
30a1988f0a Fixed additional OpenStack pep8 issues
The "hacking" package used in most OpenStack repos pulls in
additional pep8 rules.  This commit should fix all of them
other than a hand full in the build.py file which will
be fixed in a separate commit

Change-Id: I40a0a30d338592ad64123e3da5523b9ad95a7a9c
Partially-Implements: blueprint enable-flake8
2015-07-10 12:01:28 -07:00
Harm Weites
aef25bbaa8 Properly wait for Openstack services to be ready
Just checking for an account in keystone is pointless since nova and
neutron take way more time before they are fully operational. If the user
would continue as tools/kolla suggests, the init-runonce script would
fail because either nova or neutron would not be ready for service.

Change-Id: I8fbfaa16d961b418b9ac6a34d311adb8e41b61e9
Closes-bug: #1471331
2015-07-10 20:47:08 +02:00
Swapnil Kulkarni
ba1901de65 Add config-internal/config-external for barbican
Partially Implements: Blueprint standard-start

Change-Id: I34b4d96515b4c68d42319b477504abdfe9581bad
2015-07-09 12:08:47 -04:00
Alicja Kwasniewska
fcda6a06d8 Keystone installation from source
Makes use of new gen-source-tar script to provide a source based
keystone image.

This patch introduces a new concept of a .buildinfo file, which provides
variables specific to the image being built which cannot be defaulted in
a generic way, at least until the build script is overhauled. This file
is sourced before the .buildconf which still leaves everything
customisable by the user.

Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>
Change-Id: I0ec6b9cfe6d4173f3192e4ae5833fb0f6d333f1c
Implements: blueprint install-from-source
2015-07-09 11:06:58 +00:00