276 Commits

Author SHA1 Message Date
Michal Rostecki
9a9c0ce944 Remove memcached container in cleanup-containers tool
Change-Id: Ic56b7b2fd6cd7d191cc364a37f3ebbc44950932e
Closes-Bug: #1508780
2015-10-22 06:47:32 +02:00
Kuo-tung Kao
1e86af763b put conatiner name to array in cleanup-containers
The brace in string variable will not be expanded in some case.
Put conatiner name into array.

Change-Id: I2fb16e7352bd579f207efce0fb9b2565a1e7236d
Closes-Bug: #1502467
2015-10-06 13:55:58 +08:00
Sam Yaple
0ac5e048c6 Improve cleanup script
Its still dirty, but at least it won't kill all your containers.

Change-Id: Ie468210bd0f273432ca16fc9530bf9acd2a808ed
Closes-Bug: #1486620
2015-09-27 08:41:02 +00:00
Hui Kang
ed0829ae5e Fix a small bug of wrong path to validate-docker-execuate
Change-Id: I61e7ac2bb0ec0b960dc807d8880d5da105aacd14
Closes-Bug: #1497463
2015-09-18 18:21:29 -04:00
Martin André
14acb298c2 Make kolla-ansible work in pip installed kolla
This is a quick hack to get kolla-ansible working with pip installed
kolla, kolla-ansible will need to be rewritten at some point in python.

Closes-Bug: #1495797
Change-Id: I7cf8c4baae76ff8f31514f64bed934848a1c3e40
2015-09-15 14:44:01 +09:00
Kai Qiang Wu(Kennan)
da68e2eccc Improve scripts with some check before kick rm command
Closes-Bug: #1490387
Change-Id: I4a9476085b9c5b2cae3801e5b1954e85068f4e03
2015-08-31 05:13:59 +00:00
Jenkins
438599b79a Merge "Use external address in openrc-example" 2015-08-28 15:50:51 +00:00
Steven Dake
c950212079 Use external address in openrc-example
This is mostly a docs change.  The external address should be used
rather than the internal address when sourcing openrc-example.
The internal address may not be accessible from outside the VIP
interface.

Change-Id: I10ac0c116227af9c4409a050203e2a28e3a116a2
2015-08-28 15:06:41 +00:00
Steven Dake
f895ee07cc Remove docker directory
Remove the docker directory (yay) and old build tools.

This will result in an f21 failing gate - however, I have a patch
submission to remove that gate from our project configuration.

Change-Id: I3c461cedb6906422c8076f60c470e773d6cdcf33
Partially-Implements: blueprint remove-docker-dir
2015-08-28 00:50:30 -07:00
Suhail Syed
bd8d795124 Modified build.py to run from installed location
Modified build.py to run from installed location or developer
environment. To run from development environment, run the
command:

sudo pip install -e .

Additionally, remove a TODO that has been done

Co-Authored-By: Sam Yaple <sam@yaple.net>
Change-Id: I922696ba439da2c9747e65cddcba47203e54d220
Implements: blueprint python-package
2015-08-25 06:46:15 +00:00
Suhail Syed
d3872aa9ee Make Kolla installable via PIP
Install Ansible code, etc file examples, scripts, an open
rc example, a tool to initialize the OpenStack deployment,
and other various useful bits.

Start the versioning at 0.1.0 as recommended by ttx.

Change-Id: I35fa4042040957e7725c7fc3b146009e0135499a
Partially-Implements: blueprint python-package
2015-08-24 16:08:49 -07:00
Michal Jastrzebski (inc0)
48c0ecf546 Build.py regex filtering
Adds option to build.py to only build images matching and its
dependencies

Change-Id: I281bea5bed932b7c948b247392fa6a52b1d1aecf
2015-08-24 13:33:18 +00:00
Sam Yaple
4bce5cca0a Add retries to build.py
Additionally, fix an if statement to catch multiple layers of parent
images failing so the grandchildren do not attempt to build either.

Change-Id: Ie9cdf7600e067678e52938910f0d3c072adcdf8a
Partially-Implements: blueprint build-script
2015-08-23 15:02:39 +00:00
Michal Jastrzebski (inc0)
598fe7bad1 Add custom code to base docker templates
Sometimes you need custom code in Docerfiles to solve for example
proxy problems or preconfigure base image in some specific way.
With this commit you can insert content of custom file to the beggining
of base Dockerfile to provide these changes

Partially-implements: bp rhel-based-image-support
Partially-implements: bp add-proxy-to-dockerfiles
Partially-implements: bp build-script
Change-Id: Idbfec764aad627f5c00dc09c4854d5fa1c5ac9cf
2015-08-21 20:21:41 +02:00
Sam Yaple
49a9fba23e Allow Docker to make better use of cache
Docker cache takes into account things like filesize, hash of file,
and even timestamp and access times when determining whether to use
the cache or not. This modifies the build script to adjust all the
timestamps to 0 epoch. Since we dont care about timestamps this allows
us to make far better use of the cache, including when downloading and
creating tarballs for source builds.

Change-Id: Id4287cf1fcaa2de63feaab9e6f4ebbd4defdb768
Partially-Implements: blueprint build-script
2015-08-20 15:35:28 +00:00
Jenkins
41fabba084 Merge "Move defaults.yml to group_vars/all.yml" 2015-08-19 10:25:32 +00:00
Steven Dake
bd5e5bbb64 Use one data container for all data volumes
The previous method of using the API image for a data container
worked, but resulted in more data being bindmounted and copied
into the system.  This patch resolves that by essentially using
a distro-type as a FROM in a Dockerfile to generate
distro-type-data.  Further all of the data containers used
throughout ansible are modified to use this new data container.

Change-Id: I8846573d4f2d4b98d4f46c770bfefc6d4c5cd0b5
Partially-Implements: blueprint one-data-container
2015-08-18 20:52:27 -07:00
Sam Yaple
8d65921bc3 Move defaults.yml to group_vars/all.yml
The purpose for having defaults.yml on the command line was originally
for variable inheritance. Over the past month we have slowly changed
how things are inherited (like ports) allowing us to place these
'defaults' into the group_vars/all.yml location as they should be
values that go unchanged (but can be overridden).

Change-Id: I2becec66bf431bfc9d88fc825b5380c1e173ca70
Partially-Implements: blueprint update-configs
2015-08-19 03:18:16 +00:00
Jenkins
af419c835b Merge "Remove compose from documenation" 2015-08-17 20:19:05 +00:00
Steven Dake
6efe57e9eb Remove compose from documenation
Receive several quickstart related questions every day.  Make a
first pass at cleaning up our documentation to point people
in the right direction.  While we are about it remove compose
related bits.  Anything in the compose directory will remain as
a reference implementation for how to implement the compose
files to work well with our container content.

Change-Id: I9e832e97ac2bacca8eab7e1bfbd82664d2b191b8
Closes-Bug: #1485163
Paritally-Implements: blueprint remove-config-internal
2015-08-17 11:34:36 -07:00
Steven Dake
971d83645d Fix gate source building
Fix a backtrace.  Also add the default master locations for
the various tarballs.

Change-Id: I9675c2619b95c0ae6a467ffbf964c4b17ae4b791
Paritally-Implements: blueprint gate-source-builds
2015-08-17 10:06:06 -07:00
Jeff Peeler
67ce01fc62 Safely check for dictionary key presence
Accessing the key directly when it doesn't exist was yielding a
KeyError.

Change-Id: Ice877b74d46d59f2e9ecff051b09245e9d3744e1
Paritally-Implements: blueprint gate-source-builds
2015-08-14 13:57:01 -04:00
Jenkins
33531712d2 Merge "Implement source fetching for build.py" 2015-08-14 15:48:44 +00:00
Sam Yaple
0b605f305c Implement source fetching for build.py
This implements the source fetching that exists in the current way.
The patch only implements fetching a tarball from a url. Additional
methods needed would be git and local copy.

Partially-Implements: blueprint build-script
Change-Id: I51889a131f050abce9a16d114972b5e329a93862
2015-08-14 00:21:35 +00:00
Jenkins
af5dff93ca Merge "Implement Murano source images" 2015-08-13 20:19:36 +00:00
Jenkins
c3341ab51a Merge "Add new test script for parallel builds" 2015-08-12 20:36:30 +00:00
Jeff Peeler
9f824cfe4e Add new test script for parallel builds
This adds a new test script for the new python based build script. A new
tox target has been created to execute it for usage in the gate.
Eventually, the other build script stuff can be deleted, but that won't
be done until full functionality exists in the new build.py.

Change-Id: Id9dd19926b1b9d875dcb069fd13d6450318374c8
Paritally-Implements: blueprint build-script
2015-08-12 14:30:24 -04:00
Sam Yaple
16223ff639 Add Dockerfile template for rabbitmq
Change-Id: Ic42879451cba2fb7fa35764924ca191949c477c4
Partially-Implements: blueprint dockerfile-template
2015-08-12 02:50:33 +00:00
Jeff Peeler
485e1b2539 Improve logging and prepare for gate
Switched all print statements to use logger

Added ability to halt operations via Ctrl-C, needs cleanup handler

Added realtime logging when using only one thread (matches bash building
scripts behavior)

main is now returning all the build image statuses, so a quick test
script would look like:

import build
res = build.main()
if len(res[0]):
    LOG.error('failure')

Change-Id: Ic8000a96573b011490dc330a4512c77c602ac3d2
Partially-Implements: blueprint build-script
2015-08-11 11:24:22 -04:00
akwasniewska
310627890c Added initial template for base image
Added new method generating Dockerfiles from templates as well as the
appropriate code to support this in build.py

Co-Authored-By: Sam Yaple <sam@yaple.net>
Partially-implements: bp dockerfile-template

Change-Id: Id14d10d31cb4aac957e04fbc129de4043d98e033
2015-08-11 05:56:15 +00:00
Paul Bourke
a6454f15f2 Implement Murano source images
* Both api and engine start up without error, but can't test properly
until Horizon is fixed (bug #1482196)

* These are source installs are there no RPMs available for Murano
that I can find.

* Also requires a plugin for horizon that will be made as a
separate commit

Co-Authored-By: Mick Thompson <michael.a.thompson@oracle.com>
Implements: blueprint enable-murano-container

Change-Id: Ia46985b21bb5f6d7690501e7199800c8c7fcb51f
2015-08-10 15:52:21 +00:00
Jenkins
b6d3f61760 Merge "Remove validate-min-env-vars gating" 2015-08-09 15:38:21 +00:00
Jenkins
0b63b64d05 Merge "Set curl as the default source install method" 2015-08-08 06:13:27 +00:00
Steven Dake
33d8d32381 Remove validate-min-env-vars gating
We don't use config-internal anymore, so remove validate-min-env-vars
from being gated upon.  This is becuse there is no minimum
environment variables required.  While we are at it we remove
min-env.

Partially-Implements: blueprint remove-config-internal

Change-Id: Ibe2947b35e4dc1549e82acc66c01153495a91882
2015-08-07 20:18:33 -07:00
Jenkins
10164f06d8 Merge "Adds push to build script" 2015-08-06 20:25:41 +00:00
Paul Bourke
4a2ef1f21d Set curl as the default source install method
As much faster than git clone

Change-Id: I173592f1efceac61b49c37f994004cc41c641ae0
Closes-Bug: #1481670
2015-08-05 10:40:41 +00:00
Sam Yaple
fca1e0658a Adds push to build script
This works as is, but could use some cleaning up and threading needs
to be confirmed broken. If it isn't broken, it should be implemented.

Co-Authored-By: Swapnil Kulkarni <me@coolsvap.net>
Change-Id: I708406dcff8aa9b2f4064f03bda07873ce97d994
Paritally-Implements: blueprint build-script
2015-08-05 04:50:21 +00:00
Paul Bourke
07460f88f2 Add missing vars for Keystone
Got removed as part of a refactor

Change-Id: I7dc47f4af316188803fe2fc654316540b8d23cf8
Closes-Bug: #1480465
2015-08-04 12:24:31 +00:00
Paul Bourke
853fa53929 Re-add executable bit to tools/genenv
Change-Id: Icf845822735babc78ca427c00a2a125c8f0cca32
Closes-Bug: #1481293
2015-08-04 11:43:47 +00:00
Jenkins
119a60b926 Merge "Remove service_hosts.sh" 2015-08-04 10:21:32 +00:00
Swapnil Kulkarni
b396395df4 Temporary remove gnocchi from kolla-compose & functional tests
Current with due to LP#1478145 the kolla-compose script
fails to create gnocchi containers. Temperory fix to skip
gnocchi till we have gnocchi packges in delorean.

Change-Id: I7dc6aef82908a846a8b632f86a16de47c1a2eef9
Partial-Bug: #1478145
2015-08-03 09:56:05 +00:00
Swapnil Kulkarni
fd92ad8a27 Remove service_hosts.sh
* Remove service_hosts.sh file
* Add all the required variables to tools/genenv

Change-Id: I23954bf148923fbe785f51012fc9c9da909fa380
Closes-Bug: #1447867
2015-08-03 05:10:35 +00:00
Jenkins
8ffa0f5333 Merge "Adds an example openrc file" 2015-08-01 19:29:55 +00:00
Paul Bourke
1ecb7a82e2 Fix missing quotes in tools/genenv
Change-Id: Idc5f8aef80a65fea13fecd62b6b40c8ef7458354
Closes-Bug: #1480296
2015-08-01 00:33:03 +00:00
Sam Yaple
7a25b6bea3 Adds an example openrc file
Change-Id: Ie056a8347f6b72ffb647bfb79ee4449ca45f3fef
Closes-Bug: #1476294
2015-07-31 23:58:36 +00:00
Borne Mace
76cdc9fe49 Initial kolla-ansible command - deploy support only
Change-Id: I4f6f38b2a202b41a9dec839fa0222585b49fc06c
Partially-Implements: blueprint kolla-ansible-script
2015-07-31 14:39:05 -07:00
James McCarthy
5e28eb8496 Implement Swift Containers
Known bugs/TODOs at this time of this patch update:

https://bugs.launchpad.net/kolla/+bug/1477990
https://bugs.launchpad.net/kolla/+bug/1477993

Implements: Blueprint swift-container
Closes-bug: #1477992
Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>
Change-Id: I031f88a7cd1867104fef12df6ab3ffcc06cb65d6
2015-07-31 09:36:11 +00:00
Jenkins
731d5205cb Merge "Update service helper scripts for variable changes" 2015-07-30 18:54:43 +00:00
Swapnil Kulkarni
d4c7129dc3 Remove not required echo
- tools/validate-links.sh has a echo which
  is not necessary. Removed it.

Change-Id: I122c995bc5d99592212505ce23256e27685b4af4
Closes-Bug: #1479647
2015-07-30 06:57:27 +00:00
Swapnil Kulkarni
1c147e4def Update service helper scripts for variable changes
- Updated the required variables to be sorted so
  that they are better visible one on each line

- Removed variable defaults from each service scripts
  and added them to tools/genenv file which holds
  all default values

Change-Id: Ia7b1b08ba3f963b46b81434ce84f476d56890a93
Closes-Bug: #1476494
Closes-Bug: #1467652
2015-07-29 18:08:50 +00:00