288 Commits

Author SHA1 Message Date
Artur Zarzycki
95c1d7380f Remove ironic containers in the cleanup script
TrivialFix

Change-Id: Ia37369acf8bf7ca7f49fd647f40c6e98f40e93d8
2015-12-14 16:57:04 +01:00
Sidharth Surana
a3b7b866b7 Remove cinder containers in the cleanup script
Change-Id: I29b788a71f30d133e66759a5de2ecd43222313a8
Closes-Bug: #1524557
2015-12-09 16:25:44 -08:00
Sean Mooney
2ffb35ee53 adds tools/cleanup-containers regex support
- this change extends the tools/cleanup-containers script to
  support a grep extended regex as a first paramater.
- if tools/cleanup-containers is called with a grep extended
  regex string as a first paramater, only containers mataching
  that regex will be cleaned up.
- e.g. tools/cleanup-containers "neutron|openvswitch"
  will cleanup all container whoes name contains either neutron
  or openvswitch.

Change-Id: Iadb68c0a8de40e9ec2c0a27568e3a372ec0e8303
Closes-Bug: #1522168
2015-12-02 23:01:42 +00:00
Hui Kang
1c9056bcb6 Output unique admin id of user and project list
Change-Id: I8983768b6fafdd70f4c8aa7bdcf91af4f50efe70
Closes-Bug: #1520982
2015-11-29 20:17:19 +00:00
Hui Kang
afb30cbebd Remove openvswitch_data container in the cleanup script
Change-Id: Iec94e254e8df501005fd3660c80e3c2eefbb05bb
Closes-bug: #1520833
2015-11-28 16:30:00 -05:00
Swapnil Kulkarni (coolsvap)
59a1c8b9fb Remove hardcoded MAINTAINER in Dockerfiles
Added new option in kolla-build.conf

Change-Id: I45fe51966bcb59ea19d112281ba3d5a1ba091a56
Closes-Bug:#1514304
2015-11-23 11:03:47 +00:00
Jenkins
84b6f7edc4 Merge "Add Ansible support for Magnum" 2015-11-13 17:01:04 +00:00
Michal Rostecki
2cd5d9ed74 Add Ansible support for Magnum
Change-Id: Idb25ac4d3148c9b9400cf675ac2e47d35cce6224
Implements: blueprint ansible-magnum
2015-11-13 11:31:34 +01:00
Angus Salkeld
33d39f2942 Fix validate-all-maintainer.sh to look for Dockerfile.j2
And fix the fallout.

Change-Id: Iccad3f4fdb0a6a7c14246df3408cae0425b833a5
2015-11-09 15:20:13 +10:00
Jenkins
b178ed2021 Merge "Few improvements in Kolla tools. Added Ubuntu support." 2015-11-06 12:22:35 +00:00
Kirill Proskurin
396014f8d1 Few improvements in Kolla tools. Added Ubuntu support.
pip install default prefix in Ubuntu is /usr/local, and Kolla tools scripts
didnt respect that. So I added few OS checks in this scripts.

I improve config path check in build.py. Added more verbose error if we can't
find config directory.

Change-Id: Ide521ed205b0dc1fc27e237a9a8f4da0168e664f
Closes-Bug: #1512302
2015-11-06 14:03:30 +03:00
Hui Kang
bcce4502ed Use kolla_internal_address in the example rc file
Change-Id: I4ec1b5208a347a45ff729e1d8bff6fe6e37b925e
Closes-Bug: #1509865
2015-10-28 12:50:02 -04:00
Michal Rostecki
9a9c0ce944 Remove memcached container in cleanup-containers tool
Change-Id: Ic56b7b2fd6cd7d191cc364a37f3ebbc44950932e
Closes-Bug: #1508780
2015-10-22 06:47:32 +02:00
Kuo-tung Kao
1e86af763b put conatiner name to array in cleanup-containers
The brace in string variable will not be expanded in some case.
Put conatiner name into array.

Change-Id: I2fb16e7352bd579f207efce0fb9b2565a1e7236d
Closes-Bug: #1502467
2015-10-06 13:55:58 +08:00
Sam Yaple
0ac5e048c6 Improve cleanup script
Its still dirty, but at least it won't kill all your containers.

Change-Id: Ie468210bd0f273432ca16fc9530bf9acd2a808ed
Closes-Bug: #1486620
2015-09-27 08:41:02 +00:00
Hui Kang
ed0829ae5e Fix a small bug of wrong path to validate-docker-execuate
Change-Id: I61e7ac2bb0ec0b960dc807d8880d5da105aacd14
Closes-Bug: #1497463
2015-09-18 18:21:29 -04:00
Martin André
14acb298c2 Make kolla-ansible work in pip installed kolla
This is a quick hack to get kolla-ansible working with pip installed
kolla, kolla-ansible will need to be rewritten at some point in python.

Closes-Bug: #1495797
Change-Id: I7cf8c4baae76ff8f31514f64bed934848a1c3e40
2015-09-15 14:44:01 +09:00
Kai Qiang Wu(Kennan)
da68e2eccc Improve scripts with some check before kick rm command
Closes-Bug: #1490387
Change-Id: I4a9476085b9c5b2cae3801e5b1954e85068f4e03
2015-08-31 05:13:59 +00:00
Jenkins
438599b79a Merge "Use external address in openrc-example" 2015-08-28 15:50:51 +00:00
Steven Dake
c950212079 Use external address in openrc-example
This is mostly a docs change.  The external address should be used
rather than the internal address when sourcing openrc-example.
The internal address may not be accessible from outside the VIP
interface.

Change-Id: I10ac0c116227af9c4409a050203e2a28e3a116a2
2015-08-28 15:06:41 +00:00
Steven Dake
f895ee07cc Remove docker directory
Remove the docker directory (yay) and old build tools.

This will result in an f21 failing gate - however, I have a patch
submission to remove that gate from our project configuration.

Change-Id: I3c461cedb6906422c8076f60c470e773d6cdcf33
Partially-Implements: blueprint remove-docker-dir
2015-08-28 00:50:30 -07:00
Suhail Syed
bd8d795124 Modified build.py to run from installed location
Modified build.py to run from installed location or developer
environment. To run from development environment, run the
command:

sudo pip install -e .

Additionally, remove a TODO that has been done

Co-Authored-By: Sam Yaple <sam@yaple.net>
Change-Id: I922696ba439da2c9747e65cddcba47203e54d220
Implements: blueprint python-package
2015-08-25 06:46:15 +00:00
Suhail Syed
d3872aa9ee Make Kolla installable via PIP
Install Ansible code, etc file examples, scripts, an open
rc example, a tool to initialize the OpenStack deployment,
and other various useful bits.

Start the versioning at 0.1.0 as recommended by ttx.

Change-Id: I35fa4042040957e7725c7fc3b146009e0135499a
Partially-Implements: blueprint python-package
2015-08-24 16:08:49 -07:00
Michal Jastrzebski (inc0)
48c0ecf546 Build.py regex filtering
Adds option to build.py to only build images matching and its
dependencies

Change-Id: I281bea5bed932b7c948b247392fa6a52b1d1aecf
2015-08-24 13:33:18 +00:00
Sam Yaple
4bce5cca0a Add retries to build.py
Additionally, fix an if statement to catch multiple layers of parent
images failing so the grandchildren do not attempt to build either.

Change-Id: Ie9cdf7600e067678e52938910f0d3c072adcdf8a
Partially-Implements: blueprint build-script
2015-08-23 15:02:39 +00:00
Michal Jastrzebski (inc0)
598fe7bad1 Add custom code to base docker templates
Sometimes you need custom code in Docerfiles to solve for example
proxy problems or preconfigure base image in some specific way.
With this commit you can insert content of custom file to the beggining
of base Dockerfile to provide these changes

Partially-implements: bp rhel-based-image-support
Partially-implements: bp add-proxy-to-dockerfiles
Partially-implements: bp build-script
Change-Id: Idbfec764aad627f5c00dc09c4854d5fa1c5ac9cf
2015-08-21 20:21:41 +02:00
Sam Yaple
49a9fba23e Allow Docker to make better use of cache
Docker cache takes into account things like filesize, hash of file,
and even timestamp and access times when determining whether to use
the cache or not. This modifies the build script to adjust all the
timestamps to 0 epoch. Since we dont care about timestamps this allows
us to make far better use of the cache, including when downloading and
creating tarballs for source builds.

Change-Id: Id4287cf1fcaa2de63feaab9e6f4ebbd4defdb768
Partially-Implements: blueprint build-script
2015-08-20 15:35:28 +00:00
Jenkins
41fabba084 Merge "Move defaults.yml to group_vars/all.yml" 2015-08-19 10:25:32 +00:00
Steven Dake
bd5e5bbb64 Use one data container for all data volumes
The previous method of using the API image for a data container
worked, but resulted in more data being bindmounted and copied
into the system.  This patch resolves that by essentially using
a distro-type as a FROM in a Dockerfile to generate
distro-type-data.  Further all of the data containers used
throughout ansible are modified to use this new data container.

Change-Id: I8846573d4f2d4b98d4f46c770bfefc6d4c5cd0b5
Partially-Implements: blueprint one-data-container
2015-08-18 20:52:27 -07:00
Sam Yaple
8d65921bc3 Move defaults.yml to group_vars/all.yml
The purpose for having defaults.yml on the command line was originally
for variable inheritance. Over the past month we have slowly changed
how things are inherited (like ports) allowing us to place these
'defaults' into the group_vars/all.yml location as they should be
values that go unchanged (but can be overridden).

Change-Id: I2becec66bf431bfc9d88fc825b5380c1e173ca70
Partially-Implements: blueprint update-configs
2015-08-19 03:18:16 +00:00
Jenkins
af419c835b Merge "Remove compose from documenation" 2015-08-17 20:19:05 +00:00
Steven Dake
6efe57e9eb Remove compose from documenation
Receive several quickstart related questions every day.  Make a
first pass at cleaning up our documentation to point people
in the right direction.  While we are about it remove compose
related bits.  Anything in the compose directory will remain as
a reference implementation for how to implement the compose
files to work well with our container content.

Change-Id: I9e832e97ac2bacca8eab7e1bfbd82664d2b191b8
Closes-Bug: #1485163
Paritally-Implements: blueprint remove-config-internal
2015-08-17 11:34:36 -07:00
Steven Dake
971d83645d Fix gate source building
Fix a backtrace.  Also add the default master locations for
the various tarballs.

Change-Id: I9675c2619b95c0ae6a467ffbf964c4b17ae4b791
Paritally-Implements: blueprint gate-source-builds
2015-08-17 10:06:06 -07:00
Jeff Peeler
67ce01fc62 Safely check for dictionary key presence
Accessing the key directly when it doesn't exist was yielding a
KeyError.

Change-Id: Ice877b74d46d59f2e9ecff051b09245e9d3744e1
Paritally-Implements: blueprint gate-source-builds
2015-08-14 13:57:01 -04:00
Jenkins
33531712d2 Merge "Implement source fetching for build.py" 2015-08-14 15:48:44 +00:00
Sam Yaple
0b605f305c Implement source fetching for build.py
This implements the source fetching that exists in the current way.
The patch only implements fetching a tarball from a url. Additional
methods needed would be git and local copy.

Partially-Implements: blueprint build-script
Change-Id: I51889a131f050abce9a16d114972b5e329a93862
2015-08-14 00:21:35 +00:00
Jenkins
af5dff93ca Merge "Implement Murano source images" 2015-08-13 20:19:36 +00:00
Jenkins
c3341ab51a Merge "Add new test script for parallel builds" 2015-08-12 20:36:30 +00:00
Jeff Peeler
9f824cfe4e Add new test script for parallel builds
This adds a new test script for the new python based build script. A new
tox target has been created to execute it for usage in the gate.
Eventually, the other build script stuff can be deleted, but that won't
be done until full functionality exists in the new build.py.

Change-Id: Id9dd19926b1b9d875dcb069fd13d6450318374c8
Paritally-Implements: blueprint build-script
2015-08-12 14:30:24 -04:00
Sam Yaple
16223ff639 Add Dockerfile template for rabbitmq
Change-Id: Ic42879451cba2fb7fa35764924ca191949c477c4
Partially-Implements: blueprint dockerfile-template
2015-08-12 02:50:33 +00:00
Jeff Peeler
485e1b2539 Improve logging and prepare for gate
Switched all print statements to use logger

Added ability to halt operations via Ctrl-C, needs cleanup handler

Added realtime logging when using only one thread (matches bash building
scripts behavior)

main is now returning all the build image statuses, so a quick test
script would look like:

import build
res = build.main()
if len(res[0]):
    LOG.error('failure')

Change-Id: Ic8000a96573b011490dc330a4512c77c602ac3d2
Partially-Implements: blueprint build-script
2015-08-11 11:24:22 -04:00
akwasniewska
310627890c Added initial template for base image
Added new method generating Dockerfiles from templates as well as the
appropriate code to support this in build.py

Co-Authored-By: Sam Yaple <sam@yaple.net>
Partially-implements: bp dockerfile-template

Change-Id: Id14d10d31cb4aac957e04fbc129de4043d98e033
2015-08-11 05:56:15 +00:00
Paul Bourke
a6454f15f2 Implement Murano source images
* Both api and engine start up without error, but can't test properly
until Horizon is fixed (bug #1482196)

* These are source installs are there no RPMs available for Murano
that I can find.

* Also requires a plugin for horizon that will be made as a
separate commit

Co-Authored-By: Mick Thompson <michael.a.thompson@oracle.com>
Implements: blueprint enable-murano-container

Change-Id: Ia46985b21bb5f6d7690501e7199800c8c7fcb51f
2015-08-10 15:52:21 +00:00
Jenkins
b6d3f61760 Merge "Remove validate-min-env-vars gating" 2015-08-09 15:38:21 +00:00
Jenkins
0b63b64d05 Merge "Set curl as the default source install method" 2015-08-08 06:13:27 +00:00
Steven Dake
33d8d32381 Remove validate-min-env-vars gating
We don't use config-internal anymore, so remove validate-min-env-vars
from being gated upon.  This is becuse there is no minimum
environment variables required.  While we are at it we remove
min-env.

Partially-Implements: blueprint remove-config-internal

Change-Id: Ibe2947b35e4dc1549e82acc66c01153495a91882
2015-08-07 20:18:33 -07:00
Jenkins
10164f06d8 Merge "Adds push to build script" 2015-08-06 20:25:41 +00:00
Paul Bourke
4a2ef1f21d Set curl as the default source install method
As much faster than git clone

Change-Id: I173592f1efceac61b49c37f994004cc41c641ae0
Closes-Bug: #1481670
2015-08-05 10:40:41 +00:00
Sam Yaple
fca1e0658a Adds push to build script
This works as is, but could use some cleaning up and threading needs
to be confirmed broken. If it isn't broken, it should be implemented.

Co-Authored-By: Swapnil Kulkarni <me@coolsvap.net>
Change-Id: I708406dcff8aa9b2f4064f03bda07873ce97d994
Paritally-Implements: blueprint build-script
2015-08-05 04:50:21 +00:00
Paul Bourke
07460f88f2 Add missing vars for Keystone
Got removed as part of a refactor

Change-Id: I7dc47f4af316188803fe2fc654316540b8d23cf8
Closes-Bug: #1480465
2015-08-04 12:24:31 +00:00