120 Commits

Author SHA1 Message Date
Jenkins
cf3e68213e Merge "Catch all the exception in the push thread" 2016-05-10 21:02:47 +00:00
Jeffrey Zhang
070bf25835 Support a custom base image
Add a new option(base-image) to support custom base image
In default, the base-image is equal to base. When using custom
image, please use command line like:

    ./tool/build.py --base-image my-image --base centos --base-tag 0.1

DocImpact

Closes-Bug: #1573544
Change-Id: If4b9c57a2b68f6f06d3e981f30b2173064e02193
2016-05-09 07:29:19 +00:00
Michal Rostecki
6654cb1682 Add images from profile as matched only if no regex is used
Change-Id: I053e54c54883318dfc7daa64a58276487805de66
Closes-Bug: 1578955
2016-05-06 10:19:21 +02:00
Jeff Peeler
696f0b9a06 Generate image dependencies on CLI
Using the new --list-dependencies flag, one can query dependencies for a
given filter. For example:

./build.py --list-dependencies heat swift
{'base': [{'openstack-base': [{'heat-base': ['heat-engine',
                                             'heat-api-cfn',
                                             'heat-api']},
                              {'swift-base': ['swift-object',
                                              'swift-proxy-server',
                                              'swift-container',
                                              'swift-rsyncd',
                                              'swift-account']}]}]}

Also added --list-images to list all available images.

Change-Id: I1797e32e32705182a763f53329eeb5c4a361abec
Implements: blueprint images-dependency-tree-cli
2016-05-05 00:03:31 -04:00
Davanum Srinivas
fa88ce2e4c Cleanup Mesos/Marathon related work
We got rid of the kolla-mesos repo:
http://git.openstack.org/cgit/openstack/kolla-mesos/tree/README.rst

So we don't need things in the main kolla tree
related to Mesos/Marathon

Closes-Bug: #1577951
Change-Id: Iafae63914c8a6601dc1b5b04231af8a1d2cc8642
2016-05-03 21:39:57 +00:00
Travis McPeak
cc33c103d4 Adding a few #nosec tags to prepare for Bandit usage
This commit adds a few #nosec tags for non-issues.  I've examined
the code and determined that these don't represent security issues
so we should add a #nosec tag that tells Bandit not to find these
issues in the future.

Closes-Bug: #1577498
Change-Id: Ic37216c08442c700c64118c78cfb46e6cedd237c
2016-05-02 20:58:57 -07:00
Jeffrey Zhang
e043fab3a0 Catch all the exception in the push thread
Change-Id: I1ba48cd25e529bdd846d3ded1f5923f312e5d17d
Closes-Bug: #1574931
2016-04-28 00:59:14 +00:00
Michal (inc0) Jastrzebski
e2fa75fce6 Override default latest tag on ubuntu
After 16.04 got released we can't build our images as we pull latest
(16.04 now) and our sources lists are built for 14.04. We pin ubuntu to
14.04 here.

Change-Id: Ib29a1c607c3a725cdaf2098edd1c4b80f06a5e38
Closes-Bug: #1575884
2016-04-27 20:35:25 +00:00
Jenkins
0078d9b4a1 Merge "Add iscsid/tgtd specific parameters to Kolla infrastructure" 2016-04-15 12:05:39 +00:00
Serguei Bezverkhi
c605d6ca26 Add iscsid/tgtd specific parameters to Kolla infrastructure
This partially implements iscsi and lvm2 support for cinder
in Kolla. Add integration with Kolla infrastructure.

Change-Id: I5b7d59163518080f38aec0c00617440de0763f1d
Implements: blueprint iscsi-lvm2-docker
2016-04-12 14:58:15 -04:00
Swapnil Kulkarni (coolsvap)
11c6457164 Add missing base os values to kolla-build.conf
Added centos, ubuntu, oraclelinux.
Not added other base distros are not
well maintained currently.

Change-Id: Icb1c12dde2ff005068f1b0f36693049f9ea30f52
Closes-Bug:#1569265
2016-04-12 17:01:42 +05:30
Paul Bourke
cfd806aeff Log the SHA of the Git ref for source builds
When using named refs in source builds, e.g. "reference = master", one
can't easily tell from the build output what SHA master actually pointed
to at that point and time. Update the debug output to include this.

Closes-Bug: #1566316

Change-Id: I95c1cc316ab7332fa30fa43e207a5a5512b76708
2016-04-05 13:31:03 +00:00
Jeffrey Zhang
42420830f6 Implement nova-ssh container
Add a nova-ssh container to handle the `nova migrate` and
`nova resize` case, in which the nova will use ssh to copy
files between machines.

Change-Id: Ie6675943f3aeabfbba8589d308d55b9c89d732db
Closes-Bug: #1562141
2016-04-03 07:21:17 +00:00
Steven Dake
31634c4df4 Add PBR generation of version information
Change-Id: I6391392645d8608a92c885071b26210eed3f5466
Partially-Implements: blueprint add-reno
2016-03-22 20:45:46 -07:00
Jenkins
892dc09c81 Merge "Add generate_passwords.py to generate passwords" 2016-03-21 20:25:44 +00:00
SamYaple
f03e06e09b Add generate_passwords.py to generate passwords
As with all tools, this is a first pass at the generation. Perhaps we
even want to move this into kolla/kolla/cmd and be generated with tox
itself in the future.

This tool, when run, will only populate empty fields that have no
values meaning that it is safe to run repeatedly on the same file.

Of note, there is no way to preserve comments in the file after it has
been processed by the yaml parser in python. Comments and sections
will remain in the passwords.yml template for additional documentation
if the user wishes to populate the file themselves.

Use SystemRandom and clean up the docs a bit to not use pronouns.

Co-Authored-By: Steven Dake <stdake@cisco.com>

Closes-Bug: #1559266
Change-Id: I2932d592df8871f1b7811059206d0b4d0553a687
2016-03-21 17:02:23 +00:00
SamYaple
3e7be6593c Split versions onto new line
This makes the process of updating versions _much_ easier and opens
the door to a rough automated updater

This should merge in master _BEFORE_ mitaka branch

TrivialFix

Change-Id: I90b974316c5b48fd7a31959de317cb71ae3affec
2016-03-21 12:29:10 +00:00
Jenkins
c09db422cf Merge "Mesos DNS container" 2016-03-14 12:33:18 +00:00
Jenkins
a28b246259 Merge "Add cron image and playbook" 2016-03-10 20:22:15 +00:00
Éric Lemoine
32a4cadac9 Add cron image and playbook
Add cron image and playbook for logrotate.

The "common" Ansible playbook includes configuration files for
logrotate. At this point the operator cannot customize/override the
logrotate configuration.

Closes-Bug: #1553244
Change-Id: Ic9fdda9a273c9ccd90502f0acc7614d2c7157dca
2016-03-09 13:53:55 +01:00
SamYaple
279594ab64 Add local directory or file for source build
This change allows using a local directory or tarball to build from
sources by specifying the 'local' type in your kolla-build.conf:

    [keystone-base]
    type=local
    location=/home/martin/src/keystone

    [neutron-server-plugin-networking-cisco]
    type=local
    location=/tmp/networking-cisco.tar.gz

Closes-Bug: #1509625
Co-Authored-By: Martin André <m.andre@redhat.com>
Change-Id: I3f6f68b0f44efdac653d186d2625591ad7cb3b2a
2016-03-09 18:36:13 +09:00
Artur Zarzycki
dd298fcb9e Mesos DNS container
Change-Id: I07ce1b0f6a48de2a8290fac75dcf7ef07960aaf5
Implements: blueprint mesos-dns-container
2016-03-08 21:29:19 +01:00
Swapnil Kulkarni (coolsvap)
5669f7e0ad Handle kolla-build exception
kolla-build currently does not provide information
if docker service is not running. Added exception
handling.

Change-Id: I1f167804b8b4d2ad9220281954ff7ea7162a9817
Closes-Bug:#1553912
2016-03-08 09:45:04 +05:30
Jeffrey Zhang
4e154f0018 Introduce the hacking module to kolla
Implements: blueprint add-hacking

Change-Id: Ia24a263555b9c1eb11e61b9d3fe89612a89daed6
2016-03-03 04:40:16 +00:00
Vikram Hosakote
320c1f9272 Add timeout to requests.get() in kolla/cmd/build.py
When kolla-build is running, if there are network issues or if the
source's location (like http://tarballs.openstack.org) fails to
respond due to high number of concurrent requests, kolla-build just
hangs/blocks indefinitely.

This patch set resolves this issue by adding a timeout of 120
seconds for requests.get() in kolla/cmd/build.py, adds a unit test
for it in kolla/tests/test_build.py and also the "timeout" argument
in kolla/common/config.py.

Change-Id: I7c8745a20b9bd1c3f5d6a55c72a794f16fd7e513
Closes-Bug: #1548614
2016-02-28 00:54:47 +00:00
Éric Lemoine
0417844b8d Remove Rsyslog entirely
Partially implements: blueprint heka

Change-Id: I1322d2dc870e6f8fe052926995d993e8a08a25db
2016-02-23 01:45:23 -08:00
Jenkins
c18b9c3851 Merge "fix the custom profile raise exception issue" 2016-02-20 16:36:59 +00:00
Jenkins
4b0b7931e6 Merge "Fix image plugin functionality for oslo.config" 2016-02-20 16:36:52 +00:00
Éric Lemoine
ee95dc5c27 Add a Dockerfile for Heka
Partially implements: blueprint heka
Change-Id: Iafe0dba1333f1f84bc5956890c3b7a0c2a45cef3
2016-02-19 19:23:49 +00:00
SamYaple
2c45bef065 Reduce gate resource usage
Change-Id: Ic6cd45ec708efe4f573e19f3bc910717ac3b4fbb
Partially-Implements: blueprint functional-testing-gate
2016-02-16 15:12:38 +00:00
Jenkins
84f43146dc Merge "Use uppercase 'S' in word "OpenStack"" 2016-02-15 16:23:37 +00:00
venkatamahesh
70de590a11 Use uppercase 'S' in word "OpenStack"
Change-Id: I27ca0ea75f3d6a4371c91b3cb2c7a999ec90fbc4
2016-02-15 12:37:30 +00:00
Jeffrey Zhang
da0f0cf1e6 fix the custom profile raise exception issue
Closes-Bug: #1536272
Change-Id: I6c91e522923eade16ba23711e6014e6b4b8cd3e0
2016-02-15 15:25:15 +08:00
Paul Bourke
477fc18bd0 Fix image plugin functionality for oslo.config
The new oslo.config style parsing for kolla-build.conf stopped plugins
from working. This patch fixes it and adds a unit test.

Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com>
Closes-Bug: 1534556
Change-Id: I135797c733ae0cae040a009c364073769b19e4eb
2016-02-12 06:00:20 +00:00
Jeffrey Zhang
ce5e8a8257 Remove data docker image
we have moved to named volume, the old data container should be removed

TrivialFix

Change-Id: Ib73205de6566509492568381179814baa7af2d22
2016-02-10 22:46:22 +08:00
Jenkins
b891afd64c Merge "Rename kolla_ansible to kolla_toolbox" 2016-02-05 15:04:37 +00:00
Jenkins
16630340c7 Merge "Ubuntu custom apt repos" 2016-02-05 08:28:53 +00:00
Jenkins
e8348d033a Merge "Move the install base type check to kolla-build" 2016-02-04 11:31:01 +00:00
Allen Gao
db53ad1ddf Move the install base type check to kolla-build
The install type is converted in kolla-build, so it will never
fail in dockerfile, move the check to kolla-build just above
the install type converting.

TrivialFix

Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
Change-Id: I1500d3b47e909f94ea9f68c5245297733f63a70b
2016-02-04 16:48:12 +08:00
SamYaple
9dae768e69 Ubuntu custom apt repos
Change-Id: I3afb8a29c4ae2369f29e0cc94d75ff8a3c42594b
Implements: blueprint custom-repos
2016-02-03 15:56:54 +00:00
Allen Gao
682b60b861 Fix config help message
Adding the necessary spaces.
TrivialFix

Change-Id: I3858ed1cb978bcf8aefd4a85f7c802607876b36e
2016-02-03 18:11:21 +08:00
SamYaple
80b7266ed1 Rename kolla_ansible to kolla_toolbox
This change is needed for clarity. We have a kolla-ansible script.
We have a kolla-mesos repo. We plan to have a kolla-ansible repo.
Already we have had far too much confusion about whether we are
talking about the container or the project. Naming this kolla-toolbox
eliminates all of that confusion and its probably a bit more accurate
of a name too.

Closes-Bug: #1541053
Change-Id: I8fd1f49d5a22b36ede5b10f46b9fe02ddda9007e
2016-02-02 18:12:15 +00:00
SamYaple
9e98149b3c Removed unused containers from gate build
TrivialFix

Change-Id: I7ccbecddc55b26d252b92faccec94676315c3eec
2016-01-29 20:39:55 +00:00
Jenkins
87355c231a Merge "Pick up proxy buildargs from environment" 2016-01-26 11:50:04 +00:00
David Moreau Simard
c15df14737 Bump RDO delorean repositories to current-passed-ci for Mitaka
RDO now has regular and good coverage which leads to tested
repository promotion to current-passed-ci.
Bumping to current-passed-ci should lead to less errors and
instability.

Change-Id: Ifb68a26afe0062a27303553b8116a3c739aa33c6
2016-01-25 22:09:21 +00:00
Jenkins
d3756de84c Merge "Import modules rather than objects" 2016-01-20 17:31:55 +00:00
Jenkins
08f907a2cc Merge "Add Dockerfiles for Mesos" 2016-01-20 16:23:43 +00:00
Jeffrey Zhang
f7f2194967 Import modules rather than objects
Base on the OpenStack Style Guidelines[0]: Do not import objects, only
modules

[0] http://docs.openstack.org/developer/hacking/index.html#imports

TrivialFix

Change-Id: Id1bc5e4b24fd561f1a9f6167af341b00a343a718
2016-01-20 20:46:12 +08:00
Michal Rostecki
679014a052 Add Dockerfiles for Mesos
Change-Id: Iaf317817eccaa72f2a86b1058a0179afd3427859
Partially-Implements: blueprint mesos
2016-01-19 17:34:58 +01:00
Jenkins
11cdd5b8ea Merge "Expose the docker build_arg to build.py" 2016-01-19 09:51:47 +00:00