36 Commits

Author SHA1 Message Date
Kai Qiang Wu(Kennan)
3ed7b3c3b4 Add venv section in tox.ini
As jenkins docs job use venv envrionment to work, we
need add such section to make it work.

Partially-Implements: blueprint kolla-tox-doc
Change-Id: I716219515f2bf1375fd094b3aeca866cbcf5c7c6
2015-09-03 00:16:01 +00:00
Steven Dake
349a085352 Remove cruft in tox.ini from docker_templates
There is no longer a docker build system in the tree.  Remove
the cruft that was missed in the original removal patches.

Partially-Implements: blueprint gate-source-builds

Change-Id: I4e6132502e8c0f812a0b3a767dd9c7f5c7b92fe3
2015-08-29 22:55:45 -07:00
Steven Dake
730276aaf9 Remove deprecated --template option from gating
The template option is deprecated and --template is now default.
Also rename the tox jobs test calls since we won't have Docker
build operations.

Change-Id: I99df9c337680003e042e7e56a19d6cae2a59ed74
Partially-Implements: blueprint gate-source-builds
2015-08-29 02:12:20 -07:00
Sam Yaple
cbd42ca6e9 Move docker_templates to docker dir
Updated build.py to reflect this change.
Deprecate --template option and make it a noop.

Change-Id: I7cd98d1ee684a4c64984a49597159868152683b2
Partially-Implements: blueprint remove-docker-dir
2015-08-28 13:33:50 +00:00
Jenkins
3b5380ade0 Merge "Add developer docs automatic produce support" 2015-08-28 12:25:11 +00:00
Steven Dake
f895ee07cc Remove docker directory
Remove the docker directory (yay) and old build tools.

This will result in an f21 failing gate - however, I have a patch
submission to remove that gate from our project configuration.

Change-Id: I3c461cedb6906422c8076f60c470e773d6cdcf33
Partially-Implements: blueprint remove-docker-dir
2015-08-28 00:50:30 -07:00
Steven Dake
08e765fc3d Start of removal of docker directory
Start off the removal of the docker directory by making the gate
only run against docker templates.  The idea is we are going to
from this patch set forward completely abandon the functioning of
the docker directory and focus on making templates work properly.

In order to facilitate that, this patch set makes sure each change
gates properly for the changed service in the Templates build.

Note because git review and gerrit can't keep history on removal
followed by a git move operation, we first git rm the files affected
then git mv them to get the gate working again.

Every other patch in this patch set will fail the gate.  That is
expected behavior.

Change-Id: I1be2e2638aef4ada038bfe5f3dd563f040542df2
2015-08-28 00:50:29 -07:00
Steven Dake
55e6e1f8d2 Functional test Ubuntu source building
Change-Id: Ia3fa83645545bcd7d259fe7c973c849bd6cb1426
Implements: blueprint gate-source-builds
2015-08-28 00:02:45 -07:00
Kai Qiang Wu(Kennan)
eae8903ae0 Add developer docs automatic produce support
Partially-Implements: blueprint kolla-tox-doc

Change-Id: Ie950667a61d9ce45fcc7e26915a7aa0f0ca6b597
2015-08-28 06:11:08 +00:00
Sam Yaple
aada29b4db Remove tiered building in build.py
Many tiers have been shed over this issue and frankly enough is enough
on this tiering thing, it's tiering us apart! Now we use threading a
bit better as well.
No more tiers! Puns very much intended.

Additionally, this refactors the function names to make inc0 happier
and be consistent.

We also modify the test_build.py to catch the new statuses introduced
by the regex patch. Then we remove the Ubuntu Source from the Docker
folder test as that will never ever be functional.

Also fixed regex to properly match true regex expressions.

Co-Authored-By: Michal Jastrzebski (inc0) <michal.jastrzebski@intel.com>
Change-Id: I650fd6af76eddb809756762222e66aefd6fc1dca
Partially-Implements: blueprint build-script
2015-08-27 08:56:49 +00:00
Jenkins
0f2a4e1e0b Merge "Prepare for gating by distro, type, docker type" 2015-08-21 16:49:10 +00:00
Sam Yaple
7f029b759c Add Dockerfile template for kolla-ansible
Change-Id: I53113d2a7595177839daebe74fa5bc409573f824
Partially-Implements: blueprint dockerfile-template
2015-08-19 05:19:29 +00:00
Steven Dake
79d9951634 Prepare for gating by distro, type, docker type
We will gate on all combos of:
/docker
/docker_templates
Centos
Ubuntu
Binary
Source

Except for Ubuntu + Binary because there is no delorean
style repository for Ubuntu.

Change-Id: Ic1ed8c22c2f86ff339299939da9ac492a7c7c5f5
Partially-Impelements: blueprint gate-source-builds
2015-08-18 00:22:02 -07:00
Jeff Peeler
9a78a5b6f1 Change tox targets to use new build.py
tox -e images-centos-binary
tox -e images-centos-source

Both above now execute parallel image building script.

Change-Id: I6a4174b184fc239c6baa950a9c787fc6ad220774
Paritally-Implements: blueprint gate-source-builds
2015-08-14 17:32:14 +00:00
Steven Dake
f5c80d80d7 Change the tox targtes to match naming
The tox targets were previously src and rdo when they should
have been source and binary.

The gate review has been changed to these as well.

Change-Id: Ib09980c77e5859fa28a54953fc1f3f123c1886d7
2015-08-12 22:58:06 -07:00
Jeff Peeler
9f824cfe4e Add new test script for parallel builds
This adds a new test script for the new python based build script. A new
tox target has been created to execute it for usage in the gate.
Eventually, the other build script stuff can be deleted, but that won't
be done until full functionality exists in the new build.py.

Change-Id: Id9dd19926b1b9d875dcb069fd13d6450318374c8
Paritally-Implements: blueprint build-script
2015-08-12 14:30:24 -04:00
Steven Dake
777a1a5640 Add centos-src-build tox gate
Change-Id: Id8c8e0d4dcad62e3995fa7f2bb91b6bafb3a387c
Paritally-Implements: blueprint gate-source-builds
2015-08-10 12:36:11 -07:00
Steven Dake
4d85d9d016 Use docker-engine in setup_gate
The fedora version of docker is hacked by Red Hat to have specific
features which we don't want in the gating.  Use the pristine
upstream version from Docker Inc.

Change-Id: Ied219bc3868176f541083e9d42cde7d6cdeeb71d
Partially-Implements: blueprint gate-source-builds
2015-08-10 12:36:09 -07:00
Steven Dake
33d8d32381 Remove validate-min-env-vars gating
We don't use config-internal anymore, so remove validate-min-env-vars
from being gated upon.  This is becuse there is no minimum
environment variables required.  While we are at it we remove
min-env.

Partially-Implements: blueprint remove-config-internal

Change-Id: Ibe2947b35e4dc1549e82acc66c01153495a91882
2015-08-07 20:18:33 -07:00
Sam Yaple
98a379b0fd Reduce dependencies on the dest nodes
Currently we require a slew of deps on each destination node, this
includes a gcc compiler and installing things via pip. We can remove
these dependencies by containerizing them and running and Ansible
inside the container itself. The container would then report back
facts about idempotency.

DocImpact
Closes-Bug: #1481495
Implements: blueprint containerize-dependencies
Change-Id: I3dfccbf9fafc06ffc36e78f3006fe5d3367891df
2015-08-06 01:32:05 +00:00
digambar
e245eb2ff5 Implement kolla-compose script
Renamed kolla script to kolla-compose
Update change in the dev guide also

Change-Id: I6cae3d13752ecb4bb3deeb91c5e0f827fde80c2a
Implements: blueprint kolla-compose-script
2015-07-27 12:18:56 +05:30
Borne Mace
0cd4e9bc7c Removed all validate-contents tests from pep8 test
Change-Id: I2762ecf64fab090f3594bf4330dea101ba1434dd
Partially-Implements: blueprint rename-pep8-validate
2015-07-20 08:42:08 -07:00
Sam Yaple
2d61572e17 filter ansible/library from tox.ini
Change-Id: Ib063ce61fd262e77c42cb99c58983051be4c34b0
Closes-Bug: #1473697
2015-07-12 03:13:13 +00:00
Borne Mace
160d163878 Enable pep8 tests
Change-Id: I476c335b60d3195a2381a91ad05d8f64f62190d0
Partially-Implements: blueprint enable-flake8
2015-07-10 14:13:47 -07:00
Jenkins
75e01a2fb2 Merge "Add min env vars doc validation to pep8 gate" 2015-07-07 13:55:21 +00:00
Borne Mace
3875d6d302 Fixing tox tests - split out validation tests
Added additional tox test for json / yaml / link /
dockerfile validation. This currently mimics the
existing pep8 test which will be updated to run flake8

Change-Id: Id4657e6d4f4921ab419dc84e8d62468a827aaeb1
Implements: blueprint rename-pep8-validate
2015-07-06 16:41:45 -07:00
Martin André
d006122d9c Add min env vars doc validation to pep8 gate
Change-Id: I7711e9ee597184e34c88c0deeaf916fb1547b704
Implements: blueprint add-min-env-vars-gate
2015-07-05 09:08:15 +09:00
Martin André
d30712a34c Add link validation to pep8 gate
Change-Id: I2e6ac673fa9934850da6dec7b6cf3618c1437de0
Implements: blueprint add-broken-symlink-check
2015-07-02 09:09:52 +09:00
Steven Dake
e7edb092c1 Ignore .tox directory to remove some bashate failures
Change-Id: I7342e4b0b31e0add681ab5b24083eda10031f0cf
Partially-Implements: blueprint bashate-gate
2015-06-08 11:01:50 -07:00
Steven Dake
5a093488c3 Remove 1000 bashate failures by ignoring .git directory
Change-Id: I64f04bddf2d7fac1c6dd0a801b974501b24f3ac0
Partially-Implements: blueprint bashate-gate
2015-06-07 12:17:59 -07:00
Jeff Peeler
78b27e3e60 Clean up the image functional test
1. Move setup_docker.sh to tools directory

2. Make a setup_gate.sh that installs necessary packages including
   docker and starts docker.

3. Add logging output.

4. Add default test timeout of 2 hours.

5. Add user to the docker group before running test cases.

6. Run image build as dockerroot group.

This patch has to be one commit to fix the gate in one go.

Co-Authored-By: Steven Dake <stdake@cisco.com>

Change-Id: I83f3cdb1dabf0dfface589c581cb22c155467acc
2015-05-26 15:01:28 -04:00
Jeff Peeler
21cd478cbd Add functional tests to tox
This adds functional tests to tox, along with a number of prerequisite
steps. Since this is primarily a bash project, pbr usage has been avoided.
Tests are to be written in python and put in the tests directory.

Running tox -e setupenv will execute a setup script
(tests/setup_docker.sh) to ensure the running instance of docker meets
the minimum version requirement.

Running tox -e images will execute the image building script
(tools/build-all-docker-images) and will parse the resulting output to report
failures.

Running tox -e startenv will generate the environment file, run
"tools/kolla start", and run first time initialization (eventually).

Running tox -e functional is for actually testing the deployed OpenStack
environment via a series of tests utilizing the client APIs.

Change-Id: Iff6dfdca43f0c44d471e7540a7836e56a0de4507
2015-05-13 15:38:07 -04:00
Lars Kellogg-Stedman
6666d1e973 add maintainer check to tests
Change-Id: I6ee985e694142aa7dadeb085b77910667ac6359f
2014-10-31 10:10:27 -04:00
Lars Kellogg-Stedman
8b4f8d91ad modify tox config to use new validation code
this patch modifies tox.ini to perform both the JSON and YAML validation
checks.

Change-Id: Ie8db699f19dc7698407bab1e3d51dcb6184cfad2
2014-10-14 22:36:43 -04:00
Chmouel Boudjnah
5aa235066c Rename validate-json target as pep8 and improve it
When discussing with the infra guys they have mentioned it would be
easier to call our linting job pep8, it's indeed badly named but that
target has been used all over openstack for linting projects. As a bonus
point it would make things easier to add the job to the gate. To make
that patch much more interesting than a three characters change I have
improved the validate-samples script to detect if jsonlint was present
and if not fallback to the standard python -mjson.tool which give you
less details but nonetheless works if jsonlint is present.

Change-Id: I8d71a229917004dfd7223a16e4f270101cf2f0a8
2014-10-03 21:18:12 +02:00
Chmouel Boudjnah
ac0b2a797f Add validate-json tox target
This is a simple JSON validation script based on demjson python library,
we do some shell script trickeries to exit properly if there is a
failure for tox (should probably patch demjson to properly exit
instead).

Change-Id: I930908336deef7daeaab5b55ba2031c64698d880
Implements: blueprint json-validation-gate
2014-10-03 09:59:19 +00:00