648 Commits

Author SHA1 Message Date
Jenkins
0b8b18d840 Merge "XenAPI: Tail output from stack.sh" 2014-06-24 18:00:30 +00:00
Jenkins
690fd92096 Merge "Handle failure of openstack endpoint" 2014-06-24 17:54:18 +00:00
Bob Ball
dc7ebbb9a4 XenAPI: Tail output from stack.sh
While installing devstack in XenServer's DomU we can easily
track the output so end-users have much more visibility of
both what is going on and what (if anything!) went wrong.

Change-Id: I7d12a13cea9dffda6c1388ce711b6adf76cae72c
2014-06-24 14:37:36 +01:00
Bob Ball
8230296ec3 Use curl to download from github.com
Github recently removed some sslv3 ciphers - wget seems to only
enable a subset of the ciphers available so fails now, but curl
continues to succeed.

Use --no-sessionid to work around
https://bugzilla.redhat.com/show_bug.cgi?id=1098711

Change-Id: Ia110bd2d0a222e438189c10a9c1a236bd7ea3d0e
2014-06-24 11:36:47 +01:00
Ian Wienand
bcdce9ea12 Handle failure of openstack endpoint
Change 4f7bf6963a1e9ae03bc0ae9189874cba561ad62f introduced finding the
endpoint via "openstack endpoint show" only.  Previously that output
was piped through grep, etc. so it handled fell back to a blank
output when the endpoints were not available.

Ignore failures of this command so the blank output is matched

Change-Id: Iae2f09784ffa38efd2f858513bf284c84c32edac
2014-06-24 15:06:02 +10:00
Jenkins
d4f3ab9c1f Merge "Move static docs into master branch" 2014-06-23 13:42:55 +00:00
Jenkins
4adc16f7e4 Merge "add worlddump tool to devstack" 2014-06-22 17:40:15 +00:00
Sean Dague
97fcc7b27b add worlddump tool to devstack
when we exit poorly, start building a tool for doing a capture
as to why. This tool is expected to be consumed directly from
grenade as well.

Change-Id: Ia1bc1c2e259587035ca7252baceec25fa464cb82
2014-06-22 11:37:51 -04:00
Dean Troyer
54b9732339 Move static docs into master branch
The hand-maintained static HTML docs for DevStack have been in a
GitHub gh-pages branch; move them into the master branch in
preparation for hosting them in openstack.org infrastructure.

By default tools/build_docs.sh now builds the static HTML output
into docs/html.

Change-Id: Ide5f7d980a294c7a9f8a3decaed0939f1c239934
2014-06-20 18:04:55 -05:00
Jenkins
4fbb8137af Merge "Reserve Keystone ports from the ephemeral range" 2014-06-17 01:24:47 +00:00
Jenkins
3723814bf2 Merge "convert devstack from awk to outfilter" 2014-06-16 14:24:06 +00:00
Sean Dague
62cb563ddc convert devstack from awk to outfilter
The complexity of the awk script was pretty high, and it would
be good to do it in summaries as well, which starts to get a bit
squirelly. Instead bring over the outfilter.py from grenade and
use it for the timestamping.

Any additional overhead from python should be offset from not
shelling out to date on every line of output.

Change-Id: Ic2b86ddba3e7f6520a0fd35599b01143936c6deb
2014-06-16 07:03:23 -04:00
Morgan Fainberg
6cae83efd7 Reserve Keystone ports from the ephemeral range
Reserve Keystone ports from the ephemeral range as early as reasonably
possible in the fixup_stuff.sh process to reduce the likelihood that the
port will be in use. This does not completely resolve the issue
where Keystone's IANA assigned port falls into Linux's ephemeral
range, but this should reduce the occurrences. The default ports
are 35357 and 35358.

Change-Id: I8cfb53d8f90c1ff1fb1083c59fefabca3d14323b
Partial-Bug: #1253482
2014-06-13 21:33:52 +00:00
Attila Fazekas
d7967a4879 selinux permissive on Fedora
The f20 gate job is failing on hpcloud images
(official F20 cloud image), with enforcing selinux.

Setting selinux to permissive on all Fedoras.

Currently selinux policies are violated, when
 - horizon/httpd tries to access a files without
httpd_t friendly security label.
 - horizon/httpd_t tries to connect to openstack
   service port, without an allowing policy.
 - swift tryes rsync content without an authorized
   security label and without rsync_full_access sebool.
 - ..

In permissive mode you will be able to track,
the missing policies and labels by checking
the /var/log/auidit/audit.log*

The enforcing mode might be turned on in the future,
when all label and policy configured correctly.

Change-Id: I6dad705dd11b9eb5f01ce67814f05d294b3979a5
2014-06-12 11:41:54 +02:00
Jenkins
c3fd0b5298 Merge "make get-pip.py download failures more clear" 2014-06-10 15:16:04 +00:00
Mathieu Gagné
76ed427ca1 Update setuptools to latest for .dist-info support
Support for .dist-info directories was added in setuptools 0.6.28.

At this moment, Ubuntu Precise 12.04 provides setuptools 0.6.24
which is too old for our needs.

Six is installed from wheel which uses the .dist-info directory.
For six to be found, we need to install setuptools >= 0.6.28.

Updating setuptools to the latest version using pip will provide use
the needed version to make six discoverable.

Closes-bug: #1326811
Change-Id: I761d0aeb2b8b593cee38d512afc8fed6a2d1fe37
2014-06-05 18:11:16 -04:00
Sean Dague
f625ffe24f make get-pip.py download failures more clear
curl dying ends up being a really unclear failure condition, and
hard to fingerprint in the gate. We should make this much more
explicit when we die.

Also, don't trust the upstream filename, because all the rest of
our logic would break if it changes anyway.

Change-Id: Ibc2a96b33471d24c597af0d7af896fb10523156f
2014-06-05 14:01:56 +00:00
Sean Dague
7b63c5ec9e be opinionated: only use get-pip.py
get-pip.py is now on a CDN, and is the prefered way to get pip.

Remove the default path of using pip tarballs from pypi and use
get-pip.py on from here on.

Closes-Bug: #1326539

Change-Id: I0661f7c6913ba6b3e1d00b30e22740d150bfd060
2014-06-04 22:53:25 +00:00
ftersin
4f7bf6963a Fix getting EC2 and S3 urls in create_userrc
Invalid parsing of openstackclient output was introduced in
I03c17cfc9740c3eb257152c95d9c4f021db2c89e. Here command lines
was changed to get urls with no parsing.

Also default EC2_URL was fixed.

Change-Id: Ic46a9989321cf6310c56edeeb737c603a4f9c1ed
2014-05-21 22:09:46 +04:00
Jenkins
d65f7a2858 Merge "Upgrade to cirros 0.3.2" 2014-05-19 19:20:00 +00:00
Jenkins
9c2962a255 Merge "XenAPI: Fix final script to include functions" 2014-05-19 18:38:48 +00:00
Bob Ball
d06d4550de XenAPI: Fix final script to include functions
Generally a ubuntu template is supplied - but in the case
where it is not, we need to source functions before sourcing
stackrc (Through xenrc)

Change-Id: I8325cf1c6f83946b7798e6d1bb8278e86831d3c4
2014-05-15 21:12:50 +01:00
Jenkins
ceda7cfe65 Merge "Update create_userrc to openstackclient commands" 2014-05-08 05:34:27 +00:00
Jenkins
6445bd6c15 Merge "Force TFTP to listen on IPv4 endpoint" 2014-05-06 11:49:19 +00:00
Attila Fazekas
522cfe0951 tempest py26 setup
Simplifying the steps between devstack install and tempest run, by
 * installing tox<1.7, bacuse 1.7 is not compatible with our tox.ini
 * installing and patching 'discover' when the python version is 2.6

Change-Id: I8008837d2fae6cebeeeb051b63066279ca477e01
2014-05-05 07:36:49 +02:00
Dmitry Tantsur
8c0bd9fe46 Force TFTP to listen on IPv4 endpoint
On Fedora with the default configuration TFTP will listen only
on IPv6 endpoint, making imporrible for a node to reach TFTP.
This patch forces TFTP to listen on IPv4 endpoint by modifying
Xinet.d template.

Change-Id: I1ed315fae38816c8e0c2a736261d1c3736f437ff
2014-05-02 13:03:25 +02:00
Jenkins
a6c21928d2 Merge "Enable console logging for Ironic baremetal VMs" 2014-05-02 10:08:08 +00:00
Sean Dague
b623860c37 add Fedora x86_64 image for nodepool
Change-Id: I54fdc81e2a233fdcf90534aff6be7984e28f6133
2014-04-17 21:56:53 -04:00
Steve Martinelli
bce8899cde Update create_userrc to openstackclient commands
Updated keystoneclient commands in tools/create_userrc.sh
to their openstackclient equivalents.

Change-Id: I03c17cfc9740c3eb257152c95d9c4f021db2c89e
2014-04-16 00:32:53 -05:00
Adam Gandelman
8af6faed81 Enable console logging for Ironic baremetal VMs
Logs console output of VMs created for use by Ironic to
$DATA_DIR/ironic/logs. This gives Jenkins something to archive
that will be useful for debugging any deployment ramdisk issue
blocking provisioning.

Change-Id: I7d234a6a13dbe8579f685e46d7712dae497272a5
2014-04-11 18:14:16 -07:00
Jenkins
9d88ee8057 Merge "Edit docs to include git.openstack.org url" 2014-04-04 03:51:33 +00:00
Sean Dague
0936e67f54 add an image_list tool
this is an interface from devstack to provide a more robust
listing of the possible image urls that we might ask for during
a devstack run. This allows tools like nodepool, or 3rd party CI
systems to precache all this content in advance.

Change-Id: I7474f553ecf28e51a2340bef5bcefa962dbadc24
2014-04-03 14:48:48 -04:00
Sphoorti Joglekar
ce365ce1cc Edit docs to include git.openstack.org url
This patch proposes a change to clone the devstack repository from
git://git.openstack.org rather than https://github.com since git urls
are faster than https and put less loads on the server.

Change-Id: I7fe6a0f81be812dacfef575caa1cf0ae800f9a29
2014-04-02 18:35:21 +05:30
Sean Dague
33ff33b1fb cache the pip tarball
there is no need to download the pip tarball over and over again
on rerun. Use the cached value.

Change-Id: Ibcc1807ba2aca062f69839212f05ac9394db9448
2014-03-28 15:14:56 -04:00
Jenkins
27599b1b17 Merge "Set VIRSH_DEFAULT_CONNECT_URI in Ironic scripts" 2014-03-21 14:54:12 +00:00
Jenkins
32dcd52f76 Merge "Remove blank space after print" 2014-03-21 14:54:09 +00:00
Attila Fazekas
2d4c8da803 Upgrade to cirros 0.3.2
Cirros 0.3.2 is fixing the host name setting issue, which
is required for turning on the tempest instance validation tests.

Change-Id: I1b87740ab02c4eb0a8df653a35e1f85d40abda51
Related-Bug: #1132686
2014-03-20 23:12:58 +01:00
Adam Gandelman
bd93f02850 Set VIRSH_DEFAULT_CONNECT_URI in Ironic scripts
Ironic setup scripts that interface with virsh should default to always
connecting to the 'qemu:///system' URI.  Adds LIBVIRT_CONNECT_URI that
ends up exported as VIRSH_DEFAULT_CONNECT_URI in scripts that require
it.

Change-Id: Ib660bd51a8c7bfe96e14aab4b6d3a6e83a5a4220
2014-03-17 16:31:49 -07:00
Alexander Gordeev
06fb29c661 Integration testing preparation for Ironic
Add ability to create/register qemu vms for Ironic testing purposes

Implements bp:deprecate-baremetal-driver

Change-Id: If452438fcc0ff562531b33a36cd189b235654b48
2014-03-14 13:44:00 -07:00
Sean Dague
7d4c7e09b4 remove docker from devstack
with I1c9bea2fdeebc4199c4f7d8fca4580a6fb7fed5b nova removed
docker from it's driver tree.

We shouldn't have driver support inside of devstack that's not
part of upstream projects (this has been a line we've been
pretty clear on with Neutron drivers in the past).

Remove docker driver accordingly.

Change-Id: Ib91d415ea1616d99a5c5e7bc3b9015392fda5847
2014-03-12 08:05:08 -04:00
Joe Gordon
bb1e07859c Don't install vim or locate by default
Devstack doesn't need vim or locate, if someone wants to use them, they
can just install them afterwards.

Change-Id: I00f27c20c86d89465e4aefc67ed645a309c09a03
2014-03-07 12:47:06 -08:00
zhang-jinnan
8829acaf14 Remove blank space after print
Keep code clean and pleasure:)

Change-Id: Ie0c0781eaeb57b32a9a6185a59353fc4b911afd6
2014-03-04 09:58:32 +08:00
Masayuki Igawa
46c688c1ae Fix pep8 errors
This commit fixes pep8 errors.

Change-Id: Ia1f1d61081a86b8a58251918392171cbc60f5ab8
2014-03-02 08:55:14 +09:00
Ian Wienand
aee18c749b Enforce function declaration format in bash8
Check that function calls look like ^function foo {$ in bash8, and fix
all existing failures of that check.  Add a note to HACKING.rst

Change-Id: Ic19eecb39e0b20273d1bcd551a42fe400d54e938
2014-02-28 07:59:03 +11:00
Jenkins
415893fadd Merge "Add end-of-file checks to bash8" 2014-02-27 04:36:59 +00:00
Jenkins
1c10bb3737 Merge "Move enablement of rhel6-optional repo earlier" 2014-02-26 19:04:11 +00:00
Jenkins
339ec17731 Merge "remove sysstat & pidstat" 2014-02-26 02:38:30 +00:00
Ian Wienand
3e37326a35 Move enablement of rhel6-optional repo earlier
Change 4f1fee6eae300a3384900df06ebc857e95854eb0 added the RHEL6
optional repo in fixup_stuff.sh, but it turns out that doesn't get run
until after the package prerequisites phase.  Move this into stack.sh
with the RDO repo setup.

Change-Id: Iae0df85fa94c6c1b6f497dd29fda90d03b903a41
2014-02-26 13:34:18 +11:00
Jenkins
e26b7bb415 Merge "Fix missing libffi-devel for python-glanceclient" 2014-02-25 23:32:36 +00:00
Ian Wienand
b8e250232e Add end-of-file checks to bash8
Add two end-of-file checks to bash8.  Firstly, alert if heredoc hasn't
finished.  Some heredocs were done like:

---
sudo bash -c "cat <<EOF > foo
...
EOF"
---

(A better way to do this is "cat <<EOF | sudo tee ..." as it retains
the usual heredoc layout in the code).

The trailing quote was throwing the matching in bash8 off and it kept
appending the next file as if it was still part of the heredoc.  To
avoid this, we check if we're still in a heredoc when we start a new
file; if so raise an error and reset the heredoc status fresh.  We
track the state of the previous file, line and lineno so we can give a
good error.

---
E012: heredoc did not end before EOF: 'cat <<EOF'
 - lib/trove: L221
---

This includes fixes for the existing problem heredocs.

A similar EOF check is to ensure the previous file ended with a
newline.

---
E004: file did not end with a newline: '$MY_XTRACE'
 - lib/neutron_plugins/embrane: L40
---

This requires only one fix

Change-Id: I5e547d87b3921fc7ce6588c28f074e5c9f489c1f
2014-02-26 09:31:15 +11:00