794 Commits

Author SHA1 Message Date
Dean Troyer
4533eeec1f Install Nova into its own venv
Install a couple of optional feature prereqs in hypervisor plugins.

rootwrap is horribly called indirectly via PATH.  The choice, other than fixing
such nonsense, is to force the path in sudo.

TODO:
* python guestfs isn't in pypi, need to specifically install it to not
  use the distro package

Change-Id: Iad9a66d8a937fd0b0d1874005588c702e3d75e04
2015-03-26 14:54:00 -05:00
Attila Fazekas
c70605d101 Add lioadm cinder iscsi helper support
The Linux-IO is a modern way of handling targets.
Per the IRC discussions lioadm as default
seams like a better default for everyone, for now it will be
optional, but the tgtadm admin support expected to be removed when
lioadm works well with all CI (including third party).

Change-Id: Ia54c59914c1d3ff2ef5f00ecf819426bc448d0a9
2015-03-26 20:41:18 +01:00
Jenkins
8a64851689 Merge "eliminate TEST_ONLY differentiation" 2015-03-25 22:06:16 +00:00
Jenkins
b3d7cfd416 Merge "Until we prebuild wheels don't build wheels for deb installed libs" 2015-03-25 16:32:29 +00:00
Sean Dague
eeb7bda510 eliminate TEST_ONLY differentiation
devstack is a development and test environment, but by default we were
only installing the runtime dependencies. We should install all the
testing required packages as well.

Change-Id: I7c95927b9daad15766aac9d1276b10ca62efb24c
2015-03-25 11:55:32 -04:00
Joe Gordon
16e0656bd0 Until we prebuild wheels don't build wheels for deb installed libs
Until we have the ability to prebuild wheels so we don't spend time
compiling them during devstack runs, stop building wheels for libraries
that we still install from deb packages.

Long term we want to move away from using deb packages to install python
packages and use wheels. But until the wheel building logic is in place
so we don't have to compile wheels on each devstack run, don't waste
time compiling python libraries that we just use the packaged version of
anyway.

Change-Id: I962e2cfff223f7ab8efd5766ee0ef22229ab27bf
2015-03-24 07:28:11 -07:00
Dean Troyer
f8ae647f2e Install Keystone into its own venv
Configure Apache to use the Keystone venv.

Change-Id: I86f1bfdfd800f5b818bfb5c4d2750ff732049107
2015-03-20 10:47:37 -05:00
Jenkins
2949f4bffe Merge "Remove packaged rpm python libraries" 2015-03-20 15:27:29 +00:00
Jenkins
5c619b43db Merge "Install rsync-daemon on f22" 2015-03-16 05:08:37 +00:00
Ian Wienand
e52f6ca11f Remove packaged rpm python libraries
Let's just use pip versions

Change-Id: Idf3a3a914b54779172776822710b3e52e751b1d1
2015-03-13 14:14:49 +11:00
Attila Fazekas
b1a094d289 Install rsync-daemon on f22
swift requires to have rsyncd running as service or behind xinetd.
/etc/xinetd.d/rsync is not shipped with f22 and the daemon mode
 requires an additional package.
Adding rsync-daemon as swift dependency for f22 and f23(rawhide).

Change-Id: I33222719cabed59a261ce1b8ddedc457aa03800e
2015-03-12 16:26:47 +00:00
Jenkins
518ca616ae Merge "Don't use packaged unittest2" 2015-03-12 15:28:30 +00:00
Christian Berendt
d28ea9cbcb Add package mongodb to files/rpms/zaqar-server
The command mongo, used in lib/zaqar, is part of the package mongodb.
At the moment only mongodb-server is listed in files/rpms/zaqar-server,
mongodb has to be added there.

Change-Id: I60edeae6760addad62b9b61c3dcdecc2ff01cba7
Closes-bug: #1430939
2015-03-11 18:55:24 +01:00
Ian Wienand
b0595235a2 Don't use packaged unittest2
Let pip install unittest2; pip installation can conflict with the
packaged version.

Change-Id: Iec9b35174ac68ebf713cd7462d7b5a82583d6e22
Partial-Bug: #1430592
2015-03-11 12:07:20 +11:00
Akihiro Motoki
a3c103be7d neutron-nec: Vendor code split
Neutron NEC plugin support is configured using DevStack external
plugin mechanism. The following needs to be added in local.conf:

Q_PLUGIN=nec
enable_plugin networking-nec https://git.openstack.org/stackforge/networking-nec

Also removes lib/neutron_thirdparty/trema and files/debs/trema.
DevStack external plugin for Trema Sliceable Switch is available
and the following is needed to enable it in DevStack.

enable_plugin trema-devstack-plugin https://github.com/nec-openstack/trema-devstack-plugin

Change-Id: If983b986355fcc0118b6e0446b3b295f23b3c40e
2015-03-08 18:27:14 +09:00
Joe Gordon
40ce320bb0 Temporarily stop building mumpy wheel
It turns out we aren't actually using this wheel since we are still
installing the deb python-numpy, and building numpy takes several
minutes which is a lot considering we do it on every single dsvm job.

So until we have wheel caching in place, and are actually using the
version we build ourselves, stop wasting time.

Change-Id: I7643c55598e5ecc29ea708c537818b37a8047d4b
2015-03-06 15:35:51 -08:00
Jenkins
ad91baf1bc Merge "Remove lib/dib" 2015-03-06 15:09:03 +00:00
Steve Baker
249e36dec6 Remove lib/dib
diskimage-builder is a utility rather than a service, and is already
installed in devstack via pip when required.

lib/dib was created to allow an image to be created during a devstack
run for the heat functional tests, however this approach is no longer
being taken and there are no other known uses for lib/dib.

This change removes lib/dib and moves the pip mirror building to
lib/heat so that snapshot pip packages of the heat agent projects can
be made available to servers which the heat functional tests boot.

This also removes tripleo-image-elements, which has never
been utilised, and since images won't be created
during heat functional test runs it is no longer required.

Change-Id: Ic77f841437ea23c0645d3a34d9dd6bfd1ee28714
2015-03-06 10:57:52 +13:00
Jenkins
7a678bfcb2 Merge "Do not install the python-virtualenv on Fedora" 2015-03-05 14:44:14 +00:00
Joe Gordon
ab7df5ea1d Add cryptography to list if files to build before hand
building this takes 20 seconds or so

Change-Id: I95c71b1d0255c02038006bc743125ff2c49d9da9
2015-03-04 23:23:10 -06:00
Attila Fazekas
802473e45a Do not install the python-virtualenv on Fedora
The files/rpms/general:python-virtualenv explicitly
installed this package on Fedoras.

This package is not installed on other distros by devstack
by default.

If you stack/unstack the package gets reinstalled,
and confuses the system about the installed virtual-env version.
The uninstall works in CI, but it can be problematic when you do
reinstalls on the same machine.

The uninstall introduced by
834b804d3eda9029d3c66db0ab732a76a22ed08b, this commit deos not
has any reference to the external bug what it supposed to solve.

Related RDO thread started here:
https://www.redhat.com/archives/rdo-list/2015-March/msg00015.html

Change-Id: I4a723f179bdc28d39a4910fb9e3787e9e67c354b
2015-03-04 14:57:44 +01:00
Jenkins
aff8fb9be8 Merge "Remove debs for diablo volumes" 2015-03-03 15:10:29 +00:00
Joe Gordon
c82c30c55a Remove debs for diablo volumes
Diablo is long gone. Remove debs for diablo nova volumes

Original commit that added this: I3e7c412ff125dbadd18b59af55fb7dea9ea17b07

Move open-iscsi requirement over to ironic, (ironic conductor calls
iscsiadm)

libvirt driver uses iscsiadm for iscsi based volume attaches as well.
lvm backend is supported for libvirt driver

Change-Id: I536ba0ebdb6e3fa68f0a82b3027e70d8e2f35085
2015-02-27 12:58:48 -08:00
Attila Fazekas
99b598887b Fedora-21 has openjdk-1.8.0 only
Fedora-21 does not have openjdk-1.7.0 it has only 1.8.0.

This change also fixing the no op statement in the configure.

Change-Id: I6012aeb17b8e8fafa37d48aa29482702fa3491fd
2015-02-25 09:53:39 +01:00
Jenkins
a2be5e3a2d Merge "msgpack-python requires g++" 2015-02-24 22:42:00 +00:00
Jenkins
231a3e5587 Merge "Changed the log format for horizon's apache configuration" 2015-02-24 20:09:18 +00:00
Jenkins
2960ea1dea Merge "Install python-redis from pip" 2015-02-24 12:54:33 +00:00
George Peristerakis
e7b51362fd Changed the log format for horizon's apache configuration
The default apache log format is noisy. Added a custom log format
that matches the other apache log format of projects like keystone

Closes-Bug: #1222900
Change-Id: Id9a8c3a4413c778e009c56ffde6b646b8a120c8b
2015-02-23 19:10:51 +00:00
Attila Fazekas
0fda343c18 msgpack-python requires g++
msgpack-python when installed from source requires a C++ compiler
installed on the system, otherwise it falls back to the python
implementation.

Change-Id: Iffe1f90f3a70780be22459c3f7a3cddfe47f01ca
2015-02-23 14:33:52 +01:00
Attila Fazekas
d5004a3802 F21 requires redhat-rpm-config for mariadb-devel
As you can see in the f21 job, the python-MYSQL compilation
fails without this library.

At the first look it seams like packaging issue, so
I created bug related to this. [1]
Until the issue is addressed, the redhat-rpm-config will be
considered as build time dev dependency for f21.

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1195207

Change-Id: I731828cac912d1b11eaf2269364411c77a57d76c
2015-02-23 13:50:36 +01:00
Flavio Percoco
b592454e51 Install python-redis from pip
Following the leads of  I47b7e787771683c2fc4404e586f11c1a19aac15c and as
an attempt to fix a bug blocking Zaqar's gate, this patch installs
python-redis from pypi instead of using the distro package.

Change-Id: Idfef2fe1b41b44c4cba6b6948b621bc44e77659b
2015-02-23 09:23:55 +00:00
Jenkins
889f604642 Merge "Recent virtualenv review cleanups" 2015-02-23 01:26:30 +00:00
Jenkins
7ac35fc110 Merge "purge all pure python libraries" 2015-02-20 16:45:21 +00:00
Dean Troyer
99c463d56d Recent virtualenv review cleanups
This is a follow-on to comments in https://review.openstack.org/156356
and https://review.openstack.org/#/c/151513/

* Remove work-around for /var/cache/pip
* Remove WHEELHOUSE setting in tools/build_wheels.sh and use the pip
  default directory '<cwd>/wheelhouse'
* Remove bogus MySQL-python install
* Removed unused bits and clean up pip commands in from tools/build_venvs.sh

Closes-Bug: #1423720
Change-Id: I0283b0dff9146b1b63bd821358505a93566270c6
2015-02-20 08:56:53 -06:00
Mikhail S Medvedev
69741a99c7 Fix package names that cause f20/f21 breakage
Closes-Bug: #1423720
Change-Id: I8fdea7d24d1ec09885d2a395d4ba656f4194d39f
2015-02-19 19:05:28 -06:00
Jenkins
37e03c906b Merge "Build wheel cache for venvs" 2015-02-19 17:20:45 +00:00
Jenkins
9f86ec2f4d Merge "Add qemu-utils to n-cpu debs" 2015-02-19 03:21:35 +00:00
Joe Gordon
b787b684f3 Add qemu-utils to n-cpu debs
Qemu-utils is needed by nova-cpu, we are hitting issues with this in
multi node testing where fewer services are installed on the second
node.

Change-Id: I4b0a217a252c7862014443230dda2bcced355c93
2015-02-18 15:20:31 -08:00
Dean Troyer
b1d8e8e274 Build wheel cache for venvs
Building a bunch of virtual envs later is going to be tedious if we do not
pre-cache certain annoying-to-build packages.

* tools/build_wheels.sh: pre-build some wheels for annoying package installs
* list distro package dependencies in files/*/venv
* list packages to pre-build as wheels in files/venv-requirements.txt
* install database Python modules when setting up the database

Change-Id: Idff1ea69a5ca12ba56098e664dbf6924fe6a2e47
2015-02-18 15:13:00 -06:00
YAMAMOTO Takashi
606f3478b1 Remove no longer used definitions for Ryu
Change-Id: Ie6dcf1569aacfa8d20e905d694847594b136fed1
2015-02-18 13:56:35 +09:00
Sean Dague
39282bf769 purge all pure python libraries
python libraries should be installed from upstream, not from the
distro, as much as possible. The following is a first attempt at
purging all the python libraries and making it so that they instead
should fall back to the pypi versions.

Libraries which are known to include native code are left behind.

Change-Id: I47b7e787771683c2fc4404e586f11c1a19aac15c
2015-02-17 10:26:36 -05:00
Jenkins
314723962b Merge "Make EC2 compatible with current AWS CLI." 2015-02-12 17:48:54 +00:00
Jenkins
6bcd7009b5 Merge "qpid: plain auth needs cyrus-sasl-plain package" 2015-02-11 16:11:20 +00:00
Mehdi Abaakouk
d1e3ff14b8 qpid: plain auth needs cyrus-sasl-plain package
On fedora 21, qpidd cannot authenticate user, because
cyrus-sasl-plain is no more automatically installed.

This change fixes that.

Change-Id: I74452f40723881291b8c7577e5509da1c0e4e6e5
2015-02-11 14:27:11 +01:00
Wayne Okuma
00d0da36af Adds elasticsearch support as a pre-req for the glance-index.
Add elastic search pkg installation and start into the glance install
and start paths.

Change-Id: I53fc37225dd606f627c9f967083007613eb1f1bb
Implements: blueprint catalog-index-service
2015-02-09 11:35:00 -08:00
Andrey Pavlov
0ea8b72a20 Make EC2 compatible with current AWS CLI.
Nova listens for EC2 calls now at the URL without path -
http://some.server.com:8773/
I was made in review -
https://review.openstack.org/#/c/152496/

So I suggest to change EC2 urls in keystone catalog.

Change-Id: Ia2975ce0f6a30eed6016733e12c98b5f97648307
Closes-Bug: 1417555
2015-02-06 22:51:07 +03:00
Maru Newby
cbfe93bb48 Add postgresql dev package as testonly neutron dep
The neutron functional job needs to build psycopg2 which has a
dependency on postgresql dev packages.

Change-Id: Ie5c8e2bd02e148d6638f4a4c1fbf6667c30313d5
2015-02-06 15:45:12 +00:00
Maru Newby
c4b871f613 Add q-l3 conntrack dependency for ubuntu
The conntrack binary is included with conntrackd on rpm-based
distros but needs to be explicitly installed on ubuntu.

Change-Id: I615627c85d6aa5a465355c0ea27148f24d863a01
2015-01-30 22:24:30 +00:00
Attila Fazekas
1f316beb20 Remove rhel6 and py26 support
el6 is shipped with Python 2.6.x which is not expected
to be supported with the openstack kilo release.

For el6 support we need to do lot of thing differently,
which makes the code more complicated.

This change removes el6 and py26 support from devstack.

This change also removed a discontinued (1 year ago)
openSUSE 12.2 code path, which used a similar codepath as el6.

Several comment related to el6 also removed or modified.

Change-Id: Iea0b0c98a5e11fd85bb5e93c099f740fe05d2f3a
2015-01-27 09:22:52 +01:00
Attila Fazekas
55383f1a9b Do not install wsgiref for glance
wsgiref is not used by glance.

Change-Id: I5085e6418ca3cea2549b1b5d8a5877445b10c4a7
Related-Bug: #1255826
2015-01-26 18:06:33 +01:00