61 Commits

Author SHA1 Message Date
David Rabel
682e0abe1a Do not use libvirt-bin package anymore
The package libvirt-bin is a transitional package in Debian and should
not be used anymore.

Ubuntu Xenial is an exception here.

Because of that this change also adds the possibility to use "not:" to
exclude distros in files/debs/* just as "dist:" limits distros.

Depends-On: Icc59ea79f54d4ff8751f2e353ee3530fff3d961e
Closes-Bug: #1673840
Change-Id: I3998a7178d14ec40eae5cb199d66da9546cd6ccf
2017-03-24 10:44:10 +01:00
Daniel Alvarez
1d0841286e Adding haproxy package to Neutron
This patch adds haproxy package to devstack as Neutron will rely on it
for serving metadata instead of the current Python implementation.

haproxy will reduce the memory footprint from ~50MB to ~1.5MB for
serving metadata. It will be spawned for every Neutron router so,
for large deployments, it will be a significant memory reduction.

Change-Id: I36a5531cacc21c0d4bb7f20d4bec6da65d04c262
2017-02-24 12:05:03 +00:00
Clark Boylan
a09cb5acf9 Use java version independent package on Ubuntu
Different versions of Ubuntu ship with different versions of Java.
Trusty had 7, Xenial has 8, and so on. This causes problems when we
hardcode a versioned package name into our dep lists as that version may
not exist everywhere. Thankfully Ubuntu provides a default-jre-headless
package that we can use instead that maps properly onto whatever java
version is correct.

Change-Id: I4e5da215c8f7aa426494686d5043995ce5d3c3af
2016-12-15 08:48:02 -08:00
xiaolihope
8f985b6ff1 Remove heat code from devstack tree
This removes all of the heat code from the devstack tree, in favor of the
devstack plugin in Heat's tree.

Depends-On: I4bed1e5cef5afa7b049b07640086a86a3f881e13
Depends-On: Ic392bcc24bc374ee8511a94f1d8f6ac23131c7e3

Change-Id: I5b60422bf1f5fa78aa8f3383f7a222e0356d9e42
2016-11-15 15:00:43 +05:30
Jenkins
a2d1848419 Merge "Use apache for tls-proxy ssl termination" 2016-09-21 18:19:40 +00:00
Gregory Haynes
4b49e409f8 Use apache for tls-proxy ssl termination
Stud is now abandonware (see https://github.com/bumptech/stud) and is
not packaged in xenial. Lets use Apache for SSL termination since its
there already.

Change-Id: Ifcba410f5969521e8b3d30f02795541c1661f83a
2016-09-20 08:14:11 -07:00
scottda
f3daa9548e Add thin-provisioning-tools for Cinder
Ubuntu's LVM packaging does not support thin provisioning by
default:
 /usr/sbin/thin_check: execvp failed: No such file or directory
This is fixed with install of thin-provisioning-tools.

Change-Id: I31f572934ea94cae6e2aea27a2c731ee5bca68d3
Closes-Bug: #1615134
2016-09-06 16:21:57 -06:00
Julien Danjou
de40d9234b Remove Ceilometer leftover
Ceilometer uses a devstack plugin for a while now, so there should not
be any need for this file in the main devstack repository.

Change-Id: I3577c52b106c63c465a40ea3740eb5b8384e900e
2016-03-30 12:45:30 +02:00
Andreas Jaeger
70dcc17592 Remove libnspr4-dev for ceilometer-collector
Since change Ie38deadf190db33863c99d4610157349484ac10f ceilometer does
not use spidermonkey which needed libnspr4-dev to be installed. Thus the
requirement can be removed now.

Change-Id: Ib0685181f1cc4c9b58411a1679ac9dec1812f683
2016-03-28 18:40:05 +02:00
Mark Vanderwiel
d99c29032b Add dependency for hexdump
hexdump is used in common function generate_hex_string which is
used by nova and heat.  The current general dependencies do not
have this dependency covered, instead it is usually pulled in by
other implicit dependencies when a full devstack is built. In
cases where only a subset is built (like just Heat and keystone)
hexdump is missing.

Added unit tests for the generate_hex_string function.

Depends-On: Ib47d802a31a0f4c2a49daa7e6698e37c70a2365a
Change-Id: I77c8c2019fb8b8174cdfaed3e56ebf728f0732b7
Closes-Bug: #1558672
2016-03-22 09:34:04 +11:00
gordon chung
f21b86fefb Install uuid-runtime on Ubuntu
It seems uuidgen doesn't exist by default on the new trusty nodes [1].
There are quite a few projects that use uuidgen [2] so we need to
ensure it's on the node.

On Trusty, this is provided by the uuid-runtime package.  Note that on
Centos & Fedora this is provided by util-linux which is already tehre.

[1] http://logs.openstack.org/75/292475/1/check/gate-telemetry-dsvm-integration-ceilometer/2e85d1f/logs/devstacklog.txt.gz#_2016-03-16_19_20_30_116
[2] http://codesearch.openstack.org/?q=uuidgen&i=nope&files=&repos=

Change-Id: I230836d8b644698473d0611931334c232cf00734
2016-03-17 14:26:48 +11:00
Matt Riedemann
8d6d116530 Install libosinfo on n-cpu nodes
As of 9de8f7230d069e4da9736f09ad5d17773315b476 nova is now attempting
to import libosinfo packages, so install them for goodness sake.

Change-Id: Ib481dda475dd2975a513052478be0007aa1cf4a8
Related-Bug: #1543288
2016-02-10 06:38:43 -08:00
Morgan Fainberg
5997ce3ab6 Always cache tokens in a shared memcache
Instead of using in-process caching for tokens per service per
worker (disabled by default now), use a shared memcache to cache
token validation(s). This should both offload/speedup validations
and avoid the issues surrounding inconsistent validation responses
when using in-process caching [since each worker caches separately].

Change-Id: Ifc17c27744dac5ad55e84752ca6f68169c2f5a86
2016-01-22 00:04:57 +00:00
Jenkins
1195a5b739 Merge "Remove ironic code from tree" 2015-12-28 17:06:48 +00:00
Jim Rollenhagen
47367071cd Remove ironic code from tree
This removes all of the ironic code from the devstack tree, in favor of
the devstack plugin in Ironic's tree.

Depends-On: I659e3de5c64df798441798ff48ba5c9c0506585a
Depends-On: I2c52bc014f1b0dbc6b0ae22a4deb4132b4c28621
Change-Id: I5125fce295c79600781469c2f48bea80e7600081
2015-12-18 17:26:02 +02:00
YAMAMOTO Takashi
239a9788b3 Remove a stale comment about SQLALCHEMY_DATABASE_DRIVER
SQLALCHEMY_DATABASE_DRIVER is no longer used
after If6d8d08e5b7b7c48ca012677b536d71058def6fd .

Also, remove mysql connector packages from the install list.

Closes-Bug: #1523377
Related-Bug: #1493304
Change-Id: I5ecbc3b0bac989faa5c46d3c2866558a505414d8
2015-12-14 21:32:33 +09:00
Tushar Gohad
2960bfa7f6 Add liberasurecode-dev as a swift dependency
Swift requirement PyECLib won't bundle liberasurecode
going forward given the package is available in common
distros now.  This patch adds liberasurecode-dev(el)
package to the devstack debs/rpms list for Swift as a
PyECLib build/install dependency.

Change-Id: Idbc2ca3f677f1b8153ebf3a5912f4354525a55c7
2015-11-17 20:36:03 -07:00
Jenkins
9cea6e8854 Merge "Cleanup some of the deb/rpm installs" 2015-11-16 17:24:11 +00:00
Tony Breeds
2e8695b075 Add development libraries needed by Pillow
Change I8da7dd95ae24cf06dc7bdc300fcf39947a6df093 added Pillow build deps
to nodepool thick slaves.  This means that Pillow 3 will work in unit
tests.

Make the matching change to allow Pillow 3.0.0 to work under devstack.

The longer term aim is to remove temporary upper cap.

Change-Id: I2bec8cf1bfeaaa6ae329704229fdeb86d26e55c7
2015-11-11 12:04:18 +11:00
Ian Wienand
3dac869f80 Cleanup some of the deb/rpm installs
python-devel and the mysql/postgresql client dev-libs should all be
installed globally via the "general" installs; no need to installs
them separately

Change-Id: I91a9ace2e62a891634dbb4635ab2ad8c8dc59f91
2015-11-09 17:27:26 +11:00
Ian Wienand
c416d8b94f Sort rpm/deb files alphabetically
This is rather trivial, but it makes comparing the files much easier

Change-Id: I01e42defbf778626afd8dd457f93f0b02dd1a19d
2015-11-09 15:20:22 +11:00
Ian Wienand
a5e4c0f279 Clear out some duplicate package dependencies
I think these duplicate dependencies came in because we were not
correctly always installing "general" packages (see
Ie1b8d09369281059d21da61b2725a457f708ae9e)

Most of these are just extras for the lxml dependencies; I added zlib
devel to general for glance (seems pretty generic), and then that can
go too, as all other packages are specified.

Change-Id: I44b14ca15c64fad9daf1ac8d851704b02ea2eae0
2015-11-09 12:21:10 +11:00
Ian Wienand
a7e0b39a64 Move devlib packages into "general"
The removal of the wheel caching code
(Ia140dc34638d893b92f66d1ba20efd9522c5923b) removed the install of the
"devlib" packages, which was being done with a call in
tools/build_wheels.sh

The idea of "devlibs" and "general" seems to be pretty much the same
thing -- global build requirements.  I have removed the unused devlibs
files, and moved any missing packages into the "general" package
install file.

Change-Id: I8f34a164d6785a122394b42387d4221a7b447ae1
2015-11-09 12:06:18 +11:00
Sean Dague
5f8133caac remove gratuitous python packages
With pip + upper-constraints we're nearly always over installing all
python packages because we no longer support a range, we support
*exactly* one version.

This removes a bunch of the gratuitous package installs which we're
going to install over, lxml, numpy, libvirt. All of these we had
coming from packages in the past for speed concerns, but upper
constraints removes that.

It also ensures that all the headers to build all those are in
general, so they are guarunteed available at all times.

Change-Id: Ia76de730d65c84d81c4fb2c980ae1b4d595f9f5b
2015-11-06 11:48:19 -05:00
Davanum Srinivas
33a96ffc26 Zookeeper for DLM scenarios
In Tokyo, there was a cross project session on distributed
key locking:
https://etherpad.openstack.org/p/mitaka-cross-project-dlm

In support of the discussion there, we'll need support for
a zookeeper service in Devstack and ability to use libraries
like Tooz for DLM functionality.

In this review, we pick up some configuration files from
monasca-api and copy the lib/template to implement the
zookeeper lifecycle. Those services that need zookeeper
need to add "zookeeper" in ENABLED_SERVICES.

Change-Id: Icef26e5cdaa930a581e27d330e47706776a7f98f
2015-11-03 12:13:50 -05:00
Flavio Percoco
624ab1e65d Remove Zaqar from devstack
Zaqar's devstack code has been moved into a plugin in the Zaqar repo.
This patch removes the remaining code from devstack.

Depends-On: Iceefabb6cd528b23075a91e8039b8264eb3f33f5
Change-Id: Ifcf54fa2d4a5bf49b6757b593bb70cdeda8edb2a
2015-09-15 14:38:35 +02:00
Attila Fazekas
6691907683 Install cryptsetup on the n-cpu nodes
test_encrypted_cinder_volumes.* tempest test failes,
when cryptsetup package is not installed.

The following error can be seen in the n-cpu log:
Stderr: u'/usr/bin/nova-rootwrap: Executable not found: cryptsetup
(filter match = cryptsetup)\n'

Change-Id: I86603f1301fa946c8bb22de3e69a2ec1ab7f1ef3
2015-08-06 11:49:46 +02:00
Sean Dague
37eca48970 remove non RabbitMQ messaging
Part of what was decided at summit is devstack needs to return to a
more opinionated stance, the following removes support for non
RabbitMQ messaging. RabbitMQ is used by over 95% of our community
(statistically all of it), so it's a pretty clear line to draw that
this shouldn't be in tree.

iniset_rpc_backend will be our stable hook for other projects that
want to implement this out of tree. The burden on creating those out
of tree plugins will be on those that wish to support those
alternative stacks.

Change-Id: I8073a895c03ec927a2598eff6c2f01e5c82606fc
2015-06-16 08:28:52 -04:00
Jeremy Stanley
091b42b7da Stop installing nose and pylint from distros
The distro packages of nose and pylint depend on python-setuptools
on some platforms, and on some of those platforms (at least CentOS
6.x) you can't resolve dependencies on python-setuptools properly if
you've forcibly removed it already (as we do on our CI workers). It
appears that any current upstream use of these tools in relation to
DevStack-based testing is now relying on tox and pip to obtain them
instead.

Change-Id: Ibd16ac550c90364115caf57fae4f5f4cb5d5f238
2015-05-08 17:43:08 +00:00
Sean Dague
fad7b43abe testr requires python's gdbm
Debian/Ubuntu have *helpfully* removed gdbm from the base python
package and put it into another package, which is not dragged in by
installing python. Testr doesn't function without this.

We should ensure this always gets installed.

Depends-On: If48a8444b02ee1e105bc1d9ce78a0489ea0c405b

Change-Id: I85a0ffe5ee384e055e78fd3164c27d42a86bc39d
2015-04-21 22:59:51 +00:00
Jenkins
3064cee10a Merge "Added libxml2-dev package as a pre-requisite when installing tempest. This is required so that devstack can be installed on vanilla Ubuntu systems." 2015-04-17 15:49:07 +00:00
Raseel Bhagat
8c6276ea0a Added libxml2-dev package as a pre-requisite when installing tempest.
This is required so that devstack can be installed on vanilla Ubuntu systems.

Closes-Bug: 1225395

Change-Id: Id9116e00e18c23e8e6391d8aa652c04d8bdb86c3
2015-04-07 05:24:49 +05:30
Jordan Pittier
0c04c12b3f Swift PyEClib build requires 'make'
PyEClib was introduced recently to swift-master. It tries
to build liberasurecode which requires the `make` binary.

Change-Id: I8acfed4f7b46a29eac36f6acbe1d66e7fff800db
2015-03-30 18:15:25 +02:00
Jenkins
0471e588df Merge "Add lioadm cinder iscsi helper support" 2015-03-27 20:35:10 +00:00
Jenkins
9720239618 Merge "Install Nova into its own venv" 2015-03-27 17:34:10 +00:00
Dean Troyer
4533eeec1f Install Nova into its own venv
Install a couple of optional feature prereqs in hypervisor plugins.

rootwrap is horribly called indirectly via PATH.  The choice, other than fixing
such nonsense, is to force the path in sudo.

TODO:
* python guestfs isn't in pypi, need to specifically install it to not
  use the distro package

Change-Id: Iad9a66d8a937fd0b0d1874005588c702e3d75e04
2015-03-26 14:54:00 -05:00
Attila Fazekas
c70605d101 Add lioadm cinder iscsi helper support
The Linux-IO is a modern way of handling targets.
Per the IRC discussions lioadm as default
seams like a better default for everyone, for now it will be
optional, but the tgtadm admin support expected to be removed when
lioadm works well with all CI (including third party).

Change-Id: Ia54c59914c1d3ff2ef5f00ecf819426bc448d0a9
2015-03-26 20:41:18 +01:00
Sean Dague
eeb7bda510 eliminate TEST_ONLY differentiation
devstack is a development and test environment, but by default we were
only installing the runtime dependencies. We should install all the
testing required packages as well.

Change-Id: I7c95927b9daad15766aac9d1276b10ca62efb24c
2015-03-25 11:55:32 -04:00
Akihiro Motoki
a3c103be7d neutron-nec: Vendor code split
Neutron NEC plugin support is configured using DevStack external
plugin mechanism. The following needs to be added in local.conf:

Q_PLUGIN=nec
enable_plugin networking-nec https://git.openstack.org/stackforge/networking-nec

Also removes lib/neutron_thirdparty/trema and files/debs/trema.
DevStack external plugin for Trema Sliceable Switch is available
and the following is needed to enable it in DevStack.

enable_plugin trema-devstack-plugin https://github.com/nec-openstack/trema-devstack-plugin

Change-Id: If983b986355fcc0118b6e0446b3b295f23b3c40e
2015-03-08 18:27:14 +09:00
Jenkins
aff8fb9be8 Merge "Remove debs for diablo volumes" 2015-03-03 15:10:29 +00:00
Joe Gordon
c82c30c55a Remove debs for diablo volumes
Diablo is long gone. Remove debs for diablo nova volumes

Original commit that added this: I3e7c412ff125dbadd18b59af55fb7dea9ea17b07

Move open-iscsi requirement over to ironic, (ironic conductor calls
iscsiadm)

libvirt driver uses iscsiadm for iscsi based volume attaches as well.
lvm backend is supported for libvirt driver

Change-Id: I536ba0ebdb6e3fa68f0a82b3027e70d8e2f35085
2015-02-27 12:58:48 -08:00
Jenkins
a2be5e3a2d Merge "msgpack-python requires g++" 2015-02-24 22:42:00 +00:00
Attila Fazekas
0fda343c18 msgpack-python requires g++
msgpack-python when installed from source requires a C++ compiler
installed on the system, otherwise it falls back to the python
implementation.

Change-Id: Iffe1f90f3a70780be22459c3f7a3cddfe47f01ca
2015-02-23 14:33:52 +01:00
Flavio Percoco
b592454e51 Install python-redis from pip
Following the leads of  I47b7e787771683c2fc4404e586f11c1a19aac15c and as
an attempt to fix a bug blocking Zaqar's gate, this patch installs
python-redis from pypi instead of using the distro package.

Change-Id: Idfef2fe1b41b44c4cba6b6948b621bc44e77659b
2015-02-23 09:23:55 +00:00
Jenkins
7ac35fc110 Merge "purge all pure python libraries" 2015-02-20 16:45:21 +00:00
Jenkins
37e03c906b Merge "Build wheel cache for venvs" 2015-02-19 17:20:45 +00:00
Jenkins
9f86ec2f4d Merge "Add qemu-utils to n-cpu debs" 2015-02-19 03:21:35 +00:00
Joe Gordon
b787b684f3 Add qemu-utils to n-cpu debs
Qemu-utils is needed by nova-cpu, we are hitting issues with this in
multi node testing where fewer services are installed on the second
node.

Change-Id: I4b0a217a252c7862014443230dda2bcced355c93
2015-02-18 15:20:31 -08:00
Dean Troyer
b1d8e8e274 Build wheel cache for venvs
Building a bunch of virtual envs later is going to be tedious if we do not
pre-cache certain annoying-to-build packages.

* tools/build_wheels.sh: pre-build some wheels for annoying package installs
* list distro package dependencies in files/*/venv
* list packages to pre-build as wheels in files/venv-requirements.txt
* install database Python modules when setting up the database

Change-Id: Idff1ea69a5ca12ba56098e664dbf6924fe6a2e47
2015-02-18 15:13:00 -06:00
YAMAMOTO Takashi
606f3478b1 Remove no longer used definitions for Ryu
Change-Id: Ie6dcf1569aacfa8d20e905d694847594b136fed1
2015-02-18 13:56:35 +09:00