99 Commits

Author SHA1 Message Date
Daniel Alvarez
1d0841286e Adding haproxy package to Neutron
This patch adds haproxy package to devstack as Neutron will rely on it
for serving metadata instead of the current Python implementation.

haproxy will reduce the memory footprint from ~50MB to ~1.5MB for
serving metadata. It will be spawned for every Neutron router so,
for large deployments, it will be a significant memory reduction.

Change-Id: I36a5531cacc21c0d4bb7f20d4bec6da65d04c262
2017-02-24 12:05:03 +00:00
Dirk Mueller
ea774b684d [opensuse] add python-xml to general deps list
the python-xml is a subpackage from the standard cpython package that
that contains elementtree and other bits that are needed almost
everywhere in OpenStack but isn't installed on a absolutely minimal
openSUSE Leap installation. This package doesn't exist on pip but
is a SUSE only invention, so just treat it similar to a bindep.

Change-Id: I82887c2e6895740d1b16d1269574519450ca783e
2016-12-09 07:23:33 +01:00
Julien Danjou
de40d9234b Remove Ceilometer leftover
Ceilometer uses a devstack plugin for a while now, so there should not
be any need for this file in the main devstack repository.

Change-Id: I3577c52b106c63c465a40ea3740eb5b8384e900e
2016-03-30 12:45:30 +02:00
Mark Vanderwiel
d99c29032b Add dependency for hexdump
hexdump is used in common function generate_hex_string which is
used by nova and heat.  The current general dependencies do not
have this dependency covered, instead it is usually pulled in by
other implicit dependencies when a full devstack is built. In
cases where only a subset is built (like just Heat and keystone)
hexdump is missing.

Added unit tests for the generate_hex_string function.

Depends-On: Ib47d802a31a0f4c2a49daa7e6698e37c70a2365a
Change-Id: I77c8c2019fb8b8174cdfaed3e56ebf728f0732b7
Closes-Bug: #1558672
2016-03-22 09:34:04 +11:00
Ian Wienand
3bf69e835a Remove EC2 API from devstack
This all started with an investigation into Fedora's use of ecua2ools
package.  This package is a bit of a nightmare because it pulls in a
lot of other system-python packages.

For Ubuntu, this package was removed in
I47b7e787771683c2fc4404e586f11c1a19aac15c.  However, it is not
actually a "pure python" package as described in that change, in that
it is not installable from pypi.  I can't see how you could actually
run exercises/euca.sh on Ubuntu unless you installed euca2ools by hand
-- ergo I suggest it is totally unused, because nobody seems to have
reported problems.

In the mean time, ec2 api has moved to a plugin [1] anyway where the
recommendation in their README is to use the aws cli from amazon.

Thus remove all the parts related to EC2 and ecua2ools from base
devstack.

[1] https://git.openstack.org/cgit/openstack/ec2-api

Change-Id: I8a07320b59ea6cd7d1fe8bce61af84b5a28fb39e
2016-03-15 13:32:23 +11:00
Matt Riedemann
8d6d116530 Install libosinfo on n-cpu nodes
As of 9de8f7230d069e4da9736f09ad5d17773315b476 nova is now attempting
to import libosinfo packages, so install them for goodness sake.

Change-Id: Ib481dda475dd2975a513052478be0007aa1cf4a8
Related-Bug: #1543288
2016-02-10 06:38:43 -08:00
Morgan Fainberg
5997ce3ab6 Always cache tokens in a shared memcache
Instead of using in-process caching for tokens per service per
worker (disabled by default now), use a shared memcache to cache
token validation(s). This should both offload/speedup validations
and avoid the issues surrounding inconsistent validation responses
when using in-process caching [since each worker caches separately].

Change-Id: Ifc17c27744dac5ad55e84752ca6f68169c2f5a86
2016-01-22 00:04:57 +00:00
Tushar Gohad
2960bfa7f6 Add liberasurecode-dev as a swift dependency
Swift requirement PyECLib won't bundle liberasurecode
going forward given the package is available in common
distros now.  This patch adds liberasurecode-dev(el)
package to the devstack debs/rpms list for Swift as a
PyECLib build/install dependency.

Change-Id: Idbc2ca3f677f1b8153ebf3a5912f4354525a55c7
2015-11-17 20:36:03 -07:00
Jenkins
9cea6e8854 Merge "Cleanup some of the deb/rpm installs" 2015-11-16 17:24:11 +00:00
Tony Breeds
2e8695b075 Add development libraries needed by Pillow
Change I8da7dd95ae24cf06dc7bdc300fcf39947a6df093 added Pillow build deps
to nodepool thick slaves.  This means that Pillow 3 will work in unit
tests.

Make the matching change to allow Pillow 3.0.0 to work under devstack.

The longer term aim is to remove temporary upper cap.

Change-Id: I2bec8cf1bfeaaa6ae329704229fdeb86d26e55c7
2015-11-11 12:04:18 +11:00
Ian Wienand
3dac869f80 Cleanup some of the deb/rpm installs
python-devel and the mysql/postgresql client dev-libs should all be
installed globally via the "general" installs; no need to installs
them separately

Change-Id: I91a9ace2e62a891634dbb4635ab2ad8c8dc59f91
2015-11-09 17:27:26 +11:00
Ian Wienand
c416d8b94f Sort rpm/deb files alphabetically
This is rather trivial, but it makes comparing the files much easier

Change-Id: I01e42defbf778626afd8dd457f93f0b02dd1a19d
2015-11-09 15:20:22 +11:00
Ian Wienand
a7e0b39a64 Move devlib packages into "general"
The removal of the wheel caching code
(Ia140dc34638d893b92f66d1ba20efd9522c5923b) removed the install of the
"devlib" packages, which was being done with a call in
tools/build_wheels.sh

The idea of "devlibs" and "general" seems to be pretty much the same
thing -- global build requirements.  I have removed the unused devlibs
files, and moved any missing packages into the "general" package
install file.

Change-Id: I8f34a164d6785a122394b42387d4221a7b447ae1
2015-11-09 12:06:18 +11:00
Attila Fazekas
6691907683 Install cryptsetup on the n-cpu nodes
test_encrypted_cinder_volumes.* tempest test failes,
when cryptsetup package is not installed.

The following error can be seen in the n-cpu log:
Stderr: u'/usr/bin/nova-rootwrap: Executable not found: cryptsetup
(filter match = cryptsetup)\n'

Change-Id: I86603f1301fa946c8bb22de3e69a2ec1ab7f1ef3
2015-08-06 11:49:46 +02:00
Jenkins
7a0f6833ad Merge "remove non RabbitMQ messaging" 2015-07-02 20:09:05 +00:00
Dirk Mueller
c7e89f2380 SUSE: Clean up libxslt/libxml2 related dependencies
libxml2-devel is a dependency of libxslt-devel, so we don't need
to explicitly include it. Also, since it is only really needed
by python-lxml, consolidate it into devlibs and remove the copies.
Also remove a non-existing package reference along the way

Change-Id: If9afaaa93f2c485baa1efff74d7ae58c59713de6
2015-06-23 12:07:39 +02:00
Sean Dague
37eca48970 remove non RabbitMQ messaging
Part of what was decided at summit is devstack needs to return to a
more opinionated stance, the following removes support for non
RabbitMQ messaging. RabbitMQ is used by over 95% of our community
(statistically all of it), so it's a pretty clear line to draw that
this shouldn't be in tree.

iniset_rpc_backend will be our stable hook for other projects that
want to implement this out of tree. The burden on creating those out
of tree plugins will be on those that wish to support those
alternative stacks.

Change-Id: I8073a895c03ec927a2598eff6c2f01e5c82606fc
2015-06-16 08:28:52 -04:00
Dirk Mueller
987f83da5a SUSE: Add dependencies for L3 agent
Change-Id: If3f4f5ab9a3072273d2f440718ce0c75fd71fdf1
2015-06-12 13:32:39 +02:00
Dirk Mueller
643779873a Remove packaged rpm python libraries
We want to use the pip versions instead, only python-devel
should be needed.

Change-Id: If7720d54c4ad3358f9dc2fceedd6f5897085eb8f
2015-06-01 12:48:32 +02:00
Dirk Mueller
1ebe4f1ff0 Add missing libmysqlclient-devel dependency for SUSE
Currently devstack unconditionally installs MySQL-python, so
we need to have its dependencies available. Since this is
transitional until the switch to PyMysql happened, lets just
add the dependency for now to have devstack working again.

Change-Id: I638b5999d35a06eee962679b1cd95950bbf2b1d7
2015-06-01 12:48:27 +02:00
Jenkins
acdb7f6d52 Merge "Fix horizon files for SUSE" 2015-06-01 06:29:24 +00:00
Thomas Bechtold
06efa2ac5d Fix horizon files for SUSE
python-CherryPy and python-beautifulsoup are not needed so remove them
from the list of packages for horizon.

Change-Id: I45ddf98b5891a1f1f1da82bb4afa79ea43d156cc
2015-05-30 23:55:33 +02:00
Thomas Bechtold
4be092da3e Fix devlibs for SUSE
libmysqld-devel is needed for installing MySQL-python. Otherwise the
following error occurs:

EnvironmentError: mysql_config not found

Change-Id: Id84d3116d5987976169d8e2f9aca754ded205880
2015-05-30 23:28:48 +02:00
Jeremy Stanley
091b42b7da Stop installing nose and pylint from distros
The distro packages of nose and pylint depend on python-setuptools
on some platforms, and on some of those platforms (at least CentOS
6.x) you can't resolve dependencies on python-setuptools properly if
you've forcibly removed it already (as we do on our CI workers). It
appears that any current upstream use of these tools in relation to
DevStack-based testing is now relying on tox and pip to obtain them
instead.

Change-Id: Ibd16ac550c90364115caf57fae4f5f4cb5d5f238
2015-05-08 17:43:08 +00:00
Attila Fazekas
c70605d101 Add lioadm cinder iscsi helper support
The Linux-IO is a modern way of handling targets.
Per the IRC discussions lioadm as default
seams like a better default for everyone, for now it will be
optional, but the tgtadm admin support expected to be removed when
lioadm works well with all CI (including third party).

Change-Id: Ia54c59914c1d3ff2ef5f00ecf819426bc448d0a9
2015-03-26 20:41:18 +01:00
Sean Dague
eeb7bda510 eliminate TEST_ONLY differentiation
devstack is a development and test environment, but by default we were
only installing the runtime dependencies. We should install all the
testing required packages as well.

Change-Id: I7c95927b9daad15766aac9d1276b10ca62efb24c
2015-03-25 11:55:32 -04:00
Ian Wienand
b0595235a2 Don't use packaged unittest2
Let pip install unittest2; pip installation can conflict with the
packaged version.

Change-Id: Iec9b35174ac68ebf713cd7462d7b5a82583d6e22
Partial-Bug: #1430592
2015-03-11 12:07:20 +11:00
Attila Fazekas
0fda343c18 msgpack-python requires g++
msgpack-python when installed from source requires a C++ compiler
installed on the system, otherwise it falls back to the python
implementation.

Change-Id: Iffe1f90f3a70780be22459c3f7a3cddfe47f01ca
2015-02-23 14:33:52 +01:00
Dean Troyer
99c463d56d Recent virtualenv review cleanups
This is a follow-on to comments in https://review.openstack.org/156356
and https://review.openstack.org/#/c/151513/

* Remove work-around for /var/cache/pip
* Remove WHEELHOUSE setting in tools/build_wheels.sh and use the pip
  default directory '<cwd>/wheelhouse'
* Remove bogus MySQL-python install
* Removed unused bits and clean up pip commands in from tools/build_venvs.sh

Closes-Bug: #1423720
Change-Id: I0283b0dff9146b1b63bd821358505a93566270c6
2015-02-20 08:56:53 -06:00
Mikhail S Medvedev
69741a99c7 Fix package names that cause f20/f21 breakage
Closes-Bug: #1423720
Change-Id: I8fdea7d24d1ec09885d2a395d4ba656f4194d39f
2015-02-19 19:05:28 -06:00
Jenkins
37e03c906b Merge "Build wheel cache for venvs" 2015-02-19 17:20:45 +00:00
Dean Troyer
b1d8e8e274 Build wheel cache for venvs
Building a bunch of virtual envs later is going to be tedious if we do not
pre-cache certain annoying-to-build packages.

* tools/build_wheels.sh: pre-build some wheels for annoying package installs
* list distro package dependencies in files/*/venv
* list packages to pre-build as wheels in files/venv-requirements.txt
* install database Python modules when setting up the database

Change-Id: Idff1ea69a5ca12ba56098e664dbf6924fe6a2e47
2015-02-18 15:13:00 -06:00
YAMAMOTO Takashi
606f3478b1 Remove no longer used definitions for Ryu
Change-Id: Ie6dcf1569aacfa8d20e905d694847594b136fed1
2015-02-18 13:56:35 +09:00
Maru Newby
cbfe93bb48 Add postgresql dev package as testonly neutron dep
The neutron functional job needs to build psycopg2 which has a
dependency on postgresql dev packages.

Change-Id: Ie5c8e2bd02e148d6638f4a4c1fbf6667c30313d5
2015-02-06 15:45:12 +00:00
Attila Fazekas
55383f1a9b Do not install wsgiref for glance
wsgiref is not used by glance.

Change-Id: I5085e6418ca3cea2549b1b5d8a5877445b10c4a7
Related-Bug: #1255826
2015-01-26 18:06:33 +01:00
Maru Newby
5ecf46b581 Add 'acl' package to neutron deps
The acl package has been added as a test-only dependency of neutron.
It is used by the functional job in configuring postgres.

Change-Id: Ie28da793237b51cced3bd0a9b35273d9c50472e8
2015-01-09 13:40:12 +00:00
Monty Taylor
18a81a2058 Stop installing setuptools from distros
We go through a bunch of trouble to install setuptools via pip. Having
it in the distro install too is confusing.

Change-Id: I6875fe2a1ee6b7d296f7f44b4b1601794b136440
2014-12-26 09:53:21 -06:00
Monty Taylor
684e9e9ce2 Don't install sphinx from distro
We don't generate docs in devstack. But also, sphinx depends on babel
which has a hard depend that breaks with setuptools 8. However, pip
installed babel/sphinx should not have this problem.

Change-Id: I84a82e56f6540724d50c6201a68c480ba7645add
2014-12-17 11:48:59 -05:00
Kashyap Chamarthy
91e4018afd Add 'net-tools' package dependency
Noticed this on a freshly installed, minimal Fedora-21 (from
development repos):

  $ ./stack.sh
  [. . .]
  2014-11-13 10:56:22.442 | + local exitcode=0
  2014-11-13 10:56:22.453 | + sudo route add -net 10.1.0.0/24 gw 172.24.4.2
  2014-11-13 10:56:22.479 | sudo: route: command not found
  2014-11-13 10:56:22.488 | + exit_trap
  [. . .]

Also added it to files/rpms-suse/general, just in case.

Change-Id: I77954d97e654e8f384a2016631df14e73be927fe
2014-11-13 12:27:59 +01:00
Sean Dague
68e9f05f7c remove kombu from package lists
This is a pure python library that we should probably let pip
handle so that we don't accidentally only test whatever patched
version is in trusty instead of the upstream versions.

Change-Id: I93d2f9344b9f83d2397466b4bc29c97210919ed9
2014-09-28 10:38:29 -04:00
Thomas Bechtold
293869fbac Fix pkg name for mysql-connector-python on SUSE
The correct package name on SUSE distros is python-mysql-connector-python.

Change-Id: I5250356f782f149f87f3d0ffba3380911fa437be
2014-09-25 07:55:15 +02:00
Jenkins
b3ae835d7c Merge "don't install boto from packages" 2014-09-13 15:46:27 +00:00
Sean Dague
bcd3f63a99 don't install boto from packages
installing boto from packages pins some other pure python libraries
(like requests) in an unexpected way. As this is pure python we should
instead let this be install from pip and thus be controlled by global
requirements.

Change-Id: If5df9de8c3e1ad8faceab4b43c86134dbbc55a51
2014-09-03 11:30:54 -04:00
Jenkins
38f5fb7252 Merge "Support ipset for security group" 2014-08-31 06:38:04 +00:00
shihanzhang
9ec58aec64 Support ipset for security group
Install ipset if the q-agt service is enabled.

Partially implements blueprint: add-ipset-to-security

Change-Id: Ic0820a03e9823be39e26254e7c99fe2c4c811c8b
2014-08-28 10:42:03 +08:00
Matt Riedemann
18d5db8452 Add graphviz package to general list for building docs
A few projects are now gating on docs not having warnings/errors in them
during the docs build with sphinx, so developers are going to want to be
able to run 'tox -e docs' locally and fix issues.

The graphviz package is used by sphinx when building docs but you have
to get it from the distro, so this change adds the package to the
various distro lists.

Closes-Bug: #1359749

Change-Id: I7b7dee5e5d0dce6d5020b3e711f500118be163f8
2014-08-20 18:09:44 -07:00
ihrachyshka
cbea3447c7 Add ability to switch database driver
Also added mysqlconnector packages into default installation.

blueprint enable-mysql-connector

Change-Id: Ib2cda7cb183dc8f0ff4759cc6e9ecab469fd121c
2014-08-15 15:47:22 +02:00
Robert Li
72b3e448af Support Router Advertisement Daemon (radvd) for IPv6
Install radvd if the l3 service is enabled.

Partially implements blueprint: neutron-ipv6-radvd-ra

Change-Id: I749b31dcaad072a35e5921579b50f1ca451b1383
2014-08-01 16:10:01 -04:00
Jenkins
73e8deb09d Merge "Implement Ceph backend for Glance / Cinder / Nova" 2014-07-31 01:15:32 +00:00
Sébastien Han
36f2f024db Implement Ceph backend for Glance / Cinder / Nova
The new lib installs a full Ceph cluster. It can be managed
by the service init scripts. Ceph can also be installed in
standalone without any other components.
This implementation adds the auto-configuration for
the following services with Ceph:

* Glance
* Cinder
* Cinder backup
* Nova

To enable Ceph simply add: ENABLED_SERVICES+=,ceph to your localrc.
If you want to play with the Ceph replication, you can use the
CEPH_REPLICAS option and set a replica. This replica will be used for
every pools (Glance, Cinder, Cinder backup and Nova). The size of the
loopback disk used for Ceph can also be managed thanks to the
CEPH_LOOPBACK_DISK_SIZE option.

Going further pools, users and PGs are configurable as well. The
convention is <SERVICE_NAME_IN_CAPITAL>_CEPH_<OPTION> where services are
GLANCE, CINDER, NOVA, CINDER_BAK. Let's take the example of Cinder:

* CINDER_CEPH_POOL
* CINDER_CEPH_USER
* CINDER_CEPH_POOL_PG
* CINDER_CEPH_POOL_PGP

** Only works on Ubuntu Trusty, Fedora 19/20 or later **

Change-Id: Ifec850ba8e1e5263234ef428669150c76cfdb6ad
Implements: blueprint implement-ceph-backend
Signed-off-by: Sébastien Han <sebastien.han@enovance.com>
2014-07-23 16:13:45 +02:00