148 Commits

Author SHA1 Message Date
Jenkins
eeb5a1d827 Merge "Stop special casing jeepyb and pypi-mirror in test" 2015-10-23 18:29:02 +00:00
Doug Hellmann
cd88f6c3f6 do not commit requirements syncs
We need to test without committing the requirements changes because pbr
throws an error if the pre and post versioning do not match. The first
change on a stable branch must be the one to remove the pre-versioning
configuration.

Change-Id: I812af614b7a6c7f499c67310f078ac4835b9e91a
2015-10-16 14:27:08 +00:00
Clark Boylan
7fe60b6f33 Stop special casing jeepyb and pypi-mirror in test
We have removed these projects from the PROJECTS list so no longer need
to special case them here.

Change-Id: Ic3116a646389438ded03f285819529477bf849d8
Depends-On: I61c2f3f8a724dc789479278e7ba493e095c52305
2015-10-15 10:44:43 -07:00
Jenkins
96c547c1ed Merge "Move integration test dependencies into bindep" 2015-07-29 04:07:22 +00:00
Robert Collins
4c028dba0a Move integration test dependencies into bindep
bindep makes this a lot easier to work with as well as making it
possible to support Fedora, Suse etc as needed.

Change-Id: I4d19df8bbcd08e06edcf71ee51c30bb9c3d57fd0
2015-07-19 08:37:11 +12:00
Jenkins
b2788ceb19 Merge "Revert "Move integration test dependencies into bindep"" 2015-07-18 16:03:11 +00:00
Matt Riedemann
f236298949 Revert "Move integration test dependencies into bindep"
This reverts commit ce6ef0fe230ff939ae4d583a2262a16d598c32b9

We're only installing bindep on diskimage-builder built images, and
the devstack-trusty images in rax regions are snapshot-based. We'll
need to temporarily revert this until devstack-trusty is switched to
DIB everywhere, or DevStack-based jobs move to the ubuntu-trusty DIB
images we have available in rax currently.

Change-Id: I69c923297c3202fd35b8892ddfa4d8dbf272bf16
Closes-Bug: #1475880
2015-07-18 15:04:34 +00:00
Jenkins
ac231a5f6d Merge "Move integration test dependencies into bindep" 2015-07-18 01:51:06 +00:00
Robert Collins
ce6ef0fe23 Move integration test dependencies into bindep
bindep makes this a lot easier to work with as well as making it
possible to support Fedora, Suse etc as needed.

Change-Id: I29ffd7376c6f77ca104bf7d930fef178e5cab20f
2015-07-16 07:28:59 +12:00
Sean Dague
c7136bc2cd fix what-broke to strip environment markers
The addition of environment markers broke what-broke, remove them
before processing it.

Change-Id: I4bad24431a6e037e149401f5e4e33130f6ecb07f
2015-07-10 09:35:36 -04:00
Robert Collins
5e4ca1b8b8 Test that changes to requirements are freezable.
If we can't generate a new constraints file, don't let changes in.

Change-Id: If5aa15bb9ca75db0b8ef89a13c9b4bbf8d45cae2
2015-06-25 11:20:56 +12:00
Jenkins
37dc266677 Merge "Fix the empty string issue for pip" 2015-06-22 19:48:51 +00:00
Robert Collins
4b22b94752 Also update extras in setup.cfg.
This required some care. There doesn't seem to be a sane Python3 ready
comment-preserving ini parser around, so I wrote a
minimal-for-our-case one in Parsley. Parsley is already in use in
infra in bindep, but I need to add it to global-requirements as this
is the first use in a managed project of it.

Change-Id: I48de3a2f36e945f75b534f689e3af802bbdc5be9
Depends-On: I7d7e91694c9145fac0ddab8a9de5f789d723c641
Depends-On: I16e967356d5c56f1474ee661b954b3db11a608cb
2015-06-20 19:19:21 +12:00
Flavio Percoco
7428cd9e30 Use pyngus>=1.3.1
Pyngus 1.3.1 has been released and it fixes the issues that blocked the
gate last time. This version of the library is required for the amqp
driver in oslo.messaging.

Change-Id: I4ba583e062674b27ad873ca2228274f383f2bb22
2015-06-16 13:32:24 +02:00
Kai Qiang Wu(Kennan)
7578f91069 Fix the empty string issue for pip
When read from requirement file, the grep not deal with
blank line, which cause pip wheel have '' issue.

Check logs in below for details:
http://logs.openstack.org/21/181821/1/check/check-requirements-integration-dsvm/3ce99ff/console.html#_2015-05-13_05_27_33_105

Change-Id: I558a9488f576738a44dd746589c04bd28d7cd332
2015-05-13 20:51:01 +08:00
Robert Collins
020073faee Allow testing with specific pips
We want to use the new resolver branch of pip today, and perhaps
develop in future too. This introduces the same basic change we did to
pbr's tests to test with a custom pip.

Change-Id: Ia2b1a9c7ee7a7bf32f404932fe7fe872ac402b0e
Depends-On: I7600fa20391bb83491d630b277bf01cc3a20727c
2015-05-11 12:42:26 +12:00
Jenkins
5cd5005af6 Merge "add pycparser tracking to what-broke" 2015-05-06 03:15:46 +00:00
Jenkins
ab00508aed Merge "also install a new pbr into the venvs" 2015-05-04 18:42:04 +00:00
Sean Dague
8fae8b1e29 add pycparser tracking to what-broke
It broke us today, it will probably do so in the future. Let's track
it.

Depends-On: If48a8444b02ee1e105bc1d9ce78a0489ea0c405b

Change-Id: I203738fad804d3cd41808109a1671e4baabf48d0
2015-04-22 11:02:03 +00:00
Sean Dague
0c2eef0a4f add what-broke.py analayzer
This runs through all of global-requirements.txt and looks at the
release history of all components over the last N days, returning the
released list. This is helpful in unexplained gate breaks to at least
look for candidate libraries.

Fleshed out some docs to explain intent for future consumers /
modifiers of this script.

Change-Id: I5880a1d7f0a6063a45f7533319fed1ff56057144
2015-04-07 08:41:15 -04:00
Jenkins
03f906318f Merge "Add a script to find cruft global requirements" 2015-03-20 14:28:19 +00:00
Jenkins
558d1dd4af Merge "Import cap.py tool to cap explicit dependencies" 2015-03-20 13:41:52 +00:00
Jenkins
ce750be64f Merge "Do not sync requirements to possibly capped library's master branch" 2015-02-24 15:12:14 +00:00
Adam Gandelman
8c2ad8c2a8 Do not sync requirements to possibly capped library's master branch
We've hit a situation where a project (pycadf) is listed and capped
in stable/icehouse requirements.txt.  pycadf is also listed in
projects.txt. As part of the requirements integration test, we are
attempting to update pycadf's master branch with stable/icehouse
requirements, and failing because of new dependencies in pycadf that
are not managed by stable/icehouse's GR.

This updates integration.sh so that when we're testing a stable branch,
we are only syncing requirements to other projects have stable branches.
This avoids trying to sync stable requirements into library's master
branches.

Change-Id: I3b8845ad8e013cf6747995df5a62cc4f2ee85e01
2015-02-24 11:57:57 +01:00
Jenkins
c01252639a Merge "Don't use git diff --quiet to detect local change" 2015-02-23 13:27:18 +00:00
Ihar Hrachyshka
e1b3c1f099 Don't use git diff --quiet to detect local change
It seems that there is a bug in (old?) versions of git, particularily in
the one that is shipped with Ubuntu Precise (1.7.9.5) that (sometimes?)
makes the exit code of git diff incorrect.

Change-Id: Id2286147529f1072fe4ceff3fc5200aeb30267a1
Related-Bug: #1264422
Related-Bug: #1410434
2015-02-23 12:01:38 +01:00
Joe Gordon
ed868f3ab9 Import cap.py tool to cap explicit dependencies
This is a forward port of the tool we used to cap stable/juno
requirements. Save a copy of it in master so its available when we are
ready to cut future stable branches.

pin all global-requirements with the version found in pip-freeze
along with a tool to generate the new requirements file

Issues:
* Some versions are only apt-get installable (suds 0.4.1)
* Not all packages are installed in our standard dsvm-tempest env
* Some versions are lower then the minimum requirement we previously had
  because python is awful (libvirt-python)
* Doesn't pin transitive dependencies
* library versions can vanish from pypi and still break us
* Grenade and tempest-full pip-freezes are different and do not work with
each other, so some tweaking is required.

Taking the installed library version from pip-freeze and use that as a
version cap.

Previously used pip-freeze from a tempest-dsvm-neutron-full job.

Change-Id: Iaf48bb069fdd7a19d614ce44b86abd9977c5f0c0
2015-02-20 15:32:48 -08:00
Sean Dague
79387c1135 also install a new pbr into the venvs
Ensure we have an up to date pbr for running the tests.

Change-Id: If5229146ce66e79c05e688d2a340008c14f3f6ec
2015-02-13 10:07:43 -05:00
Ihar Hrachyshka
cc9e20ad30 Cleanup code related to pbr wheel installation from git
Since I8e453110655c0e74ff81b4cdc796c4935c75a553, we don't generate pbr
wheels from git, so there is no need for this either.

Change-Id: I0c70735556d1da68924518b9deb13f4ed082a79d
2015-02-11 10:04:22 +01:00
Sean Dague
0275f5f59b don't install pbr from upstream source
For requirements tests we should be using released pbr, not upstream
git.

Change-Id: I8e453110655c0e74ff81b4cdc796c4935c75a553
2015-02-10 17:19:12 -05:00
Jenkins
e3ac09e877 Merge "Add developer script to build wheels" 2015-01-29 21:50:51 +00:00
Jeremy Stanley
9f3770c349 Add a script to find cruft global requirements
Change-Id: Iee610bff2fedff9d54a1c505451507f3e6559af8
2015-01-17 20:27:19 +00:00
Sean Dague
b380f04a25 attempt to install all of global requirements
This adds a test to try to install all of the global-requirements.txt
into a venv to see if it works. If we can get this functioning, it
will help determine ordering issues and compatibility between all
components at an early stage.

Change-Id: Id147a7b31f96650159f5178ac6dbeec2736d73f6
2015-01-16 14:47:17 -05:00
Sean Dague
f1c40d16ef only do package installation once
requirements only needs to test that requirements works once, this
will dramatically speed up the time to run the requirements job.

Change-Id: I26f50f95099e57c72e1e30cdf92cd14be293f720
2015-01-16 08:22:59 -05:00
Sean Dague
82cf7d581c update tools/integration.sh to latest version from pbr
this syncs the latest changes so we can hopefully get this out of pbr
for good and into the requirements repo.

Change-Id: I37b1510f3639c332a13bd7fc892b66f71b99b594
2015-01-13 16:20:36 -05:00
Doug Hellmann
973b37885b Add developer script to build wheels
Add a script developers can use to build wheels of the global
requirements to speed up package installation time on their local
systems.

Change-Id: I978def344719380989b2454da04c1ae139df18bf
2014-12-17 16:38:05 -05:00
Sean Dague
8e073738db add integration test script from pbr
the integration test script shouldn't be in pbr, it should be in
requirements repo. Start the move process by copying this over
now.

Change-Id: I5795c6fe6af49eab3b028472dce800b73012d491
2014-09-02 13:07:24 -04:00
Alex Gaynor
d3c8bb436a Removed a reference to quantum and removed a dead file
Change-Id: Id1159b1d9f32d6af696159e64321312cdc374276
2013-09-26 08:24:07 -07:00
Monty Taylor
ec9cf61690 Rename pip-requires to requirements.txt.
Change-Id: I4cfdd0ef6cddfa3d75b4d650362f9645486755c8
2013-06-30 10:07:41 -04:00
Jenkins
ae33a3c088 Merge "Change requirement for hacking to >=0.5.6" 2013-06-29 16:50:40 +00:00
Jenkins
6f8d9852d8 Merge "Bump requests to 1.2.3" 2013-06-28 13:08:34 +00:00
Jenkins
a23f7ee7a3 Merge "Update pycrypto to 2.6 or later." 2013-06-28 12:54:19 +00:00
Jenkins
a0ed829d3f Merge "Require eventlet >= 0.12.0" 2013-06-28 12:54:19 +00:00
Ann Kamyshnikova
f10ee5518b Change requirement for hacking to >=0.5.6
This is needed for "# noqa" support in import strings.

Change-Id: I2bdfcea7567d2876f144271c60950ee19c9a283e
2013-06-27 10:54:49 +04:00
Chuck Short
1b10f40551 Bump requests to 1.2.3
Ubuntu 13.10 ships requests 1.2.3, so make sure
we are installing a newer version.

Change-Id: I1c703334464ca8fb886a0bd4ee6580afbaf9dd75
Signed-off-by: Chuck Short <chuck.short@canonical.com>
2013-06-26 12:03:48 -05:00
Jenkins
7c6f3cec43 Merge "Avoid jsonschema 1.4.0 - Release was pulled." 2013-06-26 12:04:31 +00:00
Eoghan Glynn
e58eb6deb7 Adding python-ceilometerclient to requires.
In order to allow ceilometer take a dependency on its own
client library.

Change-Id: I75f9ef40db0bc2e0295616809b58303f16e4a52c
2013-06-25 22:37:51 +01:00
Kiall Mac Innes
eb08796298 Avoid jsonschema 1.4.0 - Release was pulled.
JSONSchema 1.4.0 appears to have been an accidental release of 2.0
code under the 1.4.0 version. It's been pulled from PyPi, but still
exists on the OpenStack mirror.

Discussion with the infra folks suggests updating the requirements
file rather than removing the release from the mirror is the best
solution.

Change-Id: I7619cc41c7924f2f02c8cf8d17034e58ac3b116c
2013-06-25 00:47:51 +01:00
Jason Dunsmore
48825a313e Update pycrypto to 2.6 or later.
The exportKey methods weren't available in pycrypto 2.1.

Change-Id: Ia8b1e4a8257689d8f389cb15c5a7da68b5a1fe30
2013-06-24 09:26:29 -05:00
Dirk Mueller
71d06008ab Require eventlet >= 0.12.0
Update to eventlet 0.12.0 requirement from Oslo-Incubator,
commit log is:

    This version has important fixes required
    for ZeroMQ (spurious wakeups).

    Fixes bug 1065532.

    This is based on this commit from Nova:

    0.9.17 was released 2012-08-03 and
    includes two particular fixes related to OpenStack

    1. https://bitbucket.org/which_linden/eventlet/issue/123/
    Fix an exception thrown by epoll in certain cases.
    This can cause jenkins to deadlock, triggered for example by:
    https://review.openstack.org/#/c/10767/

    2. https://bitbucket.org/which_linden/eventlet/issue/115/
       https://bugs.launchpad.net/nova/+bug/903199
    Fix a significant memory leak of _DummyThread objects.

Change-Id: I4a614ff1fcd8deedfe37116d66d183e8aad4a7c3
2013-06-24 15:31:25 +02:00