26 Commits

Author SHA1 Message Date
Andy Smith
5a842ae155 Switch driver to confluent-kafka client library
This patch switches the kafka python client from kafka-python to
confluent-kafka due to documented threading issues with the
kafka-python consumer and the recommendation to use multiplrocessing.
The confluent-kafka client leverages the high performance librdkafka
C client and is safe for multiple thread use.

This patch:
* switches to confluent-kafka library
* revises consumer and producer message operations
* utilizes event.tpool method for confluent-kafka blocking calls
* updates unit tests
* adds kafka specific timeouts for functional tests
* adds release note

Depends-On: Ice374dca539b8ed1b1965b75379bad5140121483
Change-Id: Idfb9fe3700d882c8285c6dc56b0620951178eba2
2018-12-04 11:25:07 -05:00
Andreas Jaeger
3d7ad9cab4 Use templates for cover and lower-constraints
Use openstack-tox-cover template, this runs the cover job as
non-voting in the check queue only.

Use openstack-lower-constraints-jobs template

Remove jobs that are part of the templates.

Sort list of templates, move templates first in project stanza as is
common practice.

Change-Id: Idb976b160479efcf9f3726c1716bf9d2c39ab6cc
2018-09-07 12:18:29 +02:00
Doug Hellmann
a4a8eef010 add lib-forward-testing-python3 test job
This is a mechanically generated patch to add a functional test job
running under Python 3 as part of the python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: Ib99a323861c0fdb548287446ab25e0516a7c182e
Story: #2002586
Task: #24322
2018-08-11 18:20:14 -04:00
Doug Hellmann
deec8c1f13 add python 3.6 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.6 as part of the python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I1da69d0b77a3970c727b60de4c341552970fbb47
Story: #2002586
Task: #24322
2018-08-07 16:17:34 -04:00
Doug Hellmann
818fd688a2 import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I0401a53945ad87e1dc046904054b12e2b106a3e8
Story: #2003250
2018-08-03 17:45:00 -04:00
Kenneth Giusti
037abd3210 Convert legacy zuul jobs to v3
This patch converts the devstack tempest-based jobs to Zuulv3.

Change-Id: Ic20b7632ee314b51e12f37480476a6bdd72006bf
Partial-Bug: #1768049
2018-05-11 09:38:50 -04:00
Dan Smith
d38ad3e465 Make oslo.messaging-devstack-amqp1 job non-voting
Change-Id: I9011017e818da0d01f6c58b9dc402e81584c83ba
2018-05-09 10:08:37 -07:00
James E. Blair
2b55d6c160 Add a skeleton for a v3-native devstack job
Change-Id: Ib0b12cdc8b59c77b06d527268194d4599b24e71a
Depends-On: https://review.openstack.org/549252
2018-04-25 06:57:33 -07:00
Andrew Smith
5f4755b92b Add kafka for python 3 functional test
Change-Id: I743cd09e3450fac215ff65db37c3fe53e2e43601
2018-04-17 14:05:20 -04:00
Andrew Smith
865ab522cb Update kafka and dsvm jobs
Depends-On: I3232378790cff0a956db204e99e34337bbe019ff
Change-Id: I913dde81a83937b355019abc428d21d44882a98f
2018-03-30 08:45:24 -04:00
Zuul
6cac4c3fad Merge "add lower-constraints job" 2018-03-29 06:45:42 +00:00
Zuul
415e9b991b Merge "remove zmq tests" 2018-03-27 19:35:04 +00:00
Zuul
ba9630707c Merge "Restore devstack project name in amqp1 test" 2018-03-27 17:58:34 +00:00
Doug Hellmann
7326192b96 add lower-constraints job
Create a tox environment for running the unit tests against the lower
bounds of the dependencies.

Create a lower-constraints.txt to be used to enforce the lower bounds
in those tests.

Add openstack-tox-lower-constraints job to the zuul configuration.

See http://lists.openstack.org/pipermail/openstack-dev/2018-March/128352.html
for more details.

Change-Id: I8991c2ab1c880c401fd807e38565258403af05e8
Depends-On: https://review.openstack.org/555034
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-03-26 11:36:11 -04:00
Doug Hellmann
fca263c43c remove zmq tests
At the Rocky PTG the Oslo team decided to once again deprecate and
remove the ZMQ driver. This is the first part of doing that, which
removes the unit tests and extra functional test jobs, which are
failing.

Change-Id: Ia02adf122d2d4ff281e7c9fd3dff8894da241925
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-03-26 11:36:10 -04:00
Kenneth Giusti
222a939361 Remove the deprecated Pika driver
It is recommended that all users of the Pika driver transition to
using the Rabbit driver instead.  Typically this is done by changing
the prefix of the transport_url configuration option from "pika://..."
to "rabbit://...".  There are no changes required to the RabbitMQ
server configuration.

Change-Id: I52ea5ccb7e7c247abd95e2d8d50dac4c4ad11246
Closes-Bug: #1744741
2018-03-21 10:58:23 -04:00
Kenneth Giusti
c48c98ef3c Restore devstack project name in amqp1 test
This patch also adds heat to required projects

Change-Id: Ic150f9ce01787a1892b67e00cccc4ba43eaf0373
2018-02-14 09:53:21 -05:00
Zuul
2c2b67880d Merge "Zuul: Remove project name" 2018-02-09 16:59:12 +00:00
James E. Blair
5f184a0767 Zuul: Remove project name
Zuul no longer requires the project-name for in-repo configuration.
Omitting it makes forking or renaming projects easier.

Change-Id: I9cb1cce40e473d854a9fe6a640c8fc5036288cbd
2018-02-08 23:29:31 -08:00
Chandan Kumar
ff913ae76b Fixed telemetry integration zuul jobs
* telemetry integration tests run in tempest-venv so plugin
  needs to be installed in the same venv. devstack plugin installs
  the plugin all-plugin venv so tests are not discovered by tempest.
  In order to fix the same we need to use TEMPEST_PLUGINS vars for
  the same.
* telemetry integration tests are dependent on heat-tempest-plugin
  so we need to add that to the required projects.

Change-Id: Icab1e53d20bb7c95c232a4512e83905dcca7c599
2018-02-06 12:44:44 +05:30
Andrew Smith
d11159c430 Update telemetry integration playbooks
Change-Id: I5b4f01c928373cac530aa6877a34c684577bc64e
2018-01-18 12:54:34 -05:00
Andrew Smith
0ca9567c4a Provide bindep_profile in openstack-tox job setup
Oslo.messaging uses a single bindep.txt to define common
and driver dependencies. The bindep_profile is used by the
bindep role to select the driver specific packages.

This patch:
* Add bindep_profile var to jobs
* Add kafka dependencies
* update test-setup for use by amqp1

Depends-On: I6beb7b07a7dbc345e63e758ebbc86400e0ee16d3
Change-Id: Ib552152e841a9fc0bffdcb7c3f7bc75613d0ed62
2017-11-29 11:10:35 -05:00
Zuul
51d4b753ae Merge "Remove stable/newton from zuul settings" 2017-11-06 04:59:17 +00:00
Jeremy Liu
a89317ab75 Remove stable/newton from zuul settings
stable/newton branch is EOL now, remove relevant settings from zuul.

Change-Id: I5359f9f1096f5e4cce9d359db813a3749a0b9c64
2017-10-31 11:24:46 +08:00
James E. Blair
d4348ad7c0 Zuul: add file extension to playbook path
Zuul now supports including the file extension on the playbook path
and omitting the extension is now deprecrated.  Update references
to include the extension.

Change-Id: I025170ddb33b404747b18fcbac9ef4af6a1181f0
2017-10-29 15:44:44 -07:00
Kenneth Giusti
e1a3da9443 Move legacy zuulv3 tests into oslo.messaging repo
Next step will be to re-write these for zuulv3

Change-Id: I2f6a8432e037f75d6abee3bc977933a310a4a2c7
2017-10-17 16:01:29 -04:00