2364 Commits

Author SHA1 Message Date
Andrew Smith
1ccdccddaa Add kafka driver vhost emulation
Emulate vhost support by adding the virtual host name to the
topic created on the kafka server. Also, update connection
management for producer/consumer.

This patch:
* updates target to topic generation
* add consumer and producer connection classes
* remove connection pool
* update driver test

Change-Id: Idd164444c04e9f465a43ee909af840a41bb090c0
2017-12-27 12:57:39 -05:00
Zuul
e43240168f Merge "Updated from global requirements" 2017-12-20 06:17:24 +00:00
Zuul
7e46a5fa9d Merge "Update kafka functional test" 2017-12-19 06:16:50 +00:00
OpenStack Proposal Bot
0b42cfda14 Updated from global requirements
Change-Id: I5bc6a1ba5214d5f73fc61fd8b656d3c00b0ca193
2017-12-19 01:38:48 +00:00
Kenneth Giusti
c7cc6d0742 Create doc/requirements.txt
For compliance with the Project Testing Interface as described in:

https://governance.openstack.org/tc/reference/project-testing-interface.html

Refer to:

http://lists.openstack.org/pipermail/openstack-dev/2017-November/124815.html

Change-Id: I3d8c70f66931c15247b530ff7e1c89bfc753446f
2017-12-18 15:09:20 -05:00
Andrew Smith
3afc3a0a1d Update kafka functional test
This patch addresses a number of issues that prevented the functional
tests from running. The functional tests now execute and can complete
succesfully. At times, the test will fail (noticiably in CI) indicating
an underlying issue with consumer interaction with the kafka server.

It would be beneficial to merge this patch as it provides repeatability
and visibility for driver-kafka server integration to facilitate
additional debugging and testing.

This patch:

* removes use of deprecated get_transport
* override consumer_group for each test
* changed to synchronous send
* update to kafka 1.0.0 server

Depends-On: Ib552152e841a9fc0bffdcb7c3f7bc75613d0ed62
Change-Id: I7009a3b96ee250c177c10f5121eb73d908747a52
2017-12-16 14:41:03 -05:00
Zuul
8480144f63 Merge "Imported Translations from Zanata" 2017-12-15 13:20:48 +00:00
OpenStack Proposal Bot
6d008f24bc Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: Iaf8bc96558135054f59aa5c30bed52af57e7cc6e
2017-12-13 06:53:34 +00:00
OpenStack Proposal Bot
feb5903f0c Updated from global requirements
Change-Id: Id9da62486347345db39a2b053499f75b319f3aff
2017-12-13 05:01:29 +00:00
Zuul
c2562d1f99 Merge "Remove pbr version from setup.py" 2017-12-13 03:46:46 +00:00
Zuul
63775d9e97 Merge "Provide bindep_profile in openstack-tox job setup" 2017-12-11 09:39:31 +00:00
Zuul
ac5e20ff2d Merge "Updated from global requirements" 2017-12-11 08:54:52 +00:00
OpenStack Proposal Bot
b6b86bc7b9 Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I82de13c53c446be73c39813c2f1b1ee7245ae4a6
2017-12-03 06:03:07 +00:00
Andreas Jaeger
d68b53f056 Avoid tox_install.sh for constraints support
We do not need tox_install.sh, pip can handle constraints itself
and install the project correctly. Thus update tox.ini and remove
the now obsolete tools/tox_install.sh file.

This follows https://review.openstack.org/#/c/508061 to remove
tools/tox_install.sh.

Change-Id: Ifaaf656effff20ef08214f111645a3b5fc8b4d28
2017-12-02 17:01:55 +00:00
Zuul
8ac97450c8 Merge "rabbitmq: don't wait for message ack/requeue" 2017-11-30 08:01:37 +00:00
Mehdi Abaakouk
c38857e110 rabbitmq: don't wait for message ack/requeue
I don't see any obvious reason why we should wait ack/requeue is done.

This waiter have already be removed from amqp1.

https://git.openstack.org/cgit/openstack/oslo.messaging/tree/oslo_messaging/_drivers/amqp1_driver/controller.py#n242

So, this change remove it from rabbitmq driver too.

Closes-bug: #1734788

Change-Id: I5ecedc762596181be19410b863851a0054fd6579
2017-11-29 21:13:50 +01:00
Zuul
c7eb5cac66 Merge "sort when using groupby" 2017-11-29 19:43:46 +00:00
Andrew Smith
0ca9567c4a Provide bindep_profile in openstack-tox job setup
Oslo.messaging uses a single bindep.txt to define common
and driver dependencies. The bindep_profile is used by the
bindep role to select the driver specific packages.

This patch:
* Add bindep_profile var to jobs
* Add kafka dependencies
* update test-setup for use by amqp1

Depends-On: I6beb7b07a7dbc345e63e758ebbc86400e0ee16d3
Change-Id: Ib552152e841a9fc0bffdcb7c3f7bc75613d0ed62
2017-11-29 11:10:35 -05:00
OpenStack Proposal Bot
5d99ea8f05 Updated from global requirements
Change-Id: I370881ada05c29399f1351444544eaf28150c4d1
2017-11-29 09:15:12 +00:00
Kenneth Giusti
d0a3f70966 Add zmq packages that are no longer in bindep-fallback
Change-Id: Id47e3097dd7ea3ad9dc9e9f73bce829d6a705b6e
Needed-By: Iab9495bd381b135e8a0f2e8f35e51a9218cf8f40
2017-11-28 14:57:48 -05:00
gord chung
7c65038e79 don't convert generator to list unless required
there's only one scenario where the generator actually needs to be
forced into a list. don't waste time doing something unnecessary.

Change-Id: Iec897b1f6fed3d88b798eb673779e7c68ff930ec
2017-11-27 13:41:31 -05:00
gord chung
b8a686fc52 sort when using groupby
groupby requires items to be sorted as it's clumping consecutive
items together. also, just use itemgetter instead of lambda

Change-Id: I1676fc60ebc2c9ff03ea00cc67061fdfb3b50868
2017-11-26 10:46:58 -05:00
Zuul
02056bfb12 Merge "Updated from global requirements" 2017-11-20 12:02:23 +00:00
Zuul
c198b345a3 Merge "Catch socket.timeout when doing heartbeat_check" 2017-11-17 10:33:23 +00:00
Andreas Jaeger
c0814b2536 Remove setting of version/release from releasenotes
Release notes are version independent, so remove version/release
values. We've found that projects now require the service package
to be installed in order to build release notes, and this is entirely
due to the current convention of pulling in the version information.

Release notes should not need installation in order to build, so this
unnecessary version setting needs to be removed.

This is needed for new release notes publishing, see
I56909152975f731a9d2c21b2825b972195e48ee8 and the discussion starting
at
http://lists.openstack.org/pipermail/openstack-dev/2017-November/124480.html
.

Change-Id: Icb7de5c9020c3543c218744c0dc75e758f0abb43
2017-11-16 21:45:49 +01:00
OpenStack Proposal Bot
709ee7989d Updated from global requirements
Change-Id: Id5276f0b18005af895cad852bedfdc7d8eb9b8e8
2017-11-16 11:21:28 +00:00
OpenStack Proposal Bot
8c129459a7 Updated from global requirements
Change-Id: Iea65ddb73a626c048411d85af2669a2e01819f66
2017-11-15 11:58:20 +00:00
Vincent Untz
8bfc3637a2 Catch socket.timeout when doing heartbeat_check
heartbeat_check in kombu.connection is not reraising exceptions as
exceptions.OperationalError, and the socket timeout during the heartbeat
check is really an issue seen in the field when a node goes down; the
heartbeat thread just tries again and again to deal with it, without
success.

Change-Id: I26dbdb18a7e64946db2cba676764ff2d428c7897
Closes-Bug: #1657444
2017-11-14 18:00:42 +01:00
Zuul
bf7ca2aa53 Merge "Updated from global requirements" 2017-11-13 17:43:43 +00:00
OpenStack Proposal Bot
d1e5cf2a77 Updated from global requirements
Change-Id: If146ea28a75593f6ef07a9088b87431881721c12
2017-11-13 10:26:39 +00:00
gord chung
7fe91cc01a fix batch handling
for some reason there are two timeouts. in the batch scenario,
all the time wasted waiting on initial 'get' is never accounted
for so the batch timeout is always longer than it is declared.

Change-Id: I6132c770cccdf0ffad9f178f7463288cf954d672
2017-11-12 13:43:48 -05:00
Zuul
51d4b753ae Merge "Remove stable/newton from zuul settings" 2017-11-06 04:59:17 +00:00
Jeremy Liu
a89317ab75 Remove stable/newton from zuul settings
stable/newton branch is EOL now, remove relevant settings from zuul.

Change-Id: I5359f9f1096f5e4cce9d359db813a3749a0b9c64
2017-10-31 11:24:46 +08:00
James E. Blair
d4348ad7c0 Zuul: add file extension to playbook path
Zuul now supports including the file extension on the playbook path
and omitting the extension is now deprecrated.  Update references
to include the extension.

Change-Id: I025170ddb33b404747b18fcbac9ef4af6a1181f0
2017-10-29 15:44:44 -07:00
Zuul
c2bb75f1e7 Merge "Move legacy zuulv3 tests into oslo.messaging repo" 2017-10-20 06:20:42 +00:00
Kenneth Giusti
e1a3da9443 Move legacy zuulv3 tests into oslo.messaging repo
Next step will be to re-write these for zuulv3

Change-Id: I2f6a8432e037f75d6abee3bc977933a310a4a2c7
2017-10-17 16:01:29 -04:00
Jenkins
c5b36127ef Merge "Fix typo in contributor docs title" 2017-10-11 15:15:56 +00:00
OpenStack Proposal Bot
24e1d8a652 Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: Ib28aea3b87c63d0d3e470d43f72d236d5edbc37b
2017-10-09 08:02:00 +00:00
Ben Nemec
d925e112b5 Flesh out transport_url help
This is a complicated config opt and the single line help text
doesn't provide anywhere near enough detail for a user to properly
configure it.  This change adds the expected format from the
TransportURL docstring and leaves a link to the docs for that
class since the full details are probably too verbose to put in the
help text in their entirety.

Change-Id: I66122bf9c619d35bcb3caadfde9c0dcdb5cd9095
2017-10-06 20:04:34 +00:00
Ben Nemec
47d66d2b46 Fix typo in contributor docs title
"Contributing oslo.messaging" is not grammatically correct.  It
should be "Contributing to oslo.messaging".

Change-Id: I71737086745beb6d8d76669ab04b7580f1b7b11a
2017-10-02 23:52:24 +00:00
Jenkins
a9d10d33cd Merge "Fix default value of RPC dispatcher access_policy" 2017-09-26 14:19:54 +00:00
zhangxuanyuan
3a9c01ffe9 Fix default value of RPC dispatcher access_policy
Change-Id: I4d30ff269b2e34f4409e8d1ce822eb93918cf5a2
Closes-Bug: #1712393
2017-09-24 20:25:38 -07:00
Rajath Agasthya
6efa86a8d5 Fix wrong transport warnings in functional tests
Change-Id: Ie6726ecd566d965a94343bde7a518e986b434346
Closes-Bug: #1718691
2017-09-22 17:13:26 -07:00
OpenStack Proposal Bot
c2338ee325 Updated from global requirements
Change-Id: I1315cfd256afa17aaa3be3ae4a3a3f6ee5cbb564
2017-09-20 16:23:04 +00:00
Jenkins
393ecff345 Merge "Warn when wrong transport instance is used" 2017-09-15 18:33:29 +00:00
OpenStack Proposal Bot
4226badc83 Updated from global requirements
Change-Id: I674e086307ef8785244a14fd4e83ffaedc927eb9
2017-09-11 21:47:08 +00:00
Rajath Agasthya
03b6f18f80 Warn when wrong transport instance is used
Since RPC and notifications can have different backends, it is
useful to warn users if they use a notification transport in RPC
and vice versa. This patch introduces RPCTransport and
NotificationTransport subclasses of Transport, so it's easier to
add different behavior for them if need be.

Related-Bug: #1680192
Change-Id: Iab60544d69053c8e74c28a2d5c84665be749013f
2017-09-11 07:07:30 -07:00
Jenkins
6bbb3bc09d Merge "Class-level _exchanges in FakeExchangeManager" 2017-09-08 07:10:45 +00:00
Jenkins
809d4a54f1 Merge "Fix some reST field lists in docstrings" 2017-09-08 05:07:28 +00:00
Jenkins
338b85eb4e Merge "Suppress excessive debug logs when consume rabbit" 2017-09-07 23:24:51 +00:00