Method import_zmq returns None if can't import zmq module.
For runtime code, an ImportError is raised, and for tests,
a skip message "zmq not available" is sent, so it's unnecessary
to log error which shows up in other projects' unit test logs.
Co-Authored-By: Oleksii Zamiatin <ozamiatin@mirantis.com>
Change-Id: Iebf15042f45da56eb633a0a70822c487dc72c884
Closes-Bug: #1528415
In this change PUB-SUB pipeline was added
and used for CAST-Fanout pattern.
Added 2 new options:
* use_pub_sub - configures the driver to use
PUB/SUB if True, fallbacks to DEALER/ROUTER implementation
otherwise.
PUB/SUB implementation is assumed to be always used with proxy.
* direct_over_proxy - specifies to use proxy with direct patterns
(CALL,CAST). This option is in replace of zmq_use_broker.
Latter is meaningless in context of PUB/SUB architecture,
so renamed.
Change-Id: I7c02d4d62632293941bc0d9d947e5362a5317db6
Closes-Bug: #1515185
When a client is gone (died/restart) and somes replies cannot be sent because
the the exchange of this client will never comeback. We log one message per
reply every 0.25 messages during 60 seconds. When the only useful log
is the one where we decide to drop this replies.
This change moves the less important message to debug level.
Change-Id: I508787c0db4dcec2c0027b89eb4e65c4f98022b9
Related-bug: #1524418
This patch removes `MANIFEST.in` file as pbr generates a sensible
manifest from git files and some standard files and it removes
the need for an explicit `MANIFEST.in` file.
Change-Id: I487247ec1b4f692c62e1794dbfede5b4e2924593
When AMQPDestinationNotFound is raised, we must not
call the error_callback method. The exception is logged
only if needed in upper layer (amqpdriver.py).
Related-bug: #1524418
Change-Id: Ic1ddec2d13172532dbaa572d04a4c22c97ac4fe7
When a heartbeat is missing we call ensure_connection()
that runs a dummy method to trigger the reconnection
code in kombu. But also the code is triggered only if the
channel is None.
In case of the heartbeat threads we didn't reset the channel
before reconnecting, so the dummy method doesn't do anything.
This change sets the channel to None to ensure the connection
is reestablished before the dummy method is run.
Also it replaces the dummy method by checking the kombu connection
object. So we are sure the connection is reestablished.
Change-Id: I39f8cd23c5a5498e6f4c1aa3236ed27f3b5d7c9a
Closes-bug: #1493890
This reverts commit 196980dace199c412dfaec34568c2a2d66b95a45.
There is a bug in debtcollector with using the remove decorator on
abstract classes, which RequestContextSerializer is.
https://bugs.launchpad.net/debtcollector/+bug/1520397
The addition of debtcollector to requirements.txt is left in place
because it is used elsewhere in the code by now.
Partial-Bug: #1524041
Change-Id: Ic3985707e941f7a7a1e039e702ce9219a3c741df
The transport/driver features check is done into the get listener
methods.
So when these methods are not used the driver features checks is not
done.
This change moves it into the dispatcher layer to ensure the
requirements are always checked.
This changes a bit the behavior of when the check occurs. Before
it was during the listener object initialisation. Now this
when the listener server start.
Change-Id: I4d81a4e8496f04d62e48317829d5dd8b942d501c
Gnocchi performs better if measurements are write in batch
When Ceilometer is used with Gnocchi, this is not possible.
This change introduce a new notification listener that allows that.
On the driver side, a default batch implementation is provided.
It's just call the legacy poll method many times.
Driver can override it to provide a better implementation.
For example, kafka handles batch natively and take benefit of this.
Change-Id: I16184da24b8661aff7f4fba6196ecf33165f1a77
This change creates a dispatcher abstraction
to document the interface of a dispatcher.
And also allows in the futur to have attributes with default values.
Change-Id: I9a7e5e03f89635a3790b3851f492a1a7aab58feb
In this change import_zmq() doesn't raise ImportError any more
for the benefit of skipping tests.
Alarm about zmq unavailability moved to driver's init.
Change-Id: I6e6acc39f42c979333510064d9e845228400d233
Closes-Bug: #1522920
This change removes codepath where _reply_q is not
present in the message dict.
This kind of messages have been deprecated in grizzly and cannot
be emitted since havana.
70891c271e
Change-Id: I20558d9fae8f56970c967aa0def77cfb2a1ca3ec
This change the default of kombu_missing_consumer_retry_timeout
The initial value of 60 seconds, have been chosen because the default
rpc_response_timeout is 60. That means, the client doesn't wait for
its reply after rpc_response_timeout is reach, so we don't need
to retry it send it its reply more than rpc_response_timeout.
But the real intent of kombu_missing_consumer_retry_timeout is
to mitigate the side effect when the rabbitmq server(s) died/failover/restart.
So the question is more how long we expect the server(s) to come back
and all the oslo.messaging applications to reconnect.
In that case 60 seconds looks a bit high.
Also this 60 seconds have a sad side effect when we can't send the reply
when the rpc client is really gone (like nova-compute restart).
The rabbitmq connection to send the reply is hold during 60 seconds.
I propose 5 seconds because,i n case of failover or restart I expect
everything because normal in less that 5 seconds.
Change-Id: I2ec174e440eb91e950d9453a9de8b97ed5888968
This change renames kombu_reconnect_timeout to missing_consumer_retry_timeout.
And improves its documentation.
Change-Id: I961cf96108db2f392b13d159f516baac9ff4e989
Problem with recursion shows up only in full runs
of Nova for example. So split the code that sets
up the decorator and add a method to cleanup
the decorated set_override during teardown.
Also add a decorator for clear_override similar to
the one for set_override.
Added more tests for all the above.
Change-Id: Ib16af2e770e96d971aef7f5c5d48ffd781477cfe
Neutron and Ceilometer use set_override to set
the older deprecated key. We should support them
using the ConfFixture
Closes-Bug: #1521776
Change-Id: I2bd77284f80bc4525f062f313b1ec74f2b54b395
