This patch introduces new parameter --json <file name>.
When it is specified the simulator stores stats in JSON file.
Change-Id: I0b7a87ee614f44baa920569fe0c7046269c90925
Calculate message latency: for RPC calls on both server-side and
on client-side (round-trip); for RPC cast and NOTIFY on server-side
only.
The message is extended with metadata: sequence id, creation time,
reception time and return time (for RPC calls). For every message
the metadata is stored into MessageStatCollector. To reduce memory
consumption the collector aggregates stats on every second and can
print the ongoing stats to stdout. At the finish the overall stats
are printed.
NOTIFY tests are changed to be similar to RPC:
* use pre-generated messages
* parameter "-w WAIT_BEFORE_ANSWER" for processing delay
* parameter "--requeue" to re-queue new messages (only those that
miss the cache)
Change-Id: I4c2fc11bfaee17b6825cdc7d6edf07b8e91ef83a
Dependency on scipy results in extra requirements to the system
(include the need of Fortran compiler). With this patch the
weighted random choice algorithm is implemented directly.
Change-Id: I60cbc6c452945000add5a65263d1ab4e42dd91f9
We need to use eventlet.sleep() in green thread loops
in order to have more chances to switch between them.
Change-Id: I7c08e82182b68b95c36265d58df0644c5ce2c171
"n-t1" as notification topic not really useful. Let's allow
it to be specified from the command line. Also make sure
we set the notification driver as "messaging" by default
Change-Id: I5daf09b9a01e4d642b0f53d7634d5b305d5a82cb
Added fanout option to target
Fixed timeout option
Removed setting config values as they are
reverted to defaults on driver load
Change-Id: Ia2d8a7bbcb04706deb3d701c1a0f93a0dd835a19
The function yaml.load() provides the ability to construct an arbitrary
Python object. For security, we use yaml.safe_load() instead which
limits this ability to simple Python objects(like integers or lists).
ref: https://en.wikipedia.org/wiki/YAML#Security
Change-Id: Iea2a2d79c764d635b02c5d6d36c9a5652010d716
* passing targets to rpc-client using -tg arg
so clients can send messages to different targets
* removed redis.flush_db() so we can start
several simulator processes for zmq.
Change-Id: I0d36c5d8cbec938c8fd85d1041d2a3bff02b49e5
There are files containing string format arguments inside
logging messages. Using logging function parameters should
be preferred.
Change-Id: Iaa15bc52d1d8832032cc46205effb49630cea494
Closes-Bug: #1321274
passing config with --config-file
passing list of topics to use with -tp arg;
passing server name with -s arg
Change-Id: I8dcce9e725117f8a046135b94d8d2047d24bbf76
Since xrange has been removed in Python 3, this patch let's replace xrange()
with six.moves.range() to provide py3 compatibility.
Change-Id: I85e0748786867334756a51dcb834f84ffd1e55a7
* Avoid string concatenation during logging, especially
when logging level is disabled.
* Initialize the Randomized strings we will be using
as payloads *before* we start sending the messages
as the string creation takes time and reduces
throughput
Change-Id: I546229fe7ade95572e11bcda95a587228d84bc28
Gnocchi performs better if measurements are write in batch
When Ceilometer is used with Gnocchi, this is not possible.
This change introduce a new notification listener that allows that.
On the driver side, a default batch implementation is provided.
It's just call the legacy poll method many times.
Driver can override it to provide a better implementation.
For example, kafka handles batch natively and take benefit of this.
Change-Id: I16184da24b8661aff7f4fba6196ecf33165f1a77
In change Ief6f95ea906bfd95b3218a930c9db5d8a764beb9, we
decoupled RPC and Notifications a bit. We should take another
step and separate out the options for notifications into
its own group.
Change-Id: Ib51e2839f9035d0cc0e3f459939d9f9003a8c810
Introduce mechanism of generating real life messages to the tool
using the information gathered during Rally testing. This change
allows to generate messages of the specfic length due to the
distribution observed on real environment.
messages_length.txt file contains lengths of string JSON objects
that were later sent through the MQ layer during deployment and
deletion of 50 VMs.
simulator.py was modified to use this data as a baseline to generate
random string messages of the required length with the needed
probability.
Change-Id: Iae21f90b5ca202bf0e83f1149baef8b42c64eb55
In this patch conf object passing through the fixtures to
objects is added
Also conf.prog and conf.project attributes are initialized
for tests
Change-Id: I4094043c3ea61cfd37cc998f140d506d4136e681
Partial-Implements: bp rabbit-pika
- added config options to set debug level
- added config options to show proceed messages per second on rpc-server
- added config options to select executor for rpc-server
- added config options to select call or cast mesages for rpc-client
Usage section updated
Change-Id: Ieadbc600f556ca5eb43b05abec69315b46023662
Notifier implementation for zmq driver (ROUTER/DEALER variant).
Publishers/consumers refactoring in order to make them pluggable.
Change-Id: I2dd42cc805aa72b929a4dfa17498cd8b9c0ed7af
The Oslo libraries have moved all of their code out of the 'oslo'
namespace package into per-library packages. The namespace package was
retained during kilo for backwards compatibility, but will be removed by
the liberty-2 milestone. This change removes the use of the namespace
package, replacing it with the new package names. It also adds a local
hacking check to prevent regressions, while disabling style checks in
the "tests" directory, which will be deleted in a subsequent patch.
The patches in the libraries will be put on hold until application
patches have landed, or L2, whichever comes first. At that point, new
versions of the libraries without namespace packages will be released as
a major version update.
Please merge this patch, or an equivalent, before L2 to avoid problems
with those library releases.
Blueprint: remove-namespace-packages
https://blueprints.launchpad.net/oslo-incubator/+spec/remove-namespace-packages
Change-Id: Iad2ae13c771c99861ca9493c6ab10edcfbd8684a
Add tools to play around oslo.messaging,
It allows to create rpc server and notification server
Or to spawn many client threads that send a defined number of messages.
Change-Id: I4d31f33ab4981309a67073e2a35cdef3b0ba7cb0
