8 Commits

Author SHA1 Message Date
Jenkins
bc0146e350 Merge "Lower concurrency on rally port job" 2016-10-05 02:28:44 +00:00
Kevin Benton
a15d259b11 Lower concurrency on rally port job
Previous runs are showing that creating ports under this high load
ends up taking >5 secs per port on average. Lets set to 4, which is
still double the api_worker count in some cases for the current gate.

Change-Id: I05a0d28f5b035684e07288825f5b704a843dc9d7
2016-09-20 02:08:21 -07:00
Kevin Benton
933af3fdac Add to rally quotas to handle worst case quota race
Quoting the quota devref:
"""
For a reservation to be successful, the total amount of resources requested,
plus the total amount of resources reserved, plus the total amount of resources
already stored in the database should not exceed the project's quota limit.
"""

This means that in the absolute worst case scenario with 20 concurrent
workers, 19 could have made reservations, committed resources, but not
yet cleared their reservation. Because of the outstanding reservation
and the resources created by the 19 workers, they will all be
double-counted until their reservation is cleared (or it expires).

This adjusts the rally scenarios to handle the double-count for
concurrency.

Related-Bug: #1623390
Change-Id: I4808a92e7e6067aeeb62fc3b3d7f7ac71b179c44
2016-09-19 22:11:15 -07:00
Kevin Benton
a5d7b1ab51 Increase rally network/port count and add quotas
This increases the rally port and network count to 100
and enables quotas to exercise the quota engine to
better simulate a real system.

Additionally, it reduces the SLA requirements because of
regressions that have snuck in throughout the cycle. As
they are fixed these should be reduced back down.

Change-Id: I042d64245b1e4486334996d834ad31561613fa50
2016-08-18 10:51:46 +00:00
Kevin Benton
52fcdb4297 Increase ports per network and add SLA for rally
Increase the ports per network in the create and list ports
test. This also adds a max average time SLA so we can catch
regressions in performance.

Change-Id: I2e7e3fd7406db77c8e44dce2ab0b4594ff6f2db9
2016-04-01 23:09:19 +00:00
Alexander Maretskiy
28c95da3f5 Changes in rally-jobs/README.rst
Changes:
  * fix broken links
  * add link to release notes

Change-Id: Ie42b246aac2fd4f6de8cd8bcf28e5ff2906ffd32
2015-06-04 10:34:15 -04:00
Boris Pavlovic
6c61cf7af7 Run more Rally benchmark on every patch
* Since 24 Nov 2014 we added a lot of Neutron benchmarks

Running more Neutron related benchmarks in Neutron gate allows
to avoid performance regressions and races.

* Neutron benchmarks are described here:
https://github.com/stackforge/rally/blob/master/rally/benchmark/scenarios/neutron/network.py
It's quite simple code be free to take a look.

* All changes in concurrency and times are related to optimization
of duration/usefulness

* To get description of benchmarks use:

   rally info find NeutronNetworks.create_and_update_networks

New benchmarks:

- NeutronNetworks.create_and_update_networks

- NeutronNetworks.create_and_delete_networks

- NeutronNetworks.create_and_update_subnets

- NeutronNetworks.create_and_delete_subnets

- NeutronNetworks.create_and_update_routers

- NeutronNetworks.create_and_delete_routers

- NeutronNetworks.create_and_list_routers

- NeutronNetworks.create_and_update_ports

- NeutronNetworks.create_and_delete_ports

- NeutronNetworks.create_and_list_ports

- Quotas.neutron_update

related bug: #bug 1419723
Change-Id: Ie3c84e057fc96c0f35ad77b7297c564442ebcf10
2015-03-18 10:38:44 +00:00
Boris Pavlovic
fbd42439ca Update rally-jobs files
*) Rename rally-scenarios that is quite misleading to rally-jobs.
   rally-jobs makes much more sense, cause it actually contains files
   related to rally job

*) Update rally-jobs/README.rst to add more info

*) Update rally-jobs/plugins/README.rst to expaling plugins

*) Add new directory rally-jobs/extra, this directory is copy pasted
   in gates and can be used for files that are required by some of
   benchmarks

Change-Id: I6d0c0435a4bb4658ddf4adb871bc36ab8c157f3e
2014-11-24 23:21:11 +04:00