92248c8506
- Acreate a new tools/run_tests.py script to
execute test cases
- Move report generation to such script and
remove 'report' tox environment
- Running test cases generates report files
(.log, .html, .xml) into 'report/{envname}'
directory
- Test cases failures will returns exit code 1
Other script test runner failures returns
exit code 2
Big refactory to tox.ini file to try semplifying it:
- create the new 'py3' tox environment for running unit
tests as default platform python 3 interpreter
- use same as py3 '{envdir}' for scenario, functional,
neutron and faults tox environments
Change-Id: Id09425245cc86b84b41e6b3b1c1db759cc686f3a
|
||
|---|---|---|
| devstack | ||
| doc | ||
| etc/oslo-config-generator | ||
| infrared_plugin | ||
| playbooks | ||
| releasenotes | ||
| roles | ||
| tobiko | ||
| tools | ||
| zuul.d | ||
| .ansible-lint | ||
| .coveragerc | ||
| .gitignore | ||
| .gitreview | ||
| .stestr.conf | ||
| ansible.cfg | ||
| bindep.txt | ||
| infrared-requirements.txt | ||
| LICENSE | ||
| linters-requirements.txt | ||
| Pipfile | ||
| README.rst | ||
| requirements.txt | ||
| setup.cfg | ||
| setup.py | ||
| test-requirements.txt | ||
| tobiko.conf.example | ||
| tox.ini | ||
| Vagrantfile | ||
Tobiko
Test Big Cloud Operations
Tobiko is an OpenStack testing framework focusing on areas mostly complementary to Tempest. While tempest main focus has been testing OpenStack rest APIs, the main Tobiko focus would be to test OpenStack system operations while "simulating" the use of the cloud as the final user would.
Tobiko's test cases populate the cloud with workloads such as instances, allows the CI workflow to perform an operation such as an update or upgrade, and then runs test cases to validate that the cloud workloads are still functional.
Project Requirements
Tobiko Python framework is being tested with below Python versions:
- Python 3.6
- Python 3.7
- Python 3.8
and below Linux distributions:
- CentOS 7 (with Python 3.6 and 3.8)
- Ubuntu Bionic (with Python 3.6 and 3.7)
The framework is being used for executing test cases. As Tobiko can be executed on nodes that are not part of the cloud to test against, this doesn't mean Tobiko requires cloud nodes have to run with one of tested Python versions or Linux distributions.
Main Project Goals
- To provide a Python framework to write system scenario test cases.
- To provide tools for testing OpenStack system operations like update, upgrades and fast forward upgrade.
- To provide CLI tools to implement a workflow designed to test potentially destructive operations (like rebooting cloud nodes, restarting services or others kinds of fault injections).
- To provide tools to monitor and recollect the healthy status of the cloud as seen from user perspective (black-box testing) or from inside (white-box testing).
References
- Free software: Apache License, Version 2.0
- Documentation: https://tobiko.readthedocs.io/en/latest/
- Release notes: https://docs.openstack.org/releasenotes/tobiko/
- Source: https://opendev.org/x/tobiko
- Bugs: https://storyboard.openstack.org/#!/project/x/tobiko