549 Commits

Author SHA1 Message Date
James Kirsch
b475643c11 Add support for encrypting backend Keystone HAProxy traffic
This patch introduces an optional backend encryption for Keystone
service. When used in conjunction with enabling TLS for service API
endpoints, network communcation will be encrypted end to end, from
client through HAProxy to the Keystone service.

Change-Id: I6351147ddaff8b2ae629179a9bc3bae2ebac9519
Partially-Implements: blueprint add-ssl-internal-network
2020-04-09 09:22:55 +00:00
Michal Nasiadka
8a0740df97 OVN Support
Implement OVN Ansible role.

Implements: blueprint ovn-controller-neutron-ansible

Depends-On: https://review.opendev.org/713422
Change-Id: Icd425dea85d58db49c838839d8f0b864b4a89a78
2020-04-09 07:40:12 +02:00
Mark Goddard
f4e20a1f16 Remove support for CentOS 7
CentOS 8 support is now fairly complete - time to drop CentOS 7.

Partially-Implements: blueprint centos-rhel-8

Change-Id: I940b1d3eceb98e16fa366c243672f588b1412d70
2020-04-08 17:05:10 +01:00
Zuul
fa49143f10 Merge "Update hacking for Python3" 2020-04-06 06:43:46 +00:00
Andreas Jaeger
454489762c Update hacking for Python3
The repo is Python 3 now, so update hacking to version 3.0 which
supports Python 3.

Fix problems found by updated hacking version.

Remove hacking and friends from lower-constraints, they are not needed
during installation.

Change-Id: I7ef5ac8a89e94f5da97780198619b6facc86ecfe
2020-04-04 17:00:17 +02:00
Radosław Piliszek
ed1b74a35b CI: Avoid tox (and clean up gate setup)
We don't need tox nor tell our users to use it when doing kolla
builds.
Tox is going away from base infra images.
It's already gone from aarch64 (arm64) ones.

Change-Id: I2eb5203ad93c011b8806f4b6fb56db081c14a2cb
2020-04-03 18:04:52 +01:00
Zuul
0c1b6c8a4b Merge "Use unittest.mock instead of PyPI mock" 2020-04-03 13:29:25 +00:00
Radosław Piliszek
5648ad6e9d Use unittest.mock instead of PyPI mock
Now that py2 is gone, oslotest dropped dependency on mock and will
soon affect Ussuri CI [1], let's use unittest.mock built in py3.

This also fixes py38 jobs and proactively prevents py36 and py37
failing due to [1]. This is because we never included mock in
test-requirements (but in lower-constraints where it does not
really belong at all) and instead relied on oslotest to bring
it in.

[1] https://review.opendev.org/716322

Change-Id: I30e82e2d87418272a71c7ee089a8acdaf8872158
2020-04-02 18:21:01 +02:00
Radosław Piliszek
641b22b2ef CI: Always use upper-constraints
In stable branches we are getting hit by more py2-incompats.
Let's pin u-c in all CI pip invocations.

Change-Id: Ie2bcc7c115cd2aaf4639d90803216011b346daf3
2020-03-30 20:42:08 +02:00
Zuul
0718a1a90c Merge "CI: Enable fluentd in MariaDB jobs" 2020-03-19 17:19:06 +00:00
Michal Nasiadka
b2d45e5b87 CI: Add instance console log to test-core-openstack.sh
Sometimes ping & ssh to the instance are failing - outputting instance console
log can help in the case when there are metadata access issues (or other
issues).

Change-Id: I8437300d621448782e964d877b2614ca606f5849
2020-03-19 12:24:59 +01:00
Michal Nasiadka
866a6ba16a CI: Enable fluentd in MariaDB jobs
Since fluentd is disabled in MariaDB jobs - haproxy logs are not getting
populated.

Change-Id: I56b3fc1be6940d97905cdb2c4452b846f106c071
Depends-on: https://review.opendev.org/713704
2020-03-19 09:01:23 +00:00
Zuul
71a058d2f8 Merge "CI: install tox" 2020-03-17 21:14:21 +00:00
Michal Nasiadka
81ebae8fd1 CI: Change ceph-ansible docker tag to latest-nautilus
ceph-ansible by default uses "latest" tag for ceph Docker Hub images,
but recently latest tag has been upgraded to be Octopus release,
not Nautilus.

Change-Id: I5247c10079ab91cce130cd5ba403f25ccaf7c1fb
2020-03-17 11:20:36 +01:00
Mark Goddard
dd1ebf20ca CI: install tox
tox will be removed from the base image. Install it before that happens.

This change is made in a simple way that can be easily backported.

Depends-On: https://review.opendev.org/713386

Change-Id: I4181654c88554c81940f0d079cf1d64326cdec79
2020-03-17 09:51:00 +00:00
Zuul
c63722f32a Merge "CI: Ignore neutron-server CRITICAL about WSREP" 2020-03-16 13:22:04 +00:00
Radosław Piliszek
16ade28d5f CI: Ignore neutron-server CRITICAL about WSREP
We are getting this randomly on neutron-server shutdown
for upgrade.
As it does not affect real operations (and if it did,
we would definitely see it now), let's ignore it.

Change-Id: Ibe561517d44a1108e8223442a71fab36b69c2258
Related-bug: #1863579
2020-03-16 10:00:46 +00:00
Zuul
5a11f14b1b Merge "CI: Debug init-runonce" 2020-03-15 20:18:18 +00:00
Zuul
ee7d2979eb Merge "CentOS 8: CI: Add upgrade job" 2020-03-06 11:01:19 +00:00
Mark Goddard
29f223c02a CentOS 8: CI: Add upgrade job
Test upgrade from CentOS 8 train to CentOS 8 master.

Change-Id: Ibff2c7f8844dec4758945cbc7aa8df80d70a3dfd
Partially-Implements: blueprint centos-rhel-8
2020-03-03 10:29:31 +00:00
Mark Goddard
cdae86a747 CI: Add Ceph groups back to inventory
Following I21dd51c82534704f31ca8d3f72cb2587ee216cd9, the test inventory
was synced with the multinode inventory. This removed some temporary
ceph groups used by the ceph-ansible-upgrade jobs, and broke them. This
change adds the groups back.

Change-Id: I37379258447ffde6b083f4e8d9a1644bc17cd165
2020-03-03 10:12:01 +00:00
Zuul
e003898ffd Merge "CI: sync inventory with multinode" 2020-03-02 19:42:09 +00:00
Radosław Piliszek
8df511a437 CI: Fix cinder smoke test
TrivialFix

Change-Id: I0e6924b5dc86e90c10037d96ab871bd981365cc9
2020-03-02 09:44:51 +01:00
Radosław Piliszek
29e4ef1374 CI: Debug init-runonce
Also adds gawk for timestamping.

This helps to correlate init events with failures elsewhere.

Change-Id: I22fdb683ecf9870b2d66fedd6b40b7004317130a
2020-03-01 09:57:35 +01:00
Zuul
438a611375 Merge "CI: Test floating ip allocation and connectivity to the instance" 2020-02-28 20:06:48 +00:00
Radosław Piliszek
1f0070db6c CI: Test floating ip allocation and connectivity to the instance
Inspired by pending work of mnasiadka [1] and mgoddard [2].

[1] https://review.opendev.org/708250
[2] https://review.opendev.org/707604

Depends-on: https://review.opendev.org/709362
Depends-on: https://review.opendev.org/709671
Depends-on: https://review.opendev.org/709830
Change-Id: Ifd7bde60881a4b644fc3f18dd9fcb7f8b02d3a00
2020-02-28 10:47:45 +01:00
Zuul
0317de44cc Merge "CI: Add addressing on external network" 2020-02-27 21:26:52 +00:00
Radosław Piliszek
195813dd60 CI: Add addressing on external network
This is to allow CI testing of network connectivity.

Note only "primary" node gets an address on it.
Hence, "primary" becomes our fake external router.

Depends-on: https://review.opendev.org/709361

Change-Id: I05592888796107d6de95b940c42b2bff73ac0669
2020-02-26 13:27:00 +01:00
James Kirsch
9b384da306 CI: Fix TLS upgrade test
Fix the upgrade TLS scenario in zuul to generate self signed
certificates and to configure TLS to be enabled in the open stack
deployment.

Change-Id: Icacc28eed6ad5b81fc3954db80486d9d7f24c082
Partially-Implements: blueprint custom-cacerts
2020-02-25 10:08:54 -08:00
Zuul
dfe2f9d0c7 Merge "CI: Use upper constraints when installing clients" 2020-02-25 15:07:44 +00:00
Mark Goddard
d8733b290e CI: Use upper constraints when installing clients
Clients are starting to release versions that don't support Python 2.
The ironic scenario is currently failing on stable branches for this
reason.

Use upper constraints to avoid installing these new versions on stable
branches.

Change-Id: I4f91b53cbf2297d70da4b54d6c402c1427aacdd9
2020-02-25 11:21:06 +00:00
Zuul
c3f7b6cce3 Merge "CI: Remove useless pre task" 2020-02-24 16:07:58 +00:00
Zuul
c00e1be43e Merge "CI: Use auto-detected python interpreter except on CentOS 7" 2020-02-23 17:04:17 +00:00
Mark Goddard
97a93f3266 CI: sync inventory with multinode
Change-Id: I21dd51c82534704f31ca8d3f72cb2587ee216cd9
2020-02-21 12:12:22 +00:00
Radosław Piliszek
dc0c762ab5 CI: Remove useless pre task
This was never necessary because C7 IPv6 CI was not enabled at
the time and later we fixed IPv6 in C7 to avoid this issue.
In Ussuri C7 is going away so even more reasons to drop it. :-)

Change-Id: I4066c9cd86ff892d78f6713589f9afffc611dcc1
2020-02-21 10:36:01 +01:00
Radosław Piliszek
4ac7f6f3a0 CI: Replace dummy interface (fake for neutron external) with VXLAN
This allows for some real testing, especially in a multinode
environment.

Change-Id: Ic96819fefe460e14c8460e52a78d9b0d034edc80
2020-02-21 08:56:26 +00:00
Zuul
ae41287129 Merge "CI: Fine tune Galera gmcast.peer_timeout to 15 seconds" 2020-02-21 07:09:38 +00:00
Zuul
28e4da7f62 Merge "CI: Add linuxbridge jobs" 2020-02-21 07:09:36 +00:00
Zuul
b610feaadc Merge "Revert "Upgrade virtualenv in pre"" 2020-02-20 22:08:50 +00:00
Zuul
ee7f2bf99d Merge "CI: Generate ARA HTML" 2020-02-20 20:39:59 +00:00
Michal Nasiadka
b05038929c CI: Fine tune Galera gmcast.peer_timeout to 15 seconds
In some resource-constrained environments, particularly during service
bootstrap Galera cluster nodes can experience timeouts in inter-node
communication.

This change sets the gmcast.peer_timeout based on the galera cluster
documentation:
https://galeracluster.com/library/documentation/galera-parameters.html

We are observing peer timeout issues on some CI runs - therefore raising
it to PT15S as in similar Ubuntu charms jobs.

Change-Id: Id036e41b62a88bab486c35a5f1fde5cfc2fa4803
2020-02-20 20:37:17 +00:00
Radosław Piliszek
72a2543568 Revert "Upgrade virtualenv in pre"
Reverts temporary.

This reverts commit 241e34748dabec12b7043924cb1628ed9bbbde48.

Change-Id: I4af6b9c57e594fce407b9524f04cfa83479e16f0
2020-02-20 17:58:13 +01:00
Michal Nasiadka
220b21a844 CI: Remove dbus from bindep and playbooks
Change-Id: I8b4e649e24871b1191dba39d766b6c133c7e8f24
2020-02-20 16:50:43 +00:00
Michal Nasiadka
f7bc4d78d9 CI: Add linuxbridge jobs
global_physnet_mtu needs to be set in neutron.conf, because linuxbridge-agent
discovers underlying vxlan0 interface mtu and returns an error when creating
vxlan port

CentOS8 job will not be added, because CentOS 8 iptables-ebtables package
is missing broute (--among-src) tables support required for linuxbridge agent,
see [1].

[1]: https://bugzilla.redhat.com/show_bug.cgi?id=1720637

Change-Id: I6b12f7ba95401d3342359c57ceeee8bec8aefe49
2020-02-20 17:08:04 +01:00
Radosław Piliszek
b356762b94 CI: Refactor VXLAN overlay setup
This makes it cleaner, allows reuse and outsourcing to zuul jobs
and enables us to create multiple of these overlay networks for
testing of more advanced scenarios.

Change-Id: Id557c81f68a7f34556854e7d6efc6eddfd2e7216
2020-02-20 12:24:05 +01:00
Michal Nasiadka
1a68c53fe0 CI: Add CentOS 8 ceph-ansible job
Change-Id: If354fbdeb2fd8d026faa0210b84da0a688c3ae0a
2020-02-14 09:29:05 +01:00
Radosław Piliszek
707f0c855e CI: Generate ARA HTML
Since move to Swift ARA database does not render server-side,
let's make it render HTML locally as suggested.

Change-Id: I1190526c02d1f312d5284544d6e5be433dd839fa
2020-02-13 13:43:10 +01:00
Zuul
cd3c51197e Merge "Remove kolla-ceph" 2020-02-13 10:09:24 +00:00
Michal Nasiadka
241e34748d Upgrade virtualenv in pre
Since virtualenv 20.0 (amongst other changes) six version >1.12.0 is required.
This change adds upgrade of virtualenv and six in pre - to be reverted once
infra CentOS images are sorted out.

Change-Id: I0ca0347bb6ebc5d8f5d22f708211e01221165262
2020-02-12 13:48:25 +01:00
Zuul
ece2606aeb Merge "CI: Add TLS tests" 2020-02-12 01:20:19 +00:00