3601 Commits

Author SHA1 Message Date
Stephen Taylor
bf95238dc1 [helm] Upgrade Helm to version 3.12.0
Helm version 3 is needed for upcoming features, notably the
rook-helm charts to manage Ceph via Rook require Helm v3. This
change updates Helm in openstack-helm-infra to 3.12.0.

Change-Id: I13b1671121658b1390d89beabacfd15a24b19afe
2023-06-01 08:22:31 -06:00
Zuul
b9954058bc Merge "[osh-selenium] Upgrade image to latest-ubuntu_focal" 2023-05-25 02:48:48 +00:00
Zuul
97ca7839a2 Merge "Update calico to v3.25.1" 2023-05-23 20:35:32 +00:00
Anselme, Schubert (sa246v)
e74e94a19a
Update calico to v3.25.1
Change-Id: I1c475266584316d550924fa53badf43463f4d0bd
Signed-off-by: Anselme, Schubert (sa246v) <sa246v@att.com>
2023-05-23 15:13:30 +00:00
astebenkova
92d16f3a29 [osh-selenium] Upgrade image to latest-ubuntu_focal
+ migrate all Python tests to use Selenium v4 (bionic image had v3 installed):
https://www.selenium.dev/documentation/webdriver/getting_started/upgrade_to_selenium_4/
+ amend selenium role in order to install ChromeDriver compatible with Google Chrome:
https://chromedriver.chromium.org/downloads/version-selection
+ run selenium tests AFTER the charts are deployed

Change-Id: I46200b7dc173bd0e1e6bf3545d9a26c252a21927
2023-05-23 18:09:16 +03:00
Vladimir Kozhukalov
ebbf659e35 Revert "Update kubernetes to 1.27.1"
This reverts commit 8e96a91ffae745b952c053923aa177e615b49b74.

Reason for revert: The change broke the compute-kit tests.
The deployment of all Openstack components is successful but then when we create networks and a VM, neutron-dhcp-agent crashes. It is still not clear why it happens. Let's revert this change and figure out what is going on.

Change-Id: I07082511cd168560c8fe8dce3421e37fc402a1ae
2023-05-23 09:20:47 +00:00
SPEARS, DUSTIN (ds443n)
8e96a91ffa Update kubernetes to 1.27.1
Update mini-kube to 1.30.1
Update crictl to 1.27.0

Change-Id: I528bad131cac4922b5663a8f7522657d26d1e020
2023-05-18 16:08:01 -04:00
Stephen Taylor
9c5e5102f6 [ceph-client] Strip any errors preceding pool properties JSON
Sometimes errors appear in the 'ceph osd pool get' output before
the JSON string. The returned string is saved and is assumed to
contain only the JSON string with the pool properties. When errors
appear in the string, pool properties are not read properly, which
can cause pools to be misconfigured. This change filters that
output so only the expected JSON string is returned. It can then be
parsed correctly.

Change-Id: I83347cc32da7e7af160b5cacc2a99de74eebebc7
2023-05-10 22:41:22 +00:00
Stephen Taylor
45b492bcf7 [ceph] Update Ceph to 17.2.6
This change updates the openstack-helm-infra charts to use 17.2.6
Quincy images based on Focal.

See https://review.opendev.org/c/openstack/openstack-helm-images/+/881217

Change-Id: Ibb89435ae22f6d634846755e8121facd13d5d331
2023-05-09 12:25:07 +00:00
Zuul
3b95618f47 Merge "Add pdf-docs tox env" 2023-05-08 23:26:40 +00:00
Samuel Liu
8db130372d Migrated CronJob resource to batch/v1 API version
Migrate manifests and API clients to use the batch/v1 API version, available since v1.21.
The batch/v1beta1 API version of CronJob is no longer served as of v1.25.

ref: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#cronjob-v125

Change-Id: I4b80b6a85be5f117d8513710c6a248639ea81edf
2023-05-02 11:46:36 +03:00
Zuul
3e28b8b3ca Merge "Upgrade openvswitch image to latest-ubuntu_focal to fix qos issue" 2023-04-28 18:05:58 +00:00
Vladimir Kozhukalov
e2d550972a Add pdf-docs tox env
Story: 2006104
Task: 35275
Change-Id: Ieadbb40bcd7fbdd6d37e78eb174fdb99ad7312a8
2023-04-27 11:13:29 +03:00
Samuel Liu
1a4046f9b1 Migrated pdb resource to policy/v1 API version
The policy/v1beta1 API version of PodDisruptionBudget is no longer served as of v1.25.

ref: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#poddisruptionbudget-v125
Change-Id: Ib9edd7f159aedf1f2f054bcb9f2281389ba206b5
2023-04-25 17:16:44 +08:00
lvdongbing
34b3b4f1f4 Upgrade openvswitch image to latest-ubuntu_focal to fix qos issue
Closes-Bug: #2017383
Change-Id: I21c0260fa90ecdc1cc52469fea508f1f0bac5692
2023-04-23 02:26:56 +00:00
dbcocle-ts
7b8d459d14 Fix ovn db persistence issue
Change ovn db volume default mount to '/var/lib/ovn', as ovn(sb or nb)
default use this directory.

Closes-Bug: #2016844

Change-Id: I017781bd4df836949396c34f8ef5e6bd0f07efab
2023-04-19 01:41:08 +00:00
Zuul
766c5803b9 Merge "Update kubernetes cgroup value for libvirt" 2023-04-13 17:37:35 +00:00
Vladimir Kozhukalov
97ce6d7d8e Update kubernetes registry to registry.k8s.io
See this link for details
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/

Change-Id: Ifc8b64825751933def16a1784fae987a1d7250ad
2023-04-11 04:54:26 +03:00
Ruslan Aliev
c4a9e8b03d Add configurable liveness probe for elasticsearch client
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Change-Id: I46e1382123ce4497e3f8e414a83fe0861f0cf43b
2023-04-07 15:12:34 -05:00
Vladimir Kozhukalov
d67ce6740b Update kubernetes cgroup value for libvirt
The reason for this PR is that in most cases
we utilize systemd cgroup driver nowadays.
So it worth it to set kubepods.slice cgroup root
by default.

https: //github.com/kubernetes/kubernetes/blob/release-1.26/pkg/kubelet/cm/cgroup_manager_linux.go#L77-L81
Change-Id: I0cad148eb827439815c7e5bad1d6b6108cd1ab8d
2023-03-31 04:28:55 +03:00
Zuul
35bad7ea02 Merge "Update create db user queries" 2023-03-30 23:57:17 +00:00
Stephen Taylor
1cf87254e8 [ceph-client] Allow pg_num_min to be overridden per pool
This change allows the target pg_num_min value (global for all
pools) to be overridden on a per-pool basis by specifying a
pg_num_min value in an individual pool's values. A global value for
all pools may not suffice in all cases.

Change-Id: I42c55606d48975b40bbab9501289a7a59c15683f
2023-03-30 15:40:33 +00:00
Jose Bautista
1775e1bea6 Update create db user queries
Using GRANT to create users was deprecated in 5.7. The current
query to create user fails with new versions of mysql.

Change-Id: If991778763dc0961508e8466244955fd71b47591
2023-03-31 01:47:47 +11:00
Sergiy Markin
e6dfa15c26 Upgrade of Kubernetes
This PS upgrades the following components:
- minikube to 1.29.0
- kubernetes to 1.26.3
- calico to 3.25
- coredns to 1.9.4

Also this PS adds cri-dockerd required for kubernetes newer than 1.24
and adds recirsive response to coredns.

Change-Id: Ie8aa43642de5dfa69ed72fadbfd943b578a80a74
2023-03-30 00:37:51 +00:00
Zuul
7c1b49a341 Merge "[ceph] Document the use of mon_allow_pool_size_one" 2023-03-24 04:53:24 +00:00
Samuel Liu
6034a00bf7 Replace node-role.kubernetes.io/master with control-plane
The master label is no longer present on kubeadm control plane nodes(v1.24). For new clusters, the label 'node-role.kubernetes.io/master' will no longer be added to control plane nodes, only the label 'node-role.kubernetes.io/control-plane' will be added. For more information, refer to KEP-2067[https://github.com/kubernetes/enhancements/tree/master/keps/sig-cluster-lifecycle/kubeadm/2067-rename-master-label-taint]: Rename the kubeadm "master" label and taint.

the kubernetes pr: https://github.com/kubernetes/kubernetes/pull/107533

Change-Id: I3056b642db0a1799089998e3c020b4203c9a93ab
2023-03-20 13:38:07 +08:00
Sadegh Hayeri
6c5206a01c Add ovn
Change-Id: I2b1457042afcbe1375b771161acfa929a91e6813
2023-03-17 22:11:55 +03:00
Stephen Taylor
f47a1033aa [ceph] Document the use of mon_allow_pool_size_one
This is simply to document the fact that mon_allow_pooL_size_one
must be configured via cluster_commands in the ceph-client chart.
Adding it to ceph.conf via the conf values in the ceph-mon chart
doesn't seem to configure the mons effectively.

Change-Id: Ic7e9a0eade9c0b4028ec232ff7ad574b8574615d
2023-03-17 12:21:01 -06:00
Zuul
728641cce3 Merge "[ceph] Update all Ceph images to Focal" 2023-03-17 16:46:18 +00:00
Zuul
d3acf392cd Merge "Use free loop devices for ceph deployment" 2023-03-17 05:49:57 +00:00
Stephen Taylor
fc92933346 [ceph] Update all Ceph images to Focal
This change updates all Ceph image references to use Focal images
for all charts in openstack-helm-infra.

Change-Id: I759d3bdcf1ff332413e14e367d702c3b4ec0de44
2023-03-16 16:39:37 -06:00
Zuul
0e4af3f0e7 Merge "Fix typo in loops-setup systemd unit definition" 2023-03-16 22:12:38 +00:00
Stephen Taylor
f80049faa1 [ceph] Allow gate scripts to use 1x replication in Ceph
The Pacific release of Ceph disabled 1x replication by default, and
some of the gate scripts are not updated to allow this explicitly.
Some gate jobs fail in some configurations as a result, so this
change adds 'mon_allow_pool_size_one = true' to those Ceph gate
scripts that don't already have it, along with
--yes-i-really-mean-it added to commands that set pool size.

Change-Id: I5fb08d3bb714f1b67294bb01e17e8a5c1ddbb73a
2023-03-16 05:19:30 -06:00
Vladimir Kozhukalov
c0ca3b5c99 Fix typo in loops-setup systemd unit definition
Change-Id: Ib069e1ea70d011e5167440f02b62cb91688f92e4
2023-03-09 20:28:30 +03:00
Vladimir Kozhukalov
66fb4a2b26 Use free loop devices for ceph deployment
This is for convenience when running deployment scripts
manually. On ubuntu loop0 and loop1 could in use
for snaps so we can find free loop devices before trying
to use them.

Change-Id: Iec54c0decd3a401c99f4770187d81f370bcee24c
2023-03-09 20:18:45 +03:00
Vladimir Kozhukalov
42752cca63 Remove unnecessary ceph provisioners templates
Change-Id: Ia12a99e7c97f7af701b17e1f783d772ab44b5cd7
2023-03-09 19:20:55 +03:00
Stephen Taylor
334123e81c [ceph-provisioners] Remove legacy Ceph provisioners
The legacy CephFS and RBD provisioners are no longer maintained and
are incompatible with the latest updates to Ubuntu and Ceph. This
change disables them. CSI provisioners should replace them.

Change-Id: Ife453ef654aa206fea95c07bbc2af4f5f6748f8f
2023-03-07 14:28:32 -07:00
Sergiy Markin
a7cd689280 [backups] Database backups
This PS resolves several issues in database backup script in HTK chart:

- decreases random delay before uploading remote backup to up to 30s
- removes additional random delay before remote backup verification
- switches remote backup verification protocol from sha256 to md5

The main goal for the changes above is decreasing network load on remote
backup storages by eliminating the need of remote file download right
after uploading in order to be able to calculate sha256 checksum.

Change-Id: Ic01a37d8814283a2e9a11dac94d6909d34edc937
2023-03-01 19:48:22 +00:00
Ritchie, Frank (fr801x)
150dcdcf9a Update grafana version to 9.2.10
This PS is just to update grafana to 9.2.10.

Change-Id: I4958ef802653d9523bfdcdff0a709042794dba8c
2023-02-27 15:47:53 -05:00
Zuul
647eb821f4 Merge "Docker log collection" 2023-02-23 22:04:18 +00:00
Wahlstedt, Walter (ww229g)
d132d708e9 Docker log collection
Collect logs for zuul jobs that use docker

Change-Id: I8da05be5e84c0d565655721c4545ca7446794858
2023-02-22 12:38:07 -05:00
Zuul
87a9944d38 Merge "Bump ubuntu and openstack version in jobs" 2023-02-22 03:51:25 +00:00
Zuul
566a33c539 Merge "[ceph-rgw] Replace civetweb with beast for unencrypted connections" 2023-02-21 23:44:42 +00:00
Gage Hugo
74652cb181 Bump ubuntu and openstack version in jobs
The current zuul jobs definitions still use an older release and
distro version of ubuntu. This change modifies the versions to run
ubuntu focal and the Xena release of openstack.

Change-Id: I653fd9ed42972c7bba5fa94519cd413c0d15b2c9
2023-02-16 06:02:48 +00:00
Gage Hugo
7ce571ab54 Update NFS Provisioner image version
This change updates the nfs-provisioner to a newer image version.
Also nfs-provisioner 2.3.0 requires more ports.

Change-Id: I5ac00d6de95bc27fec6b935395a4c717e146f857
2023-02-16 03:35:14 +03:00
Stephen Taylor
2dd5bdf82e [ceph-rgw] Replace civetweb with beast for unencrypted connections
Replaces civetweb with beast for unencrypted RGW connections when
Keystone is enabled for authentication.

Change-Id: I531b169eb241464284d8fdf72f52436692092d6b
2023-02-15 21:41:25 +00:00
Vladimir Kozhukalov
c925341518 Fix ceph deployment
When deploy ceph on loop devices we need lvm2
to be installed on the host to create necessary
device links like /dev/<vgname>/<lvname>

Change-Id: I5dabbc080aa45b28c1dd5e1d883f9d45affdf60f
2023-02-15 21:39:59 +03:00
Zuul
edd5e72e3f Merge "Add debug info when wait-for-pods.sh fails" 2023-02-03 07:14:24 +00:00
Vladimir Kozhukalov
e3f966add0 Unpin containerd.io package version
It used to be pinned to 1.5.11-1 which is
is not compatible with the latest docker-ce package.

Change-Id: I69b4a28d5919cb1b47b56ea356e1337dbe146cce
2023-02-02 23:03:32 +03:00
Vladimir Kozhukalov
1f222fc438 Add debug info when wait-for-pods.sh fails
Sometimes jobs fail due to pending pods and
we need a way to debug this.

This PR adds `kubectl describe po` for pods if
not all pods are ready.

Change-Id: Iefc03bfbd26764feb54789981bdf0072e0536ee5
2023-02-02 01:00:11 +03:00