1540 Commits

Author SHA1 Message Date
Zuul
63b9df23bb Merge "Add metrics-server to list of platform namespaces" 2022-03-16 21:29:22 +00:00
Zuul
afb1612493 Merge "Upgrade Trident to 22.01.0 version." 2022-03-16 21:24:06 +00:00
Jim Gauld
fbc0afd985 Port kubelet make isolcpus allocation SMT awareness to 1.23.1
Simple port of two existing patches without modification to
kubernetes 1.23.1. This enables the feature to make kubelet
isolcpus allocation SMT aware.

Depends-On: https://review.opendev.org/c/starlingx/compile/+/825651
Depends-On: https://review.opendev.org/c/starlingx/integ/+/825654
Story: 2008760
Task: 44190

Test Plan:
PASS: Launch isolcpus pod and verify new kubelet logs on target host

Signed-off-by: Jim Gauld <james.gauld@windriver.com>
Change-Id: I2c18dea1b1f9a8a1c5e183e104a832ac872764e6
2022-03-16 12:19:06 -04:00
Zuul
1d9d130066 Merge "Add Kubernetes 1.23.1 pkg" 2022-03-16 14:59:15 +00:00
Daian Cardoso Sganderlla
7f462fe3bc Upgrade Trident to 22.01.0 version.
Update version of Trident to 22.01.0 to keep compatibility with
version 1.23 of Kubernetes.
This supports Kubernetes 1.11 until 1.23.

Test Plan:
PASS: Tested Trident 22.01.0 installation and communication with
Netapp simulator
PASS: Tested the Trident update from version 21.04.1 to 22.01.0,
upgrading tridentctl client version and rerunning the
ansible-playbook to update the server version.

Story: 2009860
Task: 44546

Change-Id: I327b4e3707de54006f2d90d53f7d343ca5cfeb43
Signed-off-by: Daian Cardoso Sganderlla <Daian.CardosoSganderlla@windriver.com>
2022-03-16 08:05:34 -04:00
Scott Little
01a95fc6ca Fix qemu and kubernetes build resource requirements
Qemu and kubernetes build failed to build under a 3 GB ramdisk.
The 6 GB ramdisk was ok.

Increase the minimum resources for these packages to 6 GB.

Closes-bug: 1964980
Signed-off-by: Scott Little <scott.little@windriver.com>
Change-Id: I6027a4c02c15ef87a405ad300e967499c103b452
2022-03-15 11:39:08 -04:00
Zuul
ce35e3d352 Merge "Port kubelet make isolcpus allocation SMT awareness to 1.22.5" 2022-03-14 18:09:55 +00:00
Zuul
eb22f6c2a8 Merge "debian: Fix ceph service calls" 2022-03-11 21:10:37 +00:00
Zuul
7b4a7d151d Merge "debian: Replace puppet-module-ceph-3.1.1 with 2.4.1" 2022-03-11 21:10:32 +00:00
Zuul
7e932f80b1 Merge "Fix kubelet service Environment File" 2022-03-11 20:14:32 +00:00
Gleb Aronsky
79db1f3eed Add Kubernetes 1.23.1 pkg
Changes for adding Kubernetes 1.23.1 in
StarlingX, including build environment updates.

The package builds successfully.
Built and installed an iso with K8s 1.23.1 on
AIO-SX.

Depends-On: https://review.opendev.org/c/starlingx/compile/+/825651
Story: 2009830
Task: 44424

Change-Id: I3e2b793d7b88057fc597b2445bddd137bb2b4fcf
Signed-off-by: Gleb Aronsky <gleb.aronsky@windriver.com>
2022-03-11 12:29:41 -05:00
Dan Voiculeasa
fe8b8dcc9b debian: Fix ceph service calls
This work is part of Debian integration effort.
This work affects only Debian, but we can port to CentOS.

Puppet manifest fails because osd service is called before osds are
prepared (partitioned). This happends because parameters are not
correctly passed to the service call. In fact the service call only
asks to start a mon serice.

Tests:
PASS: live patch controller && unlock, puppet goes past the issue
PASS: build-pkgs and check contents

Story: 2009101
Task: 44756
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I9f6c6478c51ba45843bbaff9e264fc10056fac48
2022-03-11 18:05:03 +02:00
Dan Voiculeasa
bac46cc0e0 debian: Replace puppet-module-ceph-3.1.1 with 2.4.1
This work is part of Debian integration effort. This work only affects
debian.

We package the same version of ceph for both CentOS and Debian.
Since we know the puppet-ceph module on CentOS is supposed to work,
use this on Debian also to reduce testing and possible issues.

Patches were copied from CentOS and not touched.
Drop one patch to metadata.json, we know we have some work to do in
that area to clear puppet warnings, but will be done part of a
generic clearing puppet warnings effort.

The sources need to be patched to work with debhelper-compat 13, which
we don't care now.

There are some integration issues, but testing so far revealed that
during a puppet replay for aio manifest ceph data and ceph journal
partitions were created.

Story: 2009101
Task: 43431
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I90adc736ea52e6c4f9946520156f53e572c224cc
2022-03-11 11:38:20 +02:00
Zuul
6db1ffba37 Merge "update armada-helm-toolkit for k8s 1.22.5" 2022-03-11 02:41:09 +00:00
Zuul
7696d576ad Merge "CentOS: upversion containerd and runc" 2022-03-10 20:23:18 +00:00
Zuul
939f4c964b Merge "integ: remove mlx4 from openvswitch" 2022-03-10 19:48:12 +00:00
Thiago Miranda
636e5352d9 Add metrics-server to list of platform namespaces
Testing:
* Deployed ISO with changes.
* Configured kube-cpu-mgr-policy=static.
* Verified that metrics-server were running on platform CPUs.

Partial-Bug: 1964503

Signed-off-by: Thiago Miranda <ThiagoOliveira.Miranda@windriver.com>
Change-Id: I9bebe9ec27fcd70e89a4cae52bfacde993f958eb
2022-03-10 12:04:30 -05:00
Zuul
47e28ef893 Merge "Change default location of puppet-network routes file on Debian" 2022-03-10 16:41:27 +00:00
Andre Fernando Zanella Kantek
11cc1482ca Change default location of puppet-network routes file on Debian
In order to compare the difference between sysinv database and
currently configured static routes, the destination directory will be
changed to /var/run/network-scripts.puppet/

This new location will be used by apply_network_config script to
update modified configuration from the database and save the result
in /etc/network/routes be used during boot by ifupdown

Story: 2009101
Task: 44728

Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
Change-Id: I4ba06160c2cc7db2bfec061c09b9eb6a75961ce4
2022-03-10 13:54:02 +00:00
Zuul
52093f16ab Merge "meta_data.yaml: add sha256sum checksum" 2022-03-09 22:54:45 +00:00
Zuul
f9194f4194 Merge "Add k8s container cleanup" 2022-03-09 18:27:50 +00:00
Zuul
a6e650a340 Merge "debian: Clean up services starting" 2022-03-09 16:16:26 +00:00
Daniel Safta
f3c18b0f79 Add k8s container cleanup
When executing a reboot/shutdown
k8s pods are not receiving the SIGTERM
signal which leads some of them to
unexpected behaviour such as generating
huge coredumps.

There is an upstream issue regarding this:
https://github.com/kubernetes/kubernetes/issues/107158
The problem seems to be systemd related
but this commit addresses the problem
with a workaround.

This commit introduces a new script that
will cleanup all the remaing pods and will
be run after kubelet is stopped.

The script is executed successfully when
kubelet stops and the pods are stopped
before the system shuts down.

Closes-bug: 1964111
Signed-off-by: Daniel Safta <daniel.safta@windriver.com>
Change-Id: Ia0376aa510dd0dc3983e16cd89840726c15d6c92
2022-03-09 11:10:51 -05:00
Lucas Cavalcante
44f7057e50 Fix kubelet service Environment File
Kubelet env file in Debain uses path /etc/default instead of
/etc/sysconfig

Test Plan:

PASS: Bootstrap Debian
SKIP: Boostrap Centos (only impacts debian build)

Story: 2009101
Task: 44600
Depends-on: https://review.opendev.org/c/starlingx/ansible-playbooks/+/828547
Change-Id: Ib2889ba9ca2fd4cee047e70271df0e31ac27267d
Signed-off-by: Lucas Cavalcante <lucasmedeiros.cavalcante@windriver.com>
2022-03-09 12:03:22 -03:00
Zuul
5582fbf4b5 Merge "CentOS: Uprev the containernetwork-plugins to 1.0.1" 2022-03-08 15:04:12 +00:00
Jiping Ma
94dbeb480d integ: remove mlx4 from openvswitch
The module mlx4 has been dropped in
mlnx-ofa_kernel-5.5-OFED.5.5.1.0.3.1. So remove mlx4 from openvswitch
after OFED driver upgrade. The infomation can be found in the part
"Unsupported Functionalities/Features/NICs" in this link:
https://docs.nvidia.com/networking/display/MLNXOFEDv551032/
General+Support where ConnectX-3 and ConnectX-3 Pro adapter card
represents use of mlx4.

Verification:
- Build success.
- Install success onto a StarlingX system with two controller and two
  compute nodes with network adapters Mellanox's OFED. The network
  adapters of controllers are Mellanox Technologies MT27710 Family
  [ConnectX-4 Lx], the network adapters of computes are Mellanox
  Teichnologies MT27800 Family [ConnectX-5].
- RDMA/Infiniband over Ethernet functionalities of the Mellanox adapters
  were successfully tested using the Linux RDMA community's perftest
  package.
- Test ovs-dpdk. It fails with both mlx driver version
  mlnx-ofa_kernel-5.3-OFED.5.3.1.0.0.1 and
  mlnx-ofa_kernel-5.5-OFED.5.5.1.0.3.1. The OFED v5.5 is not breaking
  anything new.

Story: 2009878
Task: 44652
Depends-On: https://review.opendev.org/c/starlingx/kernel/+/831461

Signed-off-by: Jiping Ma <jiping.ma2@windriver.com>
Change-Id: I5214ef6de1eb7c054e4fc544f113d67652f661fa
2022-03-08 09:54:48 -05:00
Jim Gauld
2874abbeaa Port kubelet make isolcpus allocation SMT awareness to 1.22.5
Simple port of two existing patches without modification to
kubernetes 1.22.5. This enables the feature to make kubelet
isolcpus allocation SMT aware.

Story: 2008760
Task: 44190

Signed-off-by: Jim Gauld <james.gauld@windriver.com>
Change-Id: I6fb17f62d90bd6aa26b88dc7057ed7f667cf81b7
2022-03-07 15:03:24 -05:00
Daniel Safta
a56f50126b update armada-helm-toolkit for k8s 1.22.5
helm-toolkit's resources need to be updated
to use the new apiVersion and changes
proposed in:
https://kubernetes.io/docs/reference/using-api/deprecation-guide

This commit addresses just the changes needed for running
the armada chart.
It was deployed successfully on k8s 1.22.5.

Story: 2009888
Task: 44649
Change-Id: If38f62d178412f8a0974ec0af8ff2475800876be
Signed-off-by: Daniel Safta <daniel.safta@windriver.com>
2022-03-07 09:20:26 -05:00
Zuul
acdd869a58 Merge "debian: Add ceph to debian_pkg_dirs" 2022-03-04 21:00:44 +00:00
Zuul
27ead659fa Merge "debian: Change systemd service presets for nfs" 2022-03-04 20:47:30 +00:00
Dan Voiculeasa
cd1d36e808 debian: Change systemd service presets for nfs
This work is part of Debian integration effort. This work
affects only Debian. This will unlock puppet manifest
apply at unlock.

Nfs utilities on Debian use different service names. Enable
them to allow puppet manifest for unlock progress. Otherwise
exportfs doesn't function without the services started.

Tests:
PASS: on an existing setup, manually enabled the services before
      unlock, did run unlock, progressed further than the error
PASS: build-pkgs && build-image
PASS: install iso
PASS: check nfs services are enabled

Story: 2009101
Task: 44380
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I41de2471074ecd3805f1cb1a74cbe3b976c01f9d
2022-03-04 20:10:19 +00:00
zulcss
bf88cd08f7 debian: Add ceph to debian_pkg_dirs
This work is part of the Debian integration efforts
This work only affects Debian.

Depends-On: https://review.opendev.org/c/starlingx/integ/+/831738

Debian tests:
PASS: build-pkgs
PASS: build-image
PASS: install

Story: 2009101
Task: 44402

Signed-off-by: Chuck Short <charles.short@windriver.com>
Change-Id: I48c513dba0fb07edc5413e8ba3b139430e53c8bd
2022-03-04 19:12:44 +00:00
Zuul
46b4bcfcfe Merge "Set provider mode when formatting network interfaces file on Debian" 2022-03-04 18:42:00 +00:00
Andre Fernando Zanella Kantek
d0a4cdcb1e Set provider mode when formatting network interfaces file on Debian
When the interfaces file is generated it is necessary to determine the
mode (vlan or raw) from the interface name. Originally the plugin
considers that a previous interfaces file exists and will use it to
set the mode value.

But on StarlingX network_config is generated by sysinv and there is no
previous file to parse, so this change adds the mode logic on
file formatting.

Test Plan:
PASS: generate valid ifupdown config when interface name is of format
      "vlanNNN" on Debian and apply it with ifup/ifdown command

Story: 2009101
Task: 44659

Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
Change-Id: Ibccd189ea14eed4b8504908188fabedfa6bf4c2a
2022-03-04 18:27:32 +00:00
Zuul
d7a0a4b720 Merge "Change openldap pid and args file location for Debian" 2022-03-04 16:19:06 +00:00
Chuck Short
8f11e0df76 debian: Clean up services starting
This commit does several things at once:
- Create a symlink for /etc/init.d/functions (centos) from
  /lib/lsb/init-functions, to maintain compatibility.
- Make /etc/systemd/system-preset so that when a service
  is installed it places a preset file in the directory.
- Remove hardcoded services.

Test Plan:
PASS Build package
PASS Build and install ISO
PASS check for symlink /etc/init.d/functions
PASS check for /etc/systemd/system-preset
PASS check for running services

Story: 2009101
Task: 44678

Signed-off-by: Chuck Short <charles.short@windriver.com>
Change-Id: I9c5ec7eb7177dd7dde954db5d0c3d3f602677ccd
2022-03-04 14:39:38 +00:00
Andy Ning
fc13f4db8b Change openldap pid and args file location for Debian
Change openldap pid and args file location from /var/run/slapd
to /run so it's aligned with CentOS. This will enable openldap
to be managed by SM.

Test Plan for Debian:
PASS: package build, image build
PASS: system boostrap
PASS: controller unlock, open-ldap service state in SM is
      enabled-active enabled-active

Story: 2009101
Task: 44664
Signed-off-by: Andy Ning <andy.ning@windriver.com>
Change-Id: I108a63d5b829b66ef24516f9e2c33fde0288f9a8
2022-03-03 11:41:22 -05:00
Yue Tao
4a709349a9 meta_data.yaml: add sha256sum checksum
Test Plan:
Pass: Verify sha256sum checksum via "download -s"

Story: 2008846
Task: 44578

Signed-off-by: Yue Tao <Yue.Tao@windriver.com>
Change-Id: I78d9dff2af0afb18c6db4e8d2d39ef79b5cf5864
2022-03-03 14:30:40 +08:00
Zuul
304571c85a Merge "debian: Remove postgres user from group/passwd files" 2022-03-02 20:05:43 +00:00
Steven Webster
9597dd7503 CentOS: Uprev the containernetwork-plugins to 1.0.1
This commit bumps the containernetwork-plugins package to v1.0.1.

This is part of the ongoing activity of refreshing kubernetes
components.  In this case, various bug fixes throughout the
plugins have been picked up.

Test Plan:

 - Successful build of the new package.
 - Plugin functional testing:
   main:
    bridge
    macvlan
    ipvlan
    vlan
    ptp
    host-device

   meta:
    sbr
    vrf
    tuning
    portmap
    bandwidth

   ipam:
    dhcp
    static
    host-local

Story: 2009832
Task: 44426

Change-Id: Id636b959cf500009b4f14bc10379a5edf969d032
Signed-off-by: Steven Webster <steven.webster@windriver.com>
2022-03-02 11:47:20 -05:00
Charles Short
d04b7a4c54 debian: Remove postgres user from group/passwd files
Removed user from group/passwd files to prevent a
conflict when the postgresql-common package is installed.

Story: 2009221
Task: 43417

Test Plan
PASS Apply patch build package
PASS Build base-passwd package
PASS Run build-image
PASS Check to see if postgresql is running when
     the image is running.
PASS Debootstrap

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I885ed3467548013ad9c2be3d7d64fafad3703adc
2022-03-02 15:40:13 +00:00
Kaustubh Dhokte
298c333a76 CentOS: upversion containerd and runc
To align with kubernetes 1.21.8,
Upgrade containerd from version 1.4.6 to 1.4.11
Upgrade runc from version 1.0.0-rc95 to 1.0.2

We continue to use no_btrfs build flag for containerd
as we do not use btrfs

Test Plan:
Built an iso (CentOS) and installed on AIO-DX lab
PASS: Run basic docker, ctr, crictl and runc commands
      to create, list containers, images
PASS: Create new pods and PVCs and delete them
PASS: Lock-unlock and reboot hosts.
      Check all pods are up back

Story: 2009845
Task: 44456

Signed-off-by: Kaustubh Dhokte <kaustubh.dhokte@windriver.com>
Change-Id: I8e5ce0fd316e2e7f059c8abe5050732192f502a1
2022-03-02 02:35:09 -05:00
Zuul
0ebda405d8 Merge "debian: Enable minimum required platform services" 2022-02-28 19:19:11 +00:00
Charles Short
cc310a0d19 debian: Enable minimum required platform services
Systemd provides preset files which may be used to encode policy which
units shall be enabled by default and which ones shall be disabled.

Add:
- 99-default-disable.preset to disable all services by default
- 90-default.preset which aims to align with services enabled in CentOS
  This file was delivered via the systemd package under CentOS. Adjusted
  for Debian compatibility.
- 85-debpkg-issues.preset to align service enablement for StarlingX
  services where the current packaging is not enabling services
  correctly. This file is temporary until packaging issues are resolved.

This commit aims to add CentOS/Debian service enablement/disablement
compatibility post-installation.

Test Plan
PASS Build and Test ISO
PASS Test that services are disabled by default
PASS Test that AIO-SX StarlingX service are started if available

Change-Id: Icc952aa40b4844f9e793cbff92612dc77883fed1
Story: 2009101
Task: 44380
Co-Authored-By: Robert Church <robert.church@windriver.com>
Signed-off-by: Charles Short <charles.short@windriver.com>
Signed-off-by: Robert Church <robert.church@windriver.com>
2022-02-28 03:10:51 -05:00
Robert Church
7ba7c83297 debian: Allow ISO installs to proceed without user prompts
To avoid any previous ext4 file system signatures that could have been
present from previous installs, add lvcreate options to wipe signatures
and zero the first 4KiB of data in the LV. This will avoid requiring
user interaction.

 WARNING: ext4 signature detected on /dev/cgts-vg/scratch-lv at offset
 1080. Wipe it? [y/n]:

Change-Id: Ifeb0ddf193820a3e5d98006093813355d2494797
Story: 2009101
Task: 44628
Signed-off-by: Robert Church <robert.church@windriver.com>
2022-02-28 02:20:28 -05:00
Dan Voiculeasa
9b0fb8e455 debian: Add and patch dh-python package
This is a transient work that enables us to progress Debian
integration. This work affects only Debian.

Sysinv loads stevedore plugins. The logic is based on the fact that
the source files are listed in SOURCES.txt which is included in the
egg. The package that provides a plugin is determined by parsing
entry_point and distribution data. Distribution data loads
information from SOURCES.txt.

dh-python is used during build and silently removes the file that
sysinv expects to be present.

Patch the package to keep the file.

Skip CentOS tests because this is a Debian only package.
Debian tests:
PASS: build python package, build non-package python
PASS: SOURCES.txt present in .egg-info in python package

Partial-Bug: https://bugs.launchpad.net/starlingx/+bug/1955648
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Id45b1ba93f9ee88cc01a9cb1fb25527b8a5f1e19
2022-02-24 18:34:49 +00:00
Zuul
dce85a57fa Merge "debian: Add and patch python3-setuptools package" 2022-02-24 17:42:24 +00:00
Zuul
64e938528b Merge "Change default location of puppet-network interfaces file on Debian" 2022-02-24 15:27:48 +00:00
Dan Voiculeasa
ed19f486ac debian: Add and patch python3-setuptools package
This is a transient work that enables us to progress Debian
integration. This work affects only Debian.

Sysinv loads stevedore plugins. The logic is based on the fact that
the source files are listed in SOURCES.txt which is included in the
egg. The package that provides a plugin is determined by parsing
entry_point and distribution data. Distribution data loads
information from SOURCES.txt.

Setuptools doesn't copy the desired file to egg.
Patch python3-setuptools so it copies the file to egg.

Skip CentOS tests because this is a Debian only package.
Debian tests:
PASS: build python package, build non-package python
PASS: SOURCES.txt present in .egg-info in python package

Partial-Bug: https://bugs.launchpad.net/starlingx/+bug/1955648
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Ia318aa0ca6825adfa3d23159691486067d96d475
2022-02-24 15:19:54 +00:00
Zuul
d73f8209ac Merge "initramfs-ostree: fix re-installing ustart image error messages" 2022-02-24 14:35:06 +00:00