1522 Commits

Author SHA1 Message Date
Zuul
7696d576ad Merge "CentOS: upversion containerd and runc" 2022-03-10 20:23:18 +00:00
Zuul
939f4c964b Merge "integ: remove mlx4 from openvswitch" 2022-03-10 19:48:12 +00:00
Zuul
47e28ef893 Merge "Change default location of puppet-network routes file on Debian" 2022-03-10 16:41:27 +00:00
Andre Fernando Zanella Kantek
11cc1482ca Change default location of puppet-network routes file on Debian
In order to compare the difference between sysinv database and
currently configured static routes, the destination directory will be
changed to /var/run/network-scripts.puppet/

This new location will be used by apply_network_config script to
update modified configuration from the database and save the result
in /etc/network/routes be used during boot by ifupdown

Story: 2009101
Task: 44728

Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
Change-Id: I4ba06160c2cc7db2bfec061c09b9eb6a75961ce4
2022-03-10 13:54:02 +00:00
Zuul
52093f16ab Merge "meta_data.yaml: add sha256sum checksum" 2022-03-09 22:54:45 +00:00
Zuul
f9194f4194 Merge "Add k8s container cleanup" 2022-03-09 18:27:50 +00:00
Zuul
a6e650a340 Merge "debian: Clean up services starting" 2022-03-09 16:16:26 +00:00
Daniel Safta
f3c18b0f79 Add k8s container cleanup
When executing a reboot/shutdown
k8s pods are not receiving the SIGTERM
signal which leads some of them to
unexpected behaviour such as generating
huge coredumps.

There is an upstream issue regarding this:
https://github.com/kubernetes/kubernetes/issues/107158
The problem seems to be systemd related
but this commit addresses the problem
with a workaround.

This commit introduces a new script that
will cleanup all the remaing pods and will
be run after kubelet is stopped.

The script is executed successfully when
kubelet stops and the pods are stopped
before the system shuts down.

Closes-bug: 1964111
Signed-off-by: Daniel Safta <daniel.safta@windriver.com>
Change-Id: Ia0376aa510dd0dc3983e16cd89840726c15d6c92
2022-03-09 11:10:51 -05:00
Zuul
5582fbf4b5 Merge "CentOS: Uprev the containernetwork-plugins to 1.0.1" 2022-03-08 15:04:12 +00:00
Jiping Ma
94dbeb480d integ: remove mlx4 from openvswitch
The module mlx4 has been dropped in
mlnx-ofa_kernel-5.5-OFED.5.5.1.0.3.1. So remove mlx4 from openvswitch
after OFED driver upgrade. The infomation can be found in the part
"Unsupported Functionalities/Features/NICs" in this link:
https://docs.nvidia.com/networking/display/MLNXOFEDv551032/
General+Support where ConnectX-3 and ConnectX-3 Pro adapter card
represents use of mlx4.

Verification:
- Build success.
- Install success onto a StarlingX system with two controller and two
  compute nodes with network adapters Mellanox's OFED. The network
  adapters of controllers are Mellanox Technologies MT27710 Family
  [ConnectX-4 Lx], the network adapters of computes are Mellanox
  Teichnologies MT27800 Family [ConnectX-5].
- RDMA/Infiniband over Ethernet functionalities of the Mellanox adapters
  were successfully tested using the Linux RDMA community's perftest
  package.
- Test ovs-dpdk. It fails with both mlx driver version
  mlnx-ofa_kernel-5.3-OFED.5.3.1.0.0.1 and
  mlnx-ofa_kernel-5.5-OFED.5.5.1.0.3.1. The OFED v5.5 is not breaking
  anything new.

Story: 2009878
Task: 44652
Depends-On: https://review.opendev.org/c/starlingx/kernel/+/831461

Signed-off-by: Jiping Ma <jiping.ma2@windriver.com>
Change-Id: I5214ef6de1eb7c054e4fc544f113d67652f661fa
2022-03-08 09:54:48 -05:00
Zuul
acdd869a58 Merge "debian: Add ceph to debian_pkg_dirs" 2022-03-04 21:00:44 +00:00
Zuul
27ead659fa Merge "debian: Change systemd service presets for nfs" 2022-03-04 20:47:30 +00:00
Dan Voiculeasa
cd1d36e808 debian: Change systemd service presets for nfs
This work is part of Debian integration effort. This work
affects only Debian. This will unlock puppet manifest
apply at unlock.

Nfs utilities on Debian use different service names. Enable
them to allow puppet manifest for unlock progress. Otherwise
exportfs doesn't function without the services started.

Tests:
PASS: on an existing setup, manually enabled the services before
      unlock, did run unlock, progressed further than the error
PASS: build-pkgs && build-image
PASS: install iso
PASS: check nfs services are enabled

Story: 2009101
Task: 44380
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I41de2471074ecd3805f1cb1a74cbe3b976c01f9d
2022-03-04 20:10:19 +00:00
zulcss
bf88cd08f7 debian: Add ceph to debian_pkg_dirs
This work is part of the Debian integration efforts
This work only affects Debian.

Depends-On: https://review.opendev.org/c/starlingx/integ/+/831738

Debian tests:
PASS: build-pkgs
PASS: build-image
PASS: install

Story: 2009101
Task: 44402

Signed-off-by: Chuck Short <charles.short@windriver.com>
Change-Id: I48c513dba0fb07edc5413e8ba3b139430e53c8bd
2022-03-04 19:12:44 +00:00
Zuul
46b4bcfcfe Merge "Set provider mode when formatting network interfaces file on Debian" 2022-03-04 18:42:00 +00:00
Andre Fernando Zanella Kantek
d0a4cdcb1e Set provider mode when formatting network interfaces file on Debian
When the interfaces file is generated it is necessary to determine the
mode (vlan or raw) from the interface name. Originally the plugin
considers that a previous interfaces file exists and will use it to
set the mode value.

But on StarlingX network_config is generated by sysinv and there is no
previous file to parse, so this change adds the mode logic on
file formatting.

Test Plan:
PASS: generate valid ifupdown config when interface name is of format
      "vlanNNN" on Debian and apply it with ifup/ifdown command

Story: 2009101
Task: 44659

Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
Change-Id: Ibccd189ea14eed4b8504908188fabedfa6bf4c2a
2022-03-04 18:27:32 +00:00
Zuul
d7a0a4b720 Merge "Change openldap pid and args file location for Debian" 2022-03-04 16:19:06 +00:00
Chuck Short
8f11e0df76 debian: Clean up services starting
This commit does several things at once:
- Create a symlink for /etc/init.d/functions (centos) from
  /lib/lsb/init-functions, to maintain compatibility.
- Make /etc/systemd/system-preset so that when a service
  is installed it places a preset file in the directory.
- Remove hardcoded services.

Test Plan:
PASS Build package
PASS Build and install ISO
PASS check for symlink /etc/init.d/functions
PASS check for /etc/systemd/system-preset
PASS check for running services

Story: 2009101
Task: 44678

Signed-off-by: Chuck Short <charles.short@windriver.com>
Change-Id: I9c5ec7eb7177dd7dde954db5d0c3d3f602677ccd
2022-03-04 14:39:38 +00:00
Andy Ning
fc13f4db8b Change openldap pid and args file location for Debian
Change openldap pid and args file location from /var/run/slapd
to /run so it's aligned with CentOS. This will enable openldap
to be managed by SM.

Test Plan for Debian:
PASS: package build, image build
PASS: system boostrap
PASS: controller unlock, open-ldap service state in SM is
      enabled-active enabled-active

Story: 2009101
Task: 44664
Signed-off-by: Andy Ning <andy.ning@windriver.com>
Change-Id: I108a63d5b829b66ef24516f9e2c33fde0288f9a8
2022-03-03 11:41:22 -05:00
Yue Tao
4a709349a9 meta_data.yaml: add sha256sum checksum
Test Plan:
Pass: Verify sha256sum checksum via "download -s"

Story: 2008846
Task: 44578

Signed-off-by: Yue Tao <Yue.Tao@windriver.com>
Change-Id: I78d9dff2af0afb18c6db4e8d2d39ef79b5cf5864
2022-03-03 14:30:40 +08:00
Zuul
304571c85a Merge "debian: Remove postgres user from group/passwd files" 2022-03-02 20:05:43 +00:00
Steven Webster
9597dd7503 CentOS: Uprev the containernetwork-plugins to 1.0.1
This commit bumps the containernetwork-plugins package to v1.0.1.

This is part of the ongoing activity of refreshing kubernetes
components.  In this case, various bug fixes throughout the
plugins have been picked up.

Test Plan:

 - Successful build of the new package.
 - Plugin functional testing:
   main:
    bridge
    macvlan
    ipvlan
    vlan
    ptp
    host-device

   meta:
    sbr
    vrf
    tuning
    portmap
    bandwidth

   ipam:
    dhcp
    static
    host-local

Story: 2009832
Task: 44426

Change-Id: Id636b959cf500009b4f14bc10379a5edf969d032
Signed-off-by: Steven Webster <steven.webster@windriver.com>
2022-03-02 11:47:20 -05:00
Charles Short
d04b7a4c54 debian: Remove postgres user from group/passwd files
Removed user from group/passwd files to prevent a
conflict when the postgresql-common package is installed.

Story: 2009221
Task: 43417

Test Plan
PASS Apply patch build package
PASS Build base-passwd package
PASS Run build-image
PASS Check to see if postgresql is running when
     the image is running.
PASS Debootstrap

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: I885ed3467548013ad9c2be3d7d64fafad3703adc
2022-03-02 15:40:13 +00:00
Kaustubh Dhokte
298c333a76 CentOS: upversion containerd and runc
To align with kubernetes 1.21.8,
Upgrade containerd from version 1.4.6 to 1.4.11
Upgrade runc from version 1.0.0-rc95 to 1.0.2

We continue to use no_btrfs build flag for containerd
as we do not use btrfs

Test Plan:
Built an iso (CentOS) and installed on AIO-DX lab
PASS: Run basic docker, ctr, crictl and runc commands
      to create, list containers, images
PASS: Create new pods and PVCs and delete them
PASS: Lock-unlock and reboot hosts.
      Check all pods are up back

Story: 2009845
Task: 44456

Signed-off-by: Kaustubh Dhokte <kaustubh.dhokte@windriver.com>
Change-Id: I8e5ce0fd316e2e7f059c8abe5050732192f502a1
2022-03-02 02:35:09 -05:00
Zuul
0ebda405d8 Merge "debian: Enable minimum required platform services" 2022-02-28 19:19:11 +00:00
Charles Short
cc310a0d19 debian: Enable minimum required platform services
Systemd provides preset files which may be used to encode policy which
units shall be enabled by default and which ones shall be disabled.

Add:
- 99-default-disable.preset to disable all services by default
- 90-default.preset which aims to align with services enabled in CentOS
  This file was delivered via the systemd package under CentOS. Adjusted
  for Debian compatibility.
- 85-debpkg-issues.preset to align service enablement for StarlingX
  services where the current packaging is not enabling services
  correctly. This file is temporary until packaging issues are resolved.

This commit aims to add CentOS/Debian service enablement/disablement
compatibility post-installation.

Test Plan
PASS Build and Test ISO
PASS Test that services are disabled by default
PASS Test that AIO-SX StarlingX service are started if available

Change-Id: Icc952aa40b4844f9e793cbff92612dc77883fed1
Story: 2009101
Task: 44380
Co-Authored-By: Robert Church <robert.church@windriver.com>
Signed-off-by: Charles Short <charles.short@windriver.com>
Signed-off-by: Robert Church <robert.church@windriver.com>
2022-02-28 03:10:51 -05:00
Robert Church
7ba7c83297 debian: Allow ISO installs to proceed without user prompts
To avoid any previous ext4 file system signatures that could have been
present from previous installs, add lvcreate options to wipe signatures
and zero the first 4KiB of data in the LV. This will avoid requiring
user interaction.

 WARNING: ext4 signature detected on /dev/cgts-vg/scratch-lv at offset
 1080. Wipe it? [y/n]:

Change-Id: Ifeb0ddf193820a3e5d98006093813355d2494797
Story: 2009101
Task: 44628
Signed-off-by: Robert Church <robert.church@windriver.com>
2022-02-28 02:20:28 -05:00
Dan Voiculeasa
9b0fb8e455 debian: Add and patch dh-python package
This is a transient work that enables us to progress Debian
integration. This work affects only Debian.

Sysinv loads stevedore plugins. The logic is based on the fact that
the source files are listed in SOURCES.txt which is included in the
egg. The package that provides a plugin is determined by parsing
entry_point and distribution data. Distribution data loads
information from SOURCES.txt.

dh-python is used during build and silently removes the file that
sysinv expects to be present.

Patch the package to keep the file.

Skip CentOS tests because this is a Debian only package.
Debian tests:
PASS: build python package, build non-package python
PASS: SOURCES.txt present in .egg-info in python package

Partial-Bug: https://bugs.launchpad.net/starlingx/+bug/1955648
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Id45b1ba93f9ee88cc01a9cb1fb25527b8a5f1e19
2022-02-24 18:34:49 +00:00
Zuul
dce85a57fa Merge "debian: Add and patch python3-setuptools package" 2022-02-24 17:42:24 +00:00
Zuul
64e938528b Merge "Change default location of puppet-network interfaces file on Debian" 2022-02-24 15:27:48 +00:00
Dan Voiculeasa
ed19f486ac debian: Add and patch python3-setuptools package
This is a transient work that enables us to progress Debian
integration. This work affects only Debian.

Sysinv loads stevedore plugins. The logic is based on the fact that
the source files are listed in SOURCES.txt which is included in the
egg. The package that provides a plugin is determined by parsing
entry_point and distribution data. Distribution data loads
information from SOURCES.txt.

Setuptools doesn't copy the desired file to egg.
Patch python3-setuptools so it copies the file to egg.

Skip CentOS tests because this is a Debian only package.
Debian tests:
PASS: build python package, build non-package python
PASS: SOURCES.txt present in .egg-info in python package

Partial-Bug: https://bugs.launchpad.net/starlingx/+bug/1955648
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: Ia318aa0ca6825adfa3d23159691486067d96d475
2022-02-24 15:19:54 +00:00
Zuul
d73f8209ac Merge "initramfs-ostree: fix re-installing ustart image error messages" 2022-02-24 14:35:06 +00:00
Zuul
721e9b4d4d Merge "ostree/initramfs-ostree: fix partition index incorrect while StarlingX AIO host partitioning" 2022-02-24 14:34:57 +00:00
Zuul
c0e83bcbff Merge "ostree/initramfs-ostree: upgrade to version 20220220" 2022-02-24 14:34:50 +00:00
Zuul
41ee2780fe Merge "debian: Correctly install the StarlingX puppet.conf" 2022-02-24 14:34:41 +00:00
Andre Fernando Zanella Kantek
df184de40a Change default location of puppet-network interfaces file on Debian
In order to compare the difference between sysinv database and currently
configured interfaces the destination directory will be changed to
/var/run/network-scripts.puppet/

This new location will be used by apply_network_config script to
update modified configuration from the database and save the result
in /etc/network/interfaces.d/ to be used during boot

Story: 2009101
Task: 44570

Signed-off-by: Andre Fernando Zanella Kantek <AndreFernandoZanella.Kantek@windriver.com>
Change-Id: I0b54688ee4ce658a23ef6257481a44d96f29f441
2022-02-24 13:43:34 +00:00
Hongxu Jia
61889ee968 initramfs-ostree: fix re-installing ustart image error messages
While re-installing ustart image, there are some error messages:

- `blockdev --rereadpt ${dev}' always failed due to existed lvm
  volume group was not cleanup because of ustart image skip fat
  partition format (instsf=1). Then move the cleanup code ahead
  for both of skip and not skip situation

- Remove `-t $p:FFFF' from platform_backup partition which is
  not recognized by sgdisk

- Add `--yes' to vgcreate and lvcreate to avoid prompt hung

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Change-Id: I865bb95a8a00bbc4144d782d4ccd1a20fcf5eaa7

Test Plan:
- PASS: Download initramfs-ostree source tarball
- PASS: Build package initramfs-ostree
- PASS: Build Ustart image
- PASS: Install Ustart image
- PASS: Boot installed image, multiple partitions mounted to
        rootfs
- PASS: Reinstall Ustart image
- PASS: Boot installed image, multiple partitions mounted to
        rootfs

Story: 2008846
Task: 44545

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Change-Id: Ia771c7ee2e5dd7fa9d6946877738357e863411f5
2022-02-24 09:42:53 +08:00
Hongxu Jia
8eac15b4f2 ostree/initramfs-ostree: fix partition index incorrect while StarlingX AIO host partitioning
Due to commit [ostree/initramfs-ostree: upgrade to version
20220220] applied, it improved partition index update
which requires:

- Put grub_pt_update ahead of variable `end' assignment and

- The increment of partition index is 1

Test Plan:
- PASS: Download initramfs-ostree source tarball
- PASS: Build package initramfs-ostree
- PASS: Build Ustart image
- PASS: Install Ustart image
- PASS: Boot installed image, multiple partitions mounted to rootfs

Story: 2008846
Task: 44545

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Change-Id: I6d27576b20f31da280178be1c3c138b432cd5818
2022-02-24 09:42:53 +08:00
Hongxu Jia
203702bda9 ostree/initramfs-ostree: upgrade to version 20220220
Add kickstart hook to create partitions and make filesystem
on rootfs disk

From https://github.com/Wind-River/meta-lat

  e794442 lat installer: add kickstart hook to make filesystem
          on rootfs disk
  69aef5b lat installer: add kickstart hook to create partitions
          on rootfs disk
  c69260c lat installer: add kickstart hook to operate before
          partition
  a7a8f1e lat installer: no expand fluxdata partition conditionally
  2b545ba lat-installer: support no fluxdata partition for kickstart
  7dbad54 lat installer: correct kickstart %pre and %post parsing
  75d177c lat installer: add lat-installer.hook
  ef9be58 lat: add package lvm2 to debian initramfs and image
  0ea8a56 lat installer: correct grub partition index update
  e791b6f init-ostree-install.sh: calculate partition index while
          making fs for arm

Rebase 0002-debian-Add-CentOS-compatible-initial-AIO-partitionin.patch
to version 20220220

Test Plan:
- PASS: Download initramfs-ostree source tarball
- PASS: Build package initramfs-ostree
- PASS: Build ISO image
- PASS: PXE ostree install over IPv4, add hooks to kickstart which
        created multiple partitions on rootfs disk
- PASS: Boot installed image, multiple partitions mounted to rootfs

Story: 2008846
Task: 44545

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
Change-Id: Ib088ba49999d0c4de9415302abf4a09d66a3cf9c
2022-02-24 09:42:53 +08:00
Daniel Safta
c66d407614 Remove kubernetes 1.18, 1.19, 1.20 pkgs
The new minimum supported k8s version
will be 1.21. This commit cleans the pkg
files needed to build the old k8s versions.

The pkgs build successfully. Deployed on
AIO-SX and AIO-DX, the k8s services were running ok.

Story: 2009859
Task: 44498
Change-Id: Ib39e9d1522a49c5788240781c8edee2bdffbc97a
Signed-off-by: Daniel Safta <daniel.safta@windriver.com>
2022-02-23 15:24:03 +00:00
Robert Church
1d31c4dd06 debian: Correctly install the StarlingX puppet.conf
The upstream Debian package provides its own puppet.conf and hiera.yaml
files. The puppet.conf file is being installed and is overwriting the
desired patched puppet.conf file from the source patch
0005-Set-strict-variables-and-basemodulepath-in-puppet.co.patch.

Move the desired content to conffiles/puppet.conf, drop the source
patch, and allow the existing install directives to install the
StarlingX content.

This packaging should be revisited in the future to update
conffiles/hiera.yaml for what is required by StarlingX . This should
install the hiera.yaml (converted to v5) from the stx-puppet package and
drop the change from that package.

This should provide ordering compatibility between CentOS and Debian to
support dual OS development.

Test Plan:
 - Build package in Debian
 - Include package in Debian ISO
 - Install ISO and confirm contents of /etc/puppet/puppet.conf

Change-Id: Ibfc58ed64a413da5620a2f05247822ef76271ef7
Story: 2009101
Task: 44576
Signed-off-by: Robert Church <robert.church@windriver.com>
2022-02-22 20:56:18 -05:00
Zuul
5f474f3c2e Merge "Debian: Remove user directive from docker-registry service" 2022-02-18 14:51:47 +00:00
Zuul
e999bed3c5 Merge "debian: Copy /var/log directory to LVM volume." 2022-02-18 00:18:28 +00:00
Charles Short
2ab2d64966 debian: Copy /var/log directory to LVM volume.
When the image boots the LVM volume is mounted via /etc/fstab.
However it does not contain the log directories that services like
Keystone and Apache expect to be present in order for them to start.

This has a knock on affect later in bootstrap when Keystone tries
to restart the service when Keystone is started and it fails to
do so because /var/log/keystone is missing.

Test Plan:
PASS Apply patch
PASS Boot image check for /var/log/keystone.

Story: 2009221
Task: 43324

Signed-off-by: Charles Short <charles.short@windriver.com>
Change-Id: Ib716e48fba2fcf5896ca3f06fc2bae76d24aa05f
2022-02-17 15:30:35 -05:00
Zuul
21e1bdd25d Merge "Fix ceph-mon resize on AIO-DX" 2022-02-17 19:15:01 +00:00
Felipe Sanches Zanoni
1887fe0770 Fix ceph-mon resize on AIO-DX
The system command for resizing ceph-mon partition is disabled
for AIO-DX setup because it is broken.

The problem is that DRBD filesystem is not handled correctly
when the ceph-mon lvm partition is resized.

Updating the DRBD metadata for the ceph-mon partition with
'drbdmadm apply-al' command fixed the problem.

Test-Plan: Install the system with ceph backend and try to resize
           the ceph-mon partition with 'system ceph-mon-modify'
           command.
    PASS: Fresh install and ceph-mon resizing on AIO-SX
    PASS: Fresh install and ceph-mon resizing on AIO-DX

Story: 2009861
Task: 44526

Signed-off-by: Felipe Sanches Zanoni <Felipe.SanchesZanoni@windriver.com>
Change-Id: I734238c94575c94ea59937b72471de940735fe1b
2022-02-17 07:45:13 -05:00
Zuul
5d4379c7d0 Merge "debian: Add grubby to debian_pkg_dirs" 2022-02-17 00:45:09 +00:00
Dan Voiculeasa
703f79a795 debian: Add grubby to debian_pkg_dirs
This work is part of Debian integration efforts.
This work affects only Debian

Enable grubby to be built.

Debian tests:
PASS: build-pkgs
PASS: build-image
PASS: install
PASS: bootstrap

Story: 2009101
Task: 44402
Signed-off-by: Dan Voiculeasa <dan.voiculeasa@windriver.com>
Change-Id: I567f51828b6e10f3b0be2d404f1870829b0c9399
2022-02-16 17:30:23 +02:00
Zuul
c4a1de6a6d Merge "ostree: upgrade to version 20220213" 2022-02-15 20:00:11 +00:00
Fabricio Henrique Ramos
a9bbdc4d55 Debian: Remove user directive from docker-registry service
By removing:
User=docker-registry
the service now runs as user root which allows ansible to use the
registry without hitting permissions issues.

Test Plan:

Pass: Execute ansible playbook in Debian OS
Pass: Service is active (running) after ansible playbook

Story: 2009101
Task: 44419

Signed-off-by: Fabricio Henrique Ramos <fabriciohenrique.ramos@windriver.com>
Change-Id: I06f3b0ed19d60400630bd01d3ae115fe44b6582b
2022-02-15 14:57:44 -03:00