184 Commits

Author SHA1 Message Date
Dmitry Tantsur
a28b8fa5bc Support installing with Python 3 on CentOS 7
RHEL/CentOS 8 dropped support for some older hardware that is still
in use. Since CentOS 7 has Python 3, let's support it for now.

Also fixes an issue with C.UTF-8 locale which does not seem to work on
CentOS 7 (and actually causes a failure with newer python packages).

Change-Id: I1b5797b030ef896ad4b2a95a504a0215ca6ee574
2.1.0
2020-07-31 18:12:28 +02:00
Julia Kreger
040e5f2ce0 Log IPv6 configuration status for tinycore
We're seeing some job failures with IPv6 when tinycore is
getting pulled in for rackspace hosts. The underlying issue
appears to be that we don't have an IPv6 route in the kernel.

First step, get more data.

Change-Id: I5b478893a2f114bdbeee53af5f44dc8139b02c52
2020-07-28 06:25:34 -07:00
Zuul
5c9bc36232 Merge "Add dynamic-login to our published images by default" 2020-07-27 12:28:46 +00:00
Zuul
597955d366 Merge "Strip some excess from the centos dib image" 2020-07-27 11:00:32 +00:00
Dmitry Tantsur
4a415504f3 Add dynamic-login to our published images by default
It's very useful for debugging and does not expose access by default.

Change-Id: I3d34d65b5536a0a06184da44e12b8534c29300e5
2020-07-23 22:35:23 +02:00
Julia Kreger
a1c3a1668a Strip some excess from the centos dib image
Strips postfix gcc make from Centos based builds in
an attempt to reduce the overall sie of the ramdisk as C development
utilties are not needed on a ramdisk and better to not have present
on a machine as it complicates attacks to take over and launch to
additional hosts.

Postfix is also present in the ramdisk and is not needed as the
ramdisk has no use for a mail transport agent.

Also removes the GeoIP data files which are not needed by the ramdisk.

Change-Id: I7627e8a3d4924a672af37a468870ba92604e2e66
2020-07-21 19:58:51 +00:00
Zuul
3e5ad55637 Merge "Add Tripleo IPA build image job in zuul layout" 2020-07-21 10:53:01 +00:00
Zuul
1b8167037e Merge "[tinyipa] Fix getting MTU via dhcp" 2020-07-21 06:52:37 +00:00
Sandeep Yadav
a41ec9dc40 Add Tripleo IPA build image job in zuul layout
With this patch we are adding tripleo IPA build image job for C8:-

* tripleo-buildimage-ironic-python-agent-centos-8

We introduced this job as non voting.

Change-Id: If7e4e44e4f3d0606206e2212f7d8ca4945cd7ec7
2020-07-20 19:53:04 +05:30
Zuul
c2daa39961 Merge "Set min version of tox to 3.2.1" 2020-07-18 20:31:10 +00:00
vmud213
541e8587a8 Fixes DIB_IPA_CERT certificate copy issue
When copying the DIB_IPA_CERT certificate to certificate bundle the script
fails due to incorrect print usage in python3

Change-Id: If130594b9ea041409c68498f1ae2239578217d07
2020-07-17 07:13:28 +00:00
Riccardo Pittau
654e9c729e Set min version of tox to 3.2.1
As recommended, since version 3.2.0 tox switches pip invocations
to use the module -m pip instead of direct invocation.
We set min version to 3.2.1 [1] to also fix the behavior of
--parallel--safe-build

[1] https://tox.readthedocs.io/en/latest/changelog.html#v3-2-1-2018-08-10

Change-Id: I79338f6a5c67e189dfd6783ab40d2e6bd7d8b628
2020-07-15 15:43:52 +02:00
Riccardo Pittau
82a1ba0c78 Build tinyipa on focal
Use new ubuntu-focal nodeset to build tinyipa images.
This is needed to prepare to build tinyipa images based on
tinycore 11.x because we need the new kernel 5.x version to
be able to chroot.

Main changes:
- patching tce-load to conform to new squashfs options in the new
kernel
- installing python3-pip instead of python-pip

Story: 2007753
Task: 39943

Change-Id: I3d8a1ab84cae3c7185eb4f9bfefe239fab49a012
2020-07-03 09:28:58 +00:00
Dmitry Tantsur
2a19fa368c Disable EPEL on CentOS 8 by default
It's currently broken and not really needed anyway.

Depends-On: https://review.opendev.org/#/c/738435/
Change-Id: I767f6fc4e4177af5f7f93a0d4d3f8dcc578da2c4
2020-06-29 16:32:10 +02:00
Vasyl Saienko
ddd631aacb [tinyipa] Fix getting MTU via dhcp
The patch updates udhcpc script to handle MTU option advertised
by DHCP server.

Change-Id: I2708b71abfe3bc24089f4a51514d362da1491c66
2020-06-24 14:58:51 +00:00
Zuul
2063b5814d Merge "Disable automatic updates in dnf-based systems" 2020-06-24 10:18:41 +00:00
Dmitry Tantsur
e9d0443573 Run ensure-pip in the build/check jobs
It is no longer included automatically.

Change-Id: I15c6459c439e25b01929a89457896abc9090581a
2020-06-22 14:16:02 +02:00
Riccardo Pittau
02d9abd43b Disable automatic updates in dnf-based systems
Fix errors caused by dnf automatic updates that are not really
needed in ipa ramdisks.

Change-Id: I541252fc5137aec755b9feb4f15b888a71c3c1be
Story: 2007805
Task: 40067
2020-06-17 09:09:55 +02:00
Zuul
cb415eff90 Merge "Fix python-dev package mapping" 2020-06-08 17:37:56 +00:00
Kaifeng Wang
074ff4b4e9 Fix python-dev package mapping
Rename the python development package to the correct name python-devel.

Change-Id: I320b6ec08a1f7c8f8ee833cab86e7942653417f9
2020-06-08 08:46:31 +08:00
Riccardo Pittau
1ae521b359 Install missing ffi development library
The ffi development library is needed to install ipa.

Change-Id: I663c5510552ac48d5f7de4512c297142aaf0b23a
2020-06-05 14:40:24 +02:00
Andreas Jaeger
16a734a0ea Switch to newer openstackdocstheme and reno versions
Switch to openstackdocstheme 2.2.1 and reno 3.1.0 versions. Using
these versions will allow especially:
* Linking from HTML to PDF document
* Allow parallel building of documents
* Fix some rendering problems

Update Sphinx version as well.

Set openstackdocs_pdf_link to link to PDF file. Note that
the link to the published document only works on docs.openstack.org
where the PDF file is placed in the top-level html directory. The
site-preview places the PDF in a pdf directory.

Disable openstackdocs_auto_name to use 'project' variable as name.

Change pygments_style to 'native' since old theme version always used
'native' and the theme now respects the setting and using 'sphinx' can
lead to some strange rendering.

openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.

See also
http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014971.html

Change-Id: Idbe930500bc7988d7e1d78cff3f39beae775db89
2020-05-21 13:47:58 +00:00
Zuul
cd4c965aac Merge "Add releasenotes link to README" 2020-05-20 21:47:00 +00:00
Zuul
a556157385 Merge "Change ownership of tce info dir" 2020-05-19 08:49:47 +00:00
lidong
94348514c7 Add releasenotes link to README
Change-Id: I8fae29dd0656530c3331a70866cff554ad5e495b
2020-05-19 14:49:48 +08:00
Zuul
3a976118e0 Merge "Install linux-firmware in DIB images" 2020-05-18 17:05:45 +00:00
Dmitry Tantsur
79cd8ed97e Install linux-firmware in DIB images
It's removed as of https://review.opendev.org/#/c/675547/ but is
actually required for bare metal.

Story: #2007385
Task: #38969
Depends-On: https://review.opendev.org/727171
Change-Id: I7e924cf58df90d957afce8a058b575643527284b
2020-05-12 14:07:52 +02:00
Iury Gregory Melo Ferreira
53d67f38df Update tox.ini
Bump minversion to 3.1.0 so we can use `ignore_basepython_conflict`
Added ignore_basepython_conflict, this will ensure we are testing with
the correct python version, see [1] for more details.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014809.html

Change-Id: I2a13efdd19da8eb114b1dd510f32bf0d78110c8b
2020-05-11 19:54:57 +02:00
Riccardo Pittau
bd780bf0d4 Change ownership of tce info dir
The tce-load command saves info of installed packages under
/usr/local/tce.installed that is created during the build process
by the root user.
That will cause access and writing issues when running tce-load
as normal user, and we shouldn't run tce-load as root.

Change-Id: I2c369bc0280b3b73339fb49c2d257555d9d2d937
2020-05-07 18:55:21 +02:00
Riccardo Pittau
dd90f32dfe Upgrade flake8-import-order version to 0.17.1
Full py3 compatible version.
Add all Python3 modules to stdlib list.
Also includes fix to an enum34 dependency bug.

Change-Id: I5eda08276c267c0866067bad1daa73513019b9b6
2.0.0
2020-04-21 16:08:55 +02:00
Kaifeng Wang
b7000b9623 [Trivial] Doc update on the stable-interface-names
Consistent interface naming is helpful in collecting introspection
data and final instance system.

Change-Id: I8d434f7f8412734a540b797255abb6391325f434
2020-04-20 08:51:39 +08:00
Andreas Jaeger
9fddc46bdc Cleanup py27 support
This repo is now testing only with Python 3, so let's make
a few cleanups:
- Remove python 2.7 stanza from setup.py
- Remove obsolete sections from setup.cfg
- Update requirements, no need for python_version anymore
- Switch to using sphinx-build
- Cleanup doc/source/conf.py to remove now obsolete content.
- Use newer openstackdocstheme version
- Remove install_command from tox.ini, the default is fine
- Update hacking to version 3

Change-Id: I7e9e3993aeb05fb623be531160e418572fa9de54
2020-04-16 18:52:41 +02:00
Riccardo Pittau
6349de8be8 Install e2fsprogs in dib images
The e2fsprogs package is mandatory if we want to create ext4
filesystem.

Story: 2007522
Task: 39312

Change-Id: I1f5fa1a15ec92ccb917670df8fc33abb83135ff9
2020-04-06 10:54:53 +02:00
waleed mousa
075cf46faf Add DIB_REPOREF_requirements when building images using a specific branch
When using a specific branch of ironic-python-agent for building
ironic images, we need to specefiy also the openstack/requirements
branch:

Change-Id: I259b5644150fe78018e2e0a6a4d719b973ab462f
2020-03-29 18:35:45 +00:00
Zuul
0f20afb478 Merge "Use variables for ssh paths" 2020-03-19 13:14:43 +00:00
Zuul
04afab4b58 Merge "Workaround for missing adjtime file" 2020-03-19 13:14:42 +00:00
Riccardo Pittau
919b8f6e42 Workaround for missing adjtime file
The adjtime file used by hwclock in tinycore is /var/lib/hwclock/adjtime
but for some reason (bug?) the file is not created when hwclock is
invoked, causing hwclock to fail when using certain options, for example
--systohc.
We create the dir and the file to prevent that.

Change-Id: I86d7adac22be1890b271fd65a4bc49a7ab0a77bf
2020-03-18 14:33:01 +01:00
Riccardo Pittau
394aec4f79 Use python3 binary for all operations
When USE_PYTHON3 is True we should use the python3 binary for all
the image building process.

Change-Id: I92e30ee4018e5412e23caaa786d508674fd99b4f
2020-03-18 09:57:38 +01:00
Riccardo Pittau
c7ec10668d Use variables for ssh paths
Converting ssh related paths to variables.

Change-Id: Ia6f272ca6439ab7731194ad37e6ccc62f1a90f87
2020-03-10 17:44:40 +01:00
Zuul
b32f4ea891 Merge "Use train branch for centos7 job" 2020-03-02 12:50:02 +00:00
Riccardo Pittau
16382930ad Use train branch for centos7 job
We save centos7 job using it to test train stable branch.

Change-Id: I73847d16ac7e045240dbc659021442dc0517e669
2020-02-20 15:05:39 +01:00
Riccardo Pittau
044ae3f2d6 Force DIB_PYTHON_VERSION to 3 for Debian
Since more and more python libraries are removing support for
Python 2 in the latest versions, we need to force the version of
Python used to build the DIB Debian image to 3, at least until
DIB fully converts to Python 3.

Change-Id: I8e6f15635754ab917562d758c35a8c5f4629efdf
2020-02-20 10:25:49 +01:00
Riccardo Pittau
ca27668c00 Make Ubuntu Bionic job green again
Changes to make the ubuntu bionic job working correctly again.

Change-Id: Ib8002acc35ddf3c4ab736698cef71273c965d732
2020-02-19 13:16:18 +00:00
Riccardo Pittau
dd4110adc5 Upgrade pip if it's too old
We upgrade pip only if the version is too old to not support the
-c option.

Change-Id: I6e633debb2bf97f397a4b3d252c25e4a41992a8d
2020-02-19 14:10:16 +01:00
Zuul
dbfbe1f451 Merge "Add ntpdate/ntpclient/chrony" 2020-02-18 16:40:20 +00:00
Julia Kreger
789ebe1e95 Add ntpdate/ntpclient/chrony
Adds ntpdate to the binary package list for the diskimage-builder
element, and added ntpclient to the tinycore package list and added
a small shim to wrap ntpclient as ntpdate is not a native tinycore
package.

For larger ramdisks, we attempt to use chrony, which superceeds the ntp
package as a combined time server and client.

Change-Id: If99f2df31af8e4d41ad7813d25f0d779abc23f7a
Needed-By: https://review.opendev.org/#/c/707911/
2020-02-17 13:11:04 -08:00
Riccardo Pittau
531167c2d5 Upgrade to tinycore 10.x
Upgrading tinycore from version 9.x to 10.x
This change was merged [1] and reverted [2], let's give it another
try and eventually discuss about possible issues.

[1] https://review.opendev.org/688411
[2] https://review.opendev.org/698098

Change-Id: I831b414461f77c65e34b0f357763e38e74e65e29
2020-02-10 14:55:56 +01:00
Julia Kreger
ae327bb1ca Add extra filesystem support
Tinycore needs xfs support in order to be used in certian
low memory testing situtions with images that prefer
to use XFS as the filesystem.

Change-Id: Ief9c04a57c3e3249ddf081b249aa583169065582
2020-02-08 13:02:26 -08:00
Zuul
622949a698 Merge "Revert "Test artifact publishing via AFS"" 2020-02-07 08:40:55 +00:00
Zuul
f2c5f0c402 Merge "Test artifact publishing via AFS" 2020-02-06 10:12:00 +00:00