Upstream testing results of CIP IEC Layer packages

1. Introduction

This document captures the Debian CI autopkgtest results of security related packages added in CIP IEC layer as well as the functional test reports generated by testing the upstream packages with the steps provided by the developers.

2. Scope

CIP install more than a hundered Debian packages to form their base system but since this requirement belongs to IEC 62443-4-1, only test results of packages included in CIP to meet IEC 62443-4-2 are captured in this document.

3. Autopkgtest results in Debian CI

Binary Package	Source package	Link
acl	acl	https://ci.debian.net/packages/a/acl/
adduser	adduser	https://ci.debian.net/packages/a/adduser/
aide	aide	https://ci.debian.net/packages/a/aide/
aide-common	aide	https://ci.debian.net/packages/a/aide/
apt	apt	https://ci.debian.net/packages/a/apt/
audispd-plugins	audit	https://ci.debian.net/packages/a/audit/
auditd	audit	https://ci.debian.net/packages/a/audit/
bsdutils	util-linux	https://ci.debian.net/packages/u/util-linux/
chrony	chrony	https://ci.debian.net/packages/c/chrony/
dash	dash	https://ci.debian.net/packages/d/dash/
debianutils	debianutils	https://ci.debian.net/packages/d/debianutils/
dpkg	dpkg	https://ci.debian.net/packages/d/dpkg/
e2fsprogs	e2fsprogs	https://ci.debian.net/packages/e/e2fsprogs/
gcc-12-base	gcc-12-base	https://ci.debian.net/packages/g/gcc-12/
gpgv	gpgv	https://ci.debian.net/packages/g/gnupg2/
grep	grep	https://ci.debian.net/packages/g/grep/
gzip	gzip	https://ci.debian.net/packages/g/gzip/
ifupdown	ifupdown	https://ci.debian.net/packages/i/ifupdown/
init	init-system-helpers	https://ci.debian.net/packages/i/init-system-helpers/
init-system-helpers	init-system-helpers	https://ci.debian.net/packages/i/init-system-helpers/
initramfs-tools	initramfs-tools	https://ci.debian.net/packages/i/initramfs-tools/
initramfs-tools-core	initramfs-tools	https://ci.debian.net/packages/i/initramfs-tools/
iproute2	iproute2	https://ci.debian.net/packages/i/initramfs-tools/
klibc-utils	klibc	https://ci.debian.net/packages/k/klibc/
libacl1	acl	https://ci.debian.net/packages/a/acl/
libapparmor1	apparmor	https://ci.debian.net/packages/a/apparmor/
libapt-pkg6.0	apt	https://ci.debian.net/packages/a/apt/
libarchive13	libarchive	https://ci.debian.net/packages/liba/libarchive/
libargon2-1	argon2	https://ci.debian.net/packages/a/argon2/
libattr1	attr	https://ci.debian.net/packages/a/attr/
libaudit-common	audit	https://ci.debian.net/packages/a/audit/
libaudit1	audit	https://ci.debian.net/packages/a/audit/
libauparse0	audit	https://ci.debian.net/packages/a/audit/
libblkid1	util-linux	https://ci.debian.net/packages/u/util-linux/
libbrotli1	brotli	https://ci.debian.net/packages/b/brotli/
libbsd0	libbsd	https://ci.debian.net/packages/libb/libbsd/
libbz2-1.0	bzip2	https://ci.debian.net/packages/b/bzip2/
libc-bin	glibc	https://ci.debian.net/packages/g/glibc/
libc-l10n	glibc	https://ci.debian.net/packages/g/glibc/
libc6	glibc	https://ci.debian.net/packages/g/glibc/
libcap2	libcap2	https://ci.debian.net/packages/libc/libcap2/
libcap2-bin	libcap2	https://ci.debian.net/packages/libc/libcap2/
libcom-err2	e2fsprogs	https://ci.debian.net/packages/e/e2fsprogs/
libcrypt1	libxcrypt	https://ci.debian.net/packages/libx/libxcrypt/
libcryptsetup12	cryptsetup	https://ci.debian.net/packages/c/cryptsetup/
libcurl3-gnutls	curl	https://ci.debian.net/packages/c/curl/
libcurl4	curl	https://ci.debian.net/packages/c/curl/
libedit2	libedit	https://ci.debian.net/packages/libe/libedit/
libexpat1	expat	https://ci.debian.net/packages/e/expat/
libext2fs2	e2fsprogs	https://ci.debian.net/packages/e/e2fsprogs/
libfdisk1	util-linux	https://ci.debian.net/packages/u/util-linux/
libgcc-s1	gcc-12	https://ci.debian.net/packages/g/gcc-12/
libgdbm-compat4	gdbm	https://ci.debian.net/packages/g/gdbm/
libgdbm6	gdbm	https://ci.debian.net/packages/g/gdbm/
libglib2.0-0	glib2.0	https://ci.debian.net/packages/g/glib2.0/
libgmp10	gmp	https://ci.debian.net/packages/g/gmp/
libgnutls30	gnutls28	https://ci.debian.net/packages/g/gnutls28/
libgomp1	gcc-12	https://ci.debian.net/packages/g/gcc-12/
libgpg-error0	libgpg-error	https://ci.debian.net/packages/libg/libgpg-error/
libgssapi-krb5-2	krb5	https://ci.debian.net/packages/k/krb5/
libicu72	icu	https://ci.debian.net/packages/i/icu/
libidn2-0	libidn2	https://ci.debian.net/packages/libi/libidn2/
libip4tc2	iptables	https://ci.debian.net/packages/i/iptables/
libjson-c5	json-c	https://ci.debian.net/packages/j/json-c/
libk5crypto3	krb5	https://ci.debian.net/packages/k/krb5/
libkeyutils1	keyutils	https://ci.debian.net/packages/k/keyutils/
libklibc	klibc	https://ci.debian.net/packages/k/klibc/
libkrb5-3	krb5	https://ci.debian.net/packages/k/krb5/
libkrb5support0	krb5	https://ci.debian.net/packages/k/krb5/
libldap-2.5-0	openldap	https://ci.debian.net/packages/o/openldap/
liblzma5	xz-utils	https://ci.debian.net/packages/x/xz-utils/
libmd0	libmd	https://ci.debian.net/packages/libm/libmd/
libmount1	util-linux	https://ci.debian.net/packages/u/util-linux/
libnftables1	nftables	https://ci.debian.net/packages/n/nftables/
libnghttp2-14	nghttp2	https://ci.debian.net/packages/n/nghttp2/
libpam-modules	pam	https://ci.debian.net/packages/p/pam/
libpam-modules-bin	pam	https://ci.debian.net/packages/p/pam/
libpam-runtime	pam	https://ci.debian.net/packages/p/pam/
libpam0g	pam	https://ci.debian.net/packages/p/pam/
libperl5.36	perl	https://ci.debian.net/packages/p/perl/
libproc2-0	procps	https://ci.debian.net/packages/p/procps/
libpsl5	libpsl	https://ci.debian.net/packages/libp/libpsl/
libpython3.11-minimal	python3.11	https://ci.debian.net/packages/p/python3.11/
libpython3.11-stdlib	python3.11	https://ci.debian.net/packages/p/python3.11/
libsasl2-2	cyrus-sasl2	https://ci.debian.net/packages/c/cyrus-sasl2/
libsasl2-modules-db	cyrus-sasl2	https://ci.debian.net/packages/c/cyrus-sasl2/
libseccomp2	libseccomp	https://ci.debian.net/packages/libs/libseccomp/
libselinux1	libselinux	https://ci.debian.net/packages/libs/libselinux/
libsmartcols1	util-linux	https://ci.debian.net/packages/u/util-linux/
libss2	e2fsprogs	https://ci.debian.net/packages/e/e2fsprogs/
libssh2-1	libssh2	https://ci.debian.net/packages/libs/libssh2/
libssl3	openssl	https://ci.debian.net/packages/o/openssl/
libstdc++6	gcc-12	https://ci.debian.net/packages/g/gcc-12/
libsystemd-shared	systemd	https://ci.debian.net/packages/s/systemd/
libsystemd0	systemd	https://ci.debian.net/packages/s/systemd/
libtasn1-6	libtasn1-6	https://ci.debian.net/packages/libt/libtasn1-6/
libtirpc-common	libtirpc	https://ci.debian.net/packages/libt/libtirpc/
libtirpc3	libtirpc	https://ci.debian.net/packages/libt/libtirpc/
libudev1	systemd	https://ci.debian.net/packages/s/systemd/
libuuid1	util-linux	https://ci.debian.net/packages/u/util-linux/
libwebsockets17	libwebsockets	https://ci.debian.net/packages/libw/libwebsockets/
libwolfssl35	wolfssl	https://ci.debian.net/packages/w/wolfssl/
libwrap0	tcp-wrappers	https://ci.debian.net/packages/t/tcp-wrappers/
libxml2	libxml2	https://ci.debian.net/packages/libx/libxml2/
libxtables12	iptables	https://ci.debian.net/packages/i/iptables/
libzstd1	libzstd	https://ci.debian.net/packages/libz/libzstd/
locales	glibc	https://ci.debian.net/packages/g/glibc/
login	shadow	https://ci.debian.net/packages/s/shadow/
logsave	e2fsprogs	https://ci.debian.net/packages/e/e2fsprogs/
mawk	mawk	https://ci.debian.net/packages/m/mawk/
mount	util-linux	https://ci.debian.net/packages/u/util-linux/
nftables	nftables	https://ci.debian.net/packages/n/nftables/
openssh-client	openssh	https://ci.debian.net/packages/o/openssh/
openssh-server	openssh	https://ci.debian.net/packages/o/openssh/
openssh-sftp-server	openssh	https://ci.debian.net/packages/o/openssh/
openssl	openssl	https://ci.debian.net/packages/o/openssl/
passwd	shadow	https://ci.debian.net/packages/s/shadow/
perl	perl	https://ci.debian.net/packages/p/perl/
perl-base	perl	https://ci.debian.net/packages/p/perl/
perl-modules-5.36	perl	https://ci.debian.net/packages/p/perl/
procps	procps	https://ci.debian.net/packages/p/procps/
python3.11	python3.11	https://ci.debian.net/packages/p/python3.11/
python3.11-minimal	python3.11	https://ci.debian.net/packages/p/python3.11/
runit-helper	dh-runit	https://ci.debian.net/packages/d/dh-runit/
sed	sed	https://ci.debian.net/packages/s/sed/
sensible-utils	sensible-utils	https://ci.debian.net/packages/s/sensible-utils/
sgml-base	sgml-base	https://ci.debian.net/packages/s/sgml-base/
ssh	openssh	https://ci.debian.net/packages/o/openssh/
sudo	sudo	https://ci.debian.net/packages/s/sudo/
systemd	systemd	https://ci.debian.net/packages/s/systemd/
systemd-sysv	systemd	https://ci.debian.net/packages/s/systemd/
sysuser-helper	dh-sysuser	https://ci.debian.net/packages/d/dh-sysuser/
tpm2-abrmd	tpm2-abrmd	https://ci.debian.net/packages/t/tpm2-abrmd/
tpm2-tools	tpm2-tools	https://ci.debian.net/packages/t/tpm2-tools/
tzdata	tzdata	https://ci.debian.net/packages/t/tzdata/
udev	systemd	https://ci.debian.net/packages/s/systemd/
util-linux	util-linux	https://ci.debian.net/packages/u/util-linux/
util-linux-extra	util-linux	https://ci.debian.net/packages/u/util-linux/
uuid-runtime	util-linux	https://ci.debian.net/packages/u/util-linux/

4. Packages with no Debian CI results but has upstream tests

Binary Package	Source package	Link
bash	bash	https://salsa.debian.org/debian/bash/-/tree/debian/master/tests?ref_type=heads
coreutils	coreutils	https://salsa.debian.org/gioele/coreutils/-/tree/debian/latest/tests?ref_type=heads
cpio	cpio	https://salsa.debian.org/lamby/pkg-cpio/-/tree/debian/experimental/tests
debconf	debconf	https://salsa.debian.org/pkg-debconf/debconf/-/tree/master/Test?ref_type=heads
debian-archive-keyring	debian-archive-keyring	https://salsa.debian.org/debian-keyring/keyring/-/tree/master/t?ref_type=heads
diffutils	diffutils	https://sources.debian.org/src/diffutils/1%3A3.8-4/tests/
dmsetup	lvm2	https://salsa.debian.org/lvm-team/lvm2/-/tree/main/test/unit?ref_type=heads
fail2ban	fail2ban	https://salsa.debian.org/python-team/packages/fail2ban/-/tree/master/fail2ban/tests?ref_type=heads
iputils-ping	iputils	https://salsa.debian.org/debian/iputils/-/tree/master/test?ref_type=heads
isc-dhcp-client	isc-dhcp	https://salsa.debian.org/debian/isc-dhcp/-/tree/master/tests?ref_type=heads
kmod	kmod	https://salsa.debian.org/md/kmod/-/tree/master/testsuite?ref_type=heads
libb2-1	libb2	https://salsa.debian.org/debian/libb2/-/blob/master/src/blake2b-test.c?ref_type=heads
libbpf1	libbpf	https://github.com/sudipm-mukherjee/libbpf/blob/master/ci/vmtest/run_selftests.sh
libbtrfsutil1	btrfs-progs	https://salsa.debian.org/debian/btrfs-progs/-/tree/debian/tests
libcap-ng0	libcap-ng	https://salsa.debian.org/haava/libcap-ng/-/blob/master/test-driver?ref_type=heads
libcbor0.8	libcbor	https://salsa.debian.org/debian/libcbor/-/tree/master/test?ref_type=heads
libconfig9	libconfig	https://github.com/hyperrealm/libconfig/tree/master/tests
libdb5.3	db5.3	https://salsa.debian.org/debian/db5.3/-/tree/master/test?ref_type=heads
libdebconfclient0	cdebconf	https://salsa.debian.org/installer-team/cdebconf/-/tree/master/src/test?ref_type=heads
libdevmapper1.02.1	lvm2	https://salsa.debian.org/lvm-team/lvm2/-/tree/main/test/unit?ref_type=heads
libelf1	elfutils	https://github.com/roolebo/elfutils/tree/master/tests
libffi8	libffi	https://salsa.debian.org/dtorrance/libffi/-/tree/ppa/bionic/testsuite?ref_type=heads
libfido2-1	libfido2	https://salsa.debian.org/auth-team/libfido2/-/blob/debian/sid/debian/run-regression-tests.sh?ref_type=heads
libgcrypt20	libgcrypt20	https://github.com/pexip/os-libgcrypt20/tree/master/tests
libgpiod2	libgpiod	https://salsa.debian.org/debian/libgpiod/-/tree/debian/master/tests?ref_type=heads
libhogweed6	nettle	https://salsa.debian.org/holmgren/nettle/-/tree/master/testsuite?ref_type=heads
libivykis0	ivykis	https://github.com/buytenh/ivykis/tree/master/test
libjansson4	jansson	https://salsa.debian.org/debian/jansson/-/tree/master/test?ref_type=heads
libkmod2	kmod	https://salsa.debian.org/md/kmod/-/tree/master/testsuite?ref_type=heads
liblockfile-bin	liblockfile	https://github.com/miquels/liblockfile/blob/master/run-tests.sh
liblockfile1	liblockfile	https://github.com/miquels/liblockfile/blob/master/run-tests.sh
liblua5.3-0	lua5.3	https://github.com/lua/lua/tree/v5.3/testes
liblz4-1	lz4	https://salsa.debian.org/debian/lz4/-/tree/master/tests?ref_type=heads
libmhash2	mhash	https://salsa.debian.org/debian/mhash/-/tree/master/src?ref_type=heads
libncursesw6	ncurses	https://salsa.debian.org/debian/ncurses/-/tree/master/test?ref_type=heads
libnet1	libnet	https://github.com/libnet/libnet/tree/master/test
libnettle8	nettle	https://salsa.debian.org/holmgren/nettle/-/tree/master/testsuite?ref_type=heads
libnftnl11	libnftnl	https://salsa.debian.org/pkg-netfilter-team/pkg-libnftnl/-/tree/master/tests?ref_type=heads
libp11-kit0	p11-kit	https://github.com/p11-glue/p11-kit/tree/master/p11-kit
libpam-google-authenticator	google-authenticator	https://salsa.debian.org/debian/google-authenticator-libpam/-/tree/debian/master/tests?ref_type=heads
libpcre2-8-0	pcre2	https://salsa.debian.org/debian/pcre2/-/blob/master/test-driver?ref_type=heads
libpcre3	pcre3	https://github.com/pexip/os-pcre3/blob/master/test-driver
libpcsclite1	pcsc-lite	https://github.com/LudovicRousseau/PCSC/tree/master/UnitaryTests
libqrencode4	qrencode	https://salsa.debian.org/debian/qrencode/-/tree/debian/tests?ref_type=heads
librsync2	librsync	https://salsa.debian.org/debian/rsync/-/tree/debian/master/testsuite?ref_type=heads
libsemanage-common	libsemanage	https://salsa.debian.org/selinux-team/libsemanage/-/tree/debian/tests?ref_type=heads
libsemanage2	libsemanage	https://salsa.debian.org/selinux-team/libsemanage/-/tree/debian/tests?ref_type=heads
libsepol2	libsepol	https://salsa.debian.org/selinux-team/libsepol/-/tree/debian/tests?ref_type=heads
libsqlite3-0	sqlite3	https://github.com/sqlite/sqlite/tree/master/test
libtinfo6	ncurses	https://salsa.debian.org/debian/ncurses/-/tree/master/test?ref_type=heads
libtss2-esys-3.0.2-0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-fapi1	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-mu0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-rc0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-sys1	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-tcti-cmd0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-tcti-device0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-tcti-mssim0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-tcti-swtpm0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libtss2-tctildr0	tpm2-tss	https://salsa.debian.org/debian/tpm2-tss/-/tree/master/test?ref_type=heads
libunistring2	libunistring	https://jff.email/cgit/libunistring.git/tree/tests
liburiparser1	uriparser	https://jff.email/cgit/uriparser.git/tree/test
libxxhash0	xxhash	https://salsa.debian.org/debian/xxhash/-/tree/master/tests?ref_type=heads
ncurses-base	ncurses	https://salsa.debian.org/debian/ncurses/-/tree/master/test?ref_type=heads
ncurses-bin	ncurses	https://salsa.debian.org/debian/ncurses/-/tree/master/test?ref_type=heads
tar	tar	https://salsa.debian.org/debian/tar/-/tree/dfsg-debian/tests?ref_type=heads
ucf	ucf	https://salsa.debian.org/srivasta/ucf/-/tree/master/examples/ucf_helper_functions?ref_type=heads
usr-is-merged	usrmerge	https://salsa.debian.org/md/usrmerge/-/blob/master/development/test
zlib1g	zlib	https://github.com/madler/zlib/tree/develop/test

5. Packages with no Debian CI results nor upstream tests

Binary Package	Source package
base-files	base-files
base-passwd	base-passwd
hostname	hostname
libmnl0	libmnl
libnsl2	libnsl
libpam-passwdqc	passwdqc
libpam-pkcs11	pam-pkcs11
libpasswdqc1	passwdqc
libpython3-stdlib	python3-defaults
libreadline8	readline
librtmp1	rtmpdump
linux-base	linux-base
media-types	media-types
net-tools	net-tools
python3	python3-defaults
python3-minimal	python3-defaults
readline-common	readline
sysvinit-utils	sysvinit
tpm-udev	tpm-udev