Releases · openshift-kni/eco-gotests

08 Oct 19:49

kononovn

v4.17.0

1907139

eco-gotest:v4.17.0 Latest

Latest

Release-4.17.0

Number of test cases: 525 ( +75)

Golang version: 1.23
Operator versions: 4.17
k8s libs versions: v0.30.5
k8s.io/kubernetes version: v1.30.5

List of test suites:

ASSEL:

upgrade

ASSISTED:

ztp operator
ztp spoke

core net bfd
core net cni
core net day1day2
core net dpdk
core net metallb
core net policy
core net sriov
ran containernshide
ran gitopsztp
ran powermanagement
ran talm

HW-ACCEL

kmm upgrade
kmm mcm
kmm module
nfd features
nfd upgrade
gpu gpu

ibu cnf upgrade
ibu mgmt negative
ibu mgmt upgrade

RHWA

SYSTEM

diskencryption
ran-du
vcore
spk
rdscore
ipsec

What's Changed

cnf ran: ztp hub templating and node delete migration by @klaskosk in #84
cnf ran: adding CR reporting to powermanagement by @klaskosk in #93
cnf ran: add reporting for CRs on each cluster by @klaskosk in #90
cnf ran: ztp policies app and machine config migration by @klaskosk in #96
cnf-network: Tests for the SR-IOV Expose MTU feature by @evgenLevin in #95
cnf network: QinQ TC update by @ajaggapa in #102
cnf ran: ztp generator and spoke checker migration by @klaskosk in #101
system-tests: update test suites to use eco-goinfra's bmc by @greyerof in #19
cnf ran: ztp generator tweaks based on testing by @klaskosk in #104
deps: bump eco-goinfra to v0.0.0-20240719152154-1785516033a2 by @trewest in #106
cnf ran: add secret creation to ztp hub templating by @klaskosk in #108
vCore: logging operator test refactoring, switch from the elasticsearch to the loki + internal odf fix by @elenagerman in #107
vCore: adjustments for the remote cmd and homedir by @elenagerman in #109
vCore: execute oc cmd on the hypervisor instead of container by @elenagerman in #110
infra: remove url package duplication by @kononovn in #105
hwaccel: change log test by @ggordaniRed in #99
vCore: create templates directly on the hyperviser by @elenagerman in #111
vCore: separate odf from the main run by @elenagerman in #112
accel: add internal folder by @siserafin in #113
vCore: fix helm redis deployment failure by @elenagerman in #114
deps: bump eco-goinfra to v0.0.0-20240723150001-514ea49f5511 by @trewest in #115
system-test: handle error while listing pods by @yprokule in #117
vCore: loki: increase pvc creation timeout by @elenagerman in #118
assisted ztp: add operator suite test namespaces to reporter by @trewest in #120
cnf ran: ztp reporting and improvements by @klaskosk in #119
deps: bump eco-goinfra to v0.0.0-20240726142624-8eb62208ad75 by @kononovn in #122
accel: add ocp upgrade test by @siserafin in #116
bump eco-goinfra to v0.0.0-20240731154756-d6b470ae81c2 by @kononovn in #130
cnf ran: image registry CR report and spoke checker fix by @klaskosk in #125
cnf ran: disable talm backup tests for 4.16+ by @klaskosk in #126
assisted ztp: increased timeout for flaky tests by @trewest in #131
lca: increase the scope of seedimage pkg by @trewest in #133
bump eco-goinfra to v0.0.0-20240806143944-e49acf61eb1b by @kononovn in #134
cnf-network:MetalLB: speaker pods replaced by frr-8ks pods by @evgenLevin in #124
cnf ran: rename ztp directory to ran-ztp by @klaskosk in #136
assisted ztp: increase timeouts for platform and trustbundle tests by @trewest in #139
vcore: odf nodes usage refactoring by @elenagerman in #140
vcore: change ObjectBucketClaim storageClass noobaa -> ceph-rgw by @elenagerman in #142
vcore: odf pv creation, cnt verification adjustment by @elenagerman in #143
noobaa: increase configmap timeout by @elenagerman in #144
system-tests: ran-du hard reboot clean up ipmitools image by @mcornea in #141
cnf-network: Added logLevel to SriovNetworks by @evgenLevin in #127
bump: eco-goinfra v0.0.0-20240809133315-01bbbf4c9ede by @edcdavid in #145
bump: eco-goinfra v0.0.0-20240809150049-0634a7a9fb27 by @kononovn in #146
vcore: odf, reduce maxDeviceCount value by @elenagerman in #147
bump: eco-goinfra v0.0.0-20240809175523-08d2ee10447b by @kononovn in #148
vcore: refactoring for the redis and odf nodes by @elenagerman in #149
vcore: odf, increase pv timeout by @elenagerman in #151
bump: eco-goinfra v0.0.0-20240812145528-915aa75bfdb6 by @kononovn in #152
odf: storage adjustments by @elenagerman in #153
vcore: storage switch to the nfs, single storageClass by @elenagerman in #154
system-test: refactor KernelCrashKdump function by @yprokule in #155
ibi mgmt: add directory structure for ibi tests by @trewest in #138
bump: eco-goinfra v0.0.0-20240813134610-7cfb14e1ce75 by @edcdavid in #156
system-test: KDump tests for RDS Core by @yprokule in #157
global: move internal ran functions to global scope by @edcdavid in #128
vcore: exclude odf deployment from the general test suite by @elenagerman in #159
cnf ran: reorganize powermanagement helpers by @klaskosk in #160
vcore: separate lso from the odf by @elenagerman in #164
Samsung ODF: move label and taints test to the lso package by @elenagerman in #165
vcore: fix verification statement by @elenagerman in #166
vCore: add timeout for getting redis ns fsGroup value by @elenagerman in #167
vCore: sleep added before pv creation stage to avoid failure by @elenagerman in #168
Refactor IPSec tests for SNO, SNO+1, and MNO by @bradyallenjohnson in #169
vCore: increase loki and odf timeouts by @elenagerman in #171
cnf-network: fixed reportxml ID for the expose MTU test by @evgenLevin in #163
global: fail fast on retry errors by @klaskosk in #162
bump: eco-goinfra v0.0.0-20240819205434-62b2119d4777 by @klaskosk in #172
RDS Core: IPVLAN connectivity test added by @elenagerman in #150
vCore odf: increase more odf/lso/loki timeouts by @elenagerman in #175
system-test: Extend polling interval for kdump tests by @yprokule in #176
system-test: use dedicated IPVLAN NADs per test by @yprokule in #177
system-tests: new test for disk encryption with support for TMPv2 PCR protection by @edcdavid in #129
vCore: increased redis ns object timeout + debug log added by @elenagerman in #179
cnf-network: fixed Metallb metric tests by @evgenLevin in https:/...

Contributors

bradyallenjohnson, sebrandon1, and 16 other contributors

Assets 2

12 Jul 16:02

kononovn

v4.16.0

3edd8c7

eco-gotest:v4.16.0

Release-4.16.0

Number of test cases: 450 ( +155)

Golang version: 1.22
Operator versions: 4.16
k8s libs versions: v0.29.4
k8s.io/kubernetes version: v1.29.4

List of test suites:

ASSISTED:

ztp operator
ztp spoke

core net bfd
core net cni
core net day1day2
core net dpdk
core net metallb
core net policy
core net sriov
ran containernshidenshide
ran powermanagement
ran talm
ran ztp

HW-ACCEL

kmm upgrade
kmm mcm
kmm module
nfd features
nfd upgrade
gpu gpudeploy

imagebasedupgrade upgrade-talm
mgmt negative
mgmt upgrade

RHWA

SYSTEM

ran-du
vcore
spk
rdscore
ipsec

What's Changed

ci: switch to ubuntu-latest runner by @kononovn in #2
ci: switch docker-images ci to setup-qemu-action@v3 by @kononovn in #3
ci: update docker-image-ci.yml ran-du push action by @kononovn in #4
ci: fix minor issue with ran-du image building by @kononovn in #5
ci: fix registry link by @kononovn in #6
ci: remove invalid parameters from image step by @kononovn in #7
ibu mgmt: add proxy test to upgrade suite by @trewest in #1
cnf ran: fixed some talm robustness issues by @klaskosk in #15
ibu mgmt: remove workaround for lca backup/restore bug by @trewest in #16
ibu mgmt: update proxy tests to ignore no_proxy by @trewest in #18
ibu cnf: add prep abort test case by @mpmaruthu in #13
cnf-test: exmanaged: added sleep time to workaround issue with nmstate ds by @evgenLevin in #11
cnf network: add qinq second PR multi-cvlans by @gkopels in #10
ci: update checkout to v4 by @sebrandon1 in #20
Update Go to v1.22.4 by @sebrandon1 in #23
mgmt ibu: add negative test suite by @trewest in #26
ready-for-final-review: ibu cnf: add upgrade abort test case by @mpmaruthu in #14
ibu cnf: post upgrade validations by @mcornea in #12
system-test: Refactor methods for PVC tests by @yprokule in #30
cnf ran: talm precache excluded image fix by @klaskosk in #28
bump: updates all libs to the latest versions by @kononovn in #32
hw-accel: fix KMM test by @cdvultur in #34
deps: update github.com/containernetworking/cni module by @trewest in #36
system-tests: update ran-du reboot tests by @mcornea in #39
system-tests: wait for SriovFecNodeConfig resource to be configured by @mcornea in #40
system-test: sleep 90 seconds between runs by @yprokule in #41
hw-accel: use multi-stage image in firmware test by @cdvultur in #38
assisted ztp: add disruptive label to operator tests by @trewest in #33
system-test: remove RBD deployment pre-requisite by @yprokule in #42
lca: add negative test for patching the stage from idle to rollback. by @achuzhoy in #37
ibu cnf: add 'rollback after a successful upgrade' test by @mpmaruthu in #45
lca: Adding coverage for idle to upgrade negative test. by @achuzhoy in #46
cnf network: add qinq dpdk tc by @gkopels in #25
Added tests for reserved core frequency tuning by @josclark42 in #35
vCore: SR-IOV verification test suite added by @elenagerman in #44
lca: add negative test for patching the stage from prep to rollback. by @achuzhoy in #50
system-test: added tests for NNCP and Policies by @yprokule in #53
system-test: test workloads with different SR-IOV networks by @yprokule in #55
system-tests: parameterize StorageClass names by @yprokule in #57
lca: cnf exclude operators and sriov nnp from post validation checks by @mcornea in #56
lca: cnf retry kcat command execution by @mcornea in #58
lca: negative test to cover unsupported stage update. by @achuzhoy in #52
ibu mgmt: move backup/restore tasks to separate utility by @trewest in #47
deps: bump eco-goinfra to 1f702e37c052 by @trewest in #59
ibu mgmt: add missing dpa test by @trewest in #62
cnf network: add qinq nmstate test case by @gkopels in #49
vCore: keda test suite by @elenagerman in #63
ibu mgmt: fix backup storage location by @trewest in #66
ready-for-final-review: ibu cnf: add 'rollback after a failed upgrade' test by @mpmaruthu in #29
system-tests: ran-du: force delete guaranteed pod by @mcornea in #60
cnf network: update Dockerfile for dpdk client image by @ajaggapa in #67
ibu mgmt: move the set to idle to after all. by @achuzhoy in #68
system-test: deploy workload with RBD volumes by @yprokule in #64
Add stability tests for ran du by @rlmanrique in #61
lca: cnf: Retry seed image info retrieval in post validations by @mcornea in #70
vCore: numa test suite by @elenagerman in #69
system-test: Documentation for tests parameters by @yprokule in #71
system-test: update parameters by @yprokule in #73
system-test: Unify delete workload mechanism in ran du tests by @rlmanrique in #74
system-test: verify SR-IOV post cluster reboot by @yprokule in #77
system-test: Enable ptp checks in existing test cases by @rlmanrique in #75
lca: cnf: fix rollback-after-failed-upgrade-test by @mcornea in #78
cnf ran: ztp test migration preliminaries by @klaskosk in #72
Add Version Check to Reserved Core Freqency Tuning Test. Fix and move CompareOCPVersionWithCurrent() by @josclark42 in #51
lca: cnf: wait for ibu idle stage after finalize cgu by @mcornea in #79
sytem-tests: Add retries to PTP validations by @rlmanrique in #80
cnf network: fix-dpdk-test-case by @gkopels in #76
system-tests: ran-du: add tuned restarts check to stability tests by @mcornea in #82
cnf ran: remove cat hack from powersave by @klaskosk in #43
cnf ran: ztp acm crs and clusters app tests by @klaskosk in #81
system-tests: increase ptp retries by @rlmanrique in #85
system-tests: use different file names for tuned stability checks by @mcornea in #88
IPSec System Test troubleshooting guide by @bradyallenjohnson in #89
Revise Polarion Test Case IDs in TALM tests by @josclark42 in #91
system-tests: ran_du store ptp logs in case of failure by @rlmanrique in #92