8000 new kola ext.config.multipath.resilient test failing intermittently · Issue #1937 · coreos/fedora-coreos-tracker · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

new kola ext.config.multipath.resilient test failing intermittently #1937

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
dustymabe opened this issue Apr 26, 2025 · 10 comments
Open

new kola ext.config.multipath.resilient test failing intermittently #1937

dustymabe opened this issue Apr 26, 2025 · 10 comments
Assignees
@jcapiitao
Labels
status/pending-upstream-release Fixed upstream. Waiting on an upstream component source code release.

Comments

@dustymabe
Copy link
Member
dustymabe commented Apr 26, 2025 •
edited
Loading

Merged in coreos/fedora-coreos-config#3475. Failing on testing-devel.

[2025-04-28T14:07:19.718Z] --- FAIL: ext.config.multipath.resilient (715.06s)

[2025-04-28T14:07:19.718Z]         harness.go:1260: kolet failed: : Waiting for reboot: machine "0a118046-8ada-44f4-882a-47bc2476e76c" failed to start: ssh journalctl failed: time limit exceeded

[2025-04-28T14:07:19.718Z]         harness.go:106: TIMEOUT[10m0s]: ssh: journalctl -t kola-runext-test.sh
@jlebon
Copy link
Member
jlebon commented Apr 28, 2025

Hmm, the log here says ext.config.networking.force-persist-ip.

@jlebon
Copy link
Member
jlebon commented Apr 28, 2025

I think this will be fixed by https://issues.redhat.com/browse/RHEL-87490.

@dustymabe
Copy link
Member Author

Hmm, the log here says ext.config.networking.force-persist-ip.

oops. Copy/paste error. Updated the description with a correct example from https://jenkins-fedora-coreos-pipeline.apps.ocp.fedoraproject.org/blue/organizations/jenkins/build-arch/detail/build-arch/1569/pipeline

dustymabe added a commit to dustymabe/fedora-coreos-config that referenced this issue Apr 28, 2025
@dustymabe
denylist: deny ext.config.multipath.resilient on all arches
4d28ecf 
This test is proving to be a bit flaky. Let's denylist it for now
while we wait for an upstream fix [1].

[1] coreos/fedora-coreos-tracker#1937 (comment)
dustymabe added a commit to coreos/fedora-coreos-config that referenced this issue Apr 29, 2025
@dustymabe
denylist: deny ext.config.multipath.resilient on all arches
4f3fce5 
This test is proving to be a bit flaky. Let's denylist it for now
while we wait for an upstream fix [1].

[1] coreos/fedora-coreos-tracker#1937 (comment)
@jlebon
Copy link
Member
jlebon commented Apr 30, 2025

dracut-ng/dracut-ng#1306 should fix this I think.

dustymabe added a commit to dustymabe/fedora-coreos-config that referenced this issue Apr 30, 2025
@dustymabe
denylist: deny ext.config.multipath.resilient on all arches
607cd36 
This test is proving to be a bit flaky. Let's denylist it for now
while we wait for an upstream fix [1].

[1] coreos/fedora-coreos-tracker#1937 (comment)

(cherry picked from commit 4f3fce5)
@dustymabe dustymabe mentioned this issue Apr 30, 2025
Merged
dustymabe added a commit to coreos/fedora-coreos-config that referenced this issue Apr 30, 2025
@dustymabe
denylist: deny ext.config.multipath.resilient on all arches
a13849e 
This test is proving to be a bit flaky. Let's denylist it for now
while we wait for an upstream fix [1].

[1] coreos/fedora-coreos-tracker#1937 (comment)

(cherry picked from commit 4f3fce5)
@aaradhak aaradhak added the status/pending-upstream-release Fixed upstream. Waiting on an upstream component source code release. label May 5, 2025
@dustymabe dustymabe changed the title new kola ext.config.multipath.resilient test failing on s390x new kola ext.config.multipath.resilient test failing intermittently May 15, 2025
@dustymabe
Copy link
Member Author

Note this isn't specific to s390x. Updated the title to reflect that.

@dustymabe dustymabe mentioned this issue May 15, 2025
Open
@dustymabe
Copy link
Member Author

dracut-ng/dracut-ng#1306 should fix this I think.

This was merged and it is in the dracut 107 release but the latest in rawhide right now is dracut 105.

@jlebon
Copy link
Member
jlebon commented May 15, 2025

Actually, it would be trivial to carry dracut-ng/dracut-ng#1306 for now until dracut catches up. I normally would be fine waiting, but I think we also need it on older releases for coreos/fedora-coreos-config#3506.

@dustymabe
Copy link
Member Author

So carry the patch in a postprocess and then when the new release comes in the patch will start failing to apply and we'll drop it?

@jlebon
Copy link
Member
jlebon commented May 15, 2025

So carry the patch in a postprocess and then when the new release comes in the patch will start failing to apply and we'll drop it?

SGTM. Though it's not clear yet for 9.4 if it'll get backported, so we might end up continuing to carry it there.

@jlebon
Copy link
Member
jlebon commented May 15, 2025

To be clear, we only need the multipathd-configure.service part of dracut-ng/dracut-ng#1306, not the multipathd.sh one (which is only used on non-systemd systems).

jcapiitao pushed a commit to jcapiitao/fedora-coreos-config that referenced this issue May 16, 2025
@dustymabe @jcapiitao
denylist: deny ext.config.multipath.resilient on all arches
3a3d6af 
This test is proving to be a bit flaky. Let's denylist it for now
while we wait for an upstream fix [1].

[1] coreos/fedora-coreos-tracker#1937 (comment)

(cherry picked from commit 4f3fce5)
@jcapiitao jcapiitao self-assigned this May 16, 2025
jcapiitao added a commit to jcapiitao/fedora-coreos-config that referenced this issue May 16, 2025
@jcapiitao
manifests/fedora-coreos-base: apply dracut fix in postcript
eba1a79 
We are awaiting some dracut patches to land in Fedora mirror for [1].
We could wait for it, but we'd need it also for older rhcos branches
and those branches won't have the new dracut. So we decided to
carry part of the dracut-ng patch [2] in a post-script.
This will be backported in older rhcos branches, and will be reverted
on testing-devel once new dracut 107 available in mirror.

[1] coreos/fedora-coreos-tracker#1937
[2] dracut-ng/dracut-ng#1306
@jcapiitao jcapiitao mentioned this issue May 16, 2025
Open
jcapiitao added a commit to jcapiitao/fedora-coreos-config that referenced this issue May 19, 2025
@jcapiitao
manifests/fedora-coreos-base: apply dracut fix in postcript
9737c5c 
We are awaiting some dracut patches to land in Fedora mirror for [1].
We could wait for it, but we'd need it also for older rhcos branches
and those branches won't have the new dracut. So we decided to
carry part of the dracut-ng patch [2] in a post-script.
This will be backported in older rhcos branches, and will be reverted
on testing-devel once new dracut 107 available in mirror.

[1] coreos/fedora-coreos-tracker#1937
[2] dracut-ng/dracut-ng#1306
jcapiitao added a commit to jcapiitao/fedora-coreos-config that referenced this issue May 20, 2025
@jcapiitao
shared-el: apply dracut fix in postcript
2e42d95 
We are awaiting some dracut patches to land in Fedora mirror for [1].
We could wait for it, but we'd need it also for older rhcos branches
and those branches won't have the new dracut. So we decided to
carry part of the dracut-ng patch [2] in a post-script.
This will be backported in older rhcos branches, and will be reverted
on testing-devel once new dracu
7195
t 107 available in mirror.

[1] coreos/fedora-coreos-tracker#1937
[2] dracut-ng/dracut-ng#1306
jcapiitao added a commit to jcapiitao/fedora-coreos-config that referenced this issue May 20, 2025
@jcapiitao
manifests/shared-el: apply dracut fix in postcript
9d804c9 
We are awaiting some dracut patches to land in Fedora mirror for [1].
We could wait for it, but we'd need it also for older rhcos branches
and those branches won't have the new dracut. So we decided to
carry part of the dracut-ng patch [2] in a post-script.
This will be backported in older rhcos branches, and will be reverted
on testing-devel once new dracut 107 available in mirror.

[1] coreos/fedora-coreos-tracker#1937
[2] dracut-ng/dracut-ng#1306
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jcapiitao jcapiitao

Labels
status/pending-upstream-release Fixed upstream. Waiting on an upstream component source code release.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@dustymabe @jlebon @jcapiitao @aaradhak
0