Skip to content

[update] Serialize VM evacuation during compute reboot - #4200

Open
srac0 wants to merge 1 commit into
openstack-k8s-operators:mainfrom
srac0:update/sync-vm-migration
Open

srac0 wants to merge 1 commit into
openstack-k8s-operators:mainfrom
srac0:update/sync-vm-migration

Conversation

@srac0

@srac0 srac0 commented Sep 23, 2026

Copy link
Copy Markdown
Contributor

Wait for each VM evacuation to finish before starting the next one. Asynchronous VM migration can cause issues when VMs have overlapping host constraints.

@openshift-ci

openshift-ci Bot commented Sep 23, 2026

Copy link
Copy Markdown
Contributor

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/ba6dd72244b44902bc4a2fe6985d8730

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 40m 42s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 21m 32s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 27m 56s
❌ cifmw-crc-podified-edpm-baremetal-minor-update NODE_FAILURE Node(set) request 099-0000211201 failed in 0s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 16s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 20m 24s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 50s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 27s
✔️ cifmw-molecule-update SUCCESS in 6m 23s

@srac0
srac0 force-pushed the update/sync-vm-migration branch from b548ba1 to 17d742e Compare September 23, 2026 21:14
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/8b1192b32ca347c890737c4b0f8ed808

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 11m 28s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 24m 11s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 35m 00s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 56m 47s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 21s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 18m 39s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 07s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 53s
✔️ cifmw-molecule-update SUCCESS in 5m 39s

@srac0
srac0 marked this pull request as ready for review September 29, 2026 07:54
@qodo-code-review

Copy link
Copy Markdown

Qodo reviews are paused for this user.

Troubleshooting steps vary by plan Learn more →

On a Teams plan?
Reviews resume once this user has a paid seat and their Git account is linked in Qodo.
Link Git account →

Using GitHub Enterprise Server, GitLab Self-Managed, or Bitbucket Data Center?
These require an Enterprise plan - Contact us
Contact us →

@srac0
srac0 force-pushed the update/sync-vm-migration branch from 17d742e to dc4c005 Compare September 29, 2026 07:56
@srac0 srac0 changed the title [update] Add guarded synchronous VM evacuation [update] Serialize VM evacuation during compute reboot Sep 29, 2026
@srac0
srac0 force-pushed the update/sync-vm-migration branch from dc4c005 to ec90d10 Compare September 29, 2026 08:05
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/caefb2c048054a04bd70d0fc7f3550d5

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 58m 54s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 26m 37s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 22m 55s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 39m 21s
❌ cifmw-crc-podified-edpm-baremetal-minor-update FAILURE in 34m 58s
✔️ cifmw-pod-zuul-files SUCCESS in 6m 28s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 12m 28s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 9m 54s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 51s
❌ cifmw-molecule-update FAILURE in 6m 10s

@michburk

Copy link
Copy Markdown
Contributor

recheck

Comment thread roles/update/tasks/migrate_instance_from_hypervisor.yml
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/06e8f36c91f64c8991bb452774c4a06e

❌ openstack-k8s-operators-content-provider FAILURE in 5m 24s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ podified-multinode-edpm-deployment-crc-centos-10 SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal-minor-update SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ cifmw-pod-zuul-files SUCCESS in 4m 08s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 5m 17s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 35s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 33s
✔️ cifmw-molecule-update SUCCESS in 6m 06s

@srac0

srac0 commented Oct 1, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@michburk michburk left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build succeeded (check pipeline).
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/3470d6ac4d8b4d3185e7500568fe9d71

✔️ openstack-k8s-operators-content-provider SUCCESS in 11h 02m 47s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 21m 46s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 25m 05s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 35m 29s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 58m 59s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 59s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 16h 28m 12s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 31m 20s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 12m 54s
✔️ cifmw-pod-pre-commit SUCCESS in 11m 43s
✔️ cifmw-molecule-update SUCCESS in 9m 36s

@srac0
srac0 force-pushed the update/sync-vm-migration branch from ec90d10 to 8bbe10d Compare October 2, 2026 06:49
@openshift-ci openshift-ci Bot removed the lgtm label Oct 2, 2026
@openshift-ci

openshift-ci Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

New changes are detected. LGTM label has been removed.

@openshift-ci

openshift-ci Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from michburk. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build succeeded (check pipeline).
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/1899797ec39342d590b5131952ae8c65

✔️ openstack-k8s-operators-content-provider SUCCESS in 7h 22m 29s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 14s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 26m 08s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 32m 10s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 56m 44s
✔️ cifmw-pod-zuul-files SUCCESS in 5m 28s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 4h 23m 49s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 25m 57s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 12m 24s
✔️ cifmw-pod-pre-commit SUCCESS in 9m 24s
✔️ cifmw-molecule-update SUCCESS in 11m 05s

@srac0

srac0 commented Oct 5, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@michburk

michburk commented Oct 5, 2026

Copy link
Copy Markdown
Contributor

The spell check failures should be addressed by #4227
We merged a change that modified docs, but the docs check wasn't configured to run against docs built from certain directories. Added the missing words to the dictionary and updated checks so that shouldn't happen again. Sorry for the inconvenience!

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/36009165cc4d4edf98d569db4b73646a

✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 15m 52s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 24m 39s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 20m 48s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 14s
❌ cifmw-crc-podified-edpm-baremetal-minor-update FAILURE in 2h 03m 28s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 55s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 3h 19m 04s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 29m 26s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 42s
✔️ cifmw-pod-pre-commit SUCCESS in 9m 41s
✔️ cifmw-molecule-update SUCCESS in 5m 44s

@srac0
srac0 force-pushed the update/sync-vm-migration branch from 8bbe10d to ed2e26a Compare October 6, 2026 08:32
When enabled, migrate running VMs in creation order and wait for each
migration before continuing. This prevents overlapping migrations during
post-adoption updates.

Signed-off-by: Samuel Rac <srac@redhat.com>
@srac0
srac0 force-pushed the update/sync-vm-migration branch from ed2e26a to 6530d84 Compare October 6, 2026 13:29
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/7437aa7950084d44920813b9e64005dd

✔️ openstack-k8s-operators-content-provider SUCCESS in 6h 10m 00s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 14s
❌ podified-multinode-edpm-deployment-crc-centos-10 NODE_FAILURE Node(set) request 099-0000226050 failed in 0s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 06s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 53m 39s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 21s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 6h 42m 44s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 29m 03s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 11s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 24s
✔️ cifmw-molecule-update SUCCESS in 5m 50s

@srac0

srac0 commented Oct 7, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/c76f24bc22f94c13936e3dcb397843e7

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 59m 05s
❌ podified-multinode-edpm-deployment-crc FAILURE in 21m 44s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 22m 53s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 37m 08s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 59m 13s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 19s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 3h 58m 32s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 28m 21s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 48s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 45s
✔️ cifmw-molecule-update SUCCESS in 6m 17s

@srac0

srac0 commented Oct 8, 2026

Copy link
Copy Markdown
Contributor Author

recheck

@centosinfra-prod-github-app

Copy link
Copy Markdown

Build succeeded (check pipeline).
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/6412b67a70cf4df38be74ab5a656ca58

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 21m 29s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 27m 20s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 28m 23s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 30m 30s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 02m 20s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 32s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 2h 37m 51s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 30m 29s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 29s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 52s
✔️ cifmw-molecule-update SUCCESS in 5m 38s

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants