Commit 25f07dc
authored
Fix flaky K8s xcom tests on ARM runners hitting 120s pod-start timeout (#65598)
On ARM CI runners with a cold containerd cache, the first test in the K8s
system suite that needs the xcom sidecar image (alpine) or the basic_pod
template's image can exceed KubernetesPodOperator's 120s startup budget,
producing a PodLaunchTimeoutException that surfaces as a generic
"AirflowException: Pod ... returned a failure".
Two changes:
- basic_pod.yaml / test_full_pod_spec now use `ubuntu` instead of `perl`.
The pod only runs `/bin/bash -c 'echo ... > /airflow/xcom/return.json'`,
so any image with bash works, and `ubuntu` is already warmed by earlier
tests in the same suite — no extra image pull needed.
- Every real-cluster test that sets `do_xcom_push=True` now passes
`startup_timeout_seconds=XCOM_STARTUP_TIMEOUT_SECONDS` (300s). Since
pytest ordering is not guaranteed, whichever xcom test runs first has to
absorb the one-time alpine sidecar pull; bumping the budget on all of
them keeps the suite order-independent.
Observed failure: apache/airflow actions run 24716106401, job 72301089157
(K8S System:CeleryExecutor-3.12-v1.32.8-false, ARM). Both failing tests
took exactly ~120s matching the default startup_timeout_seconds; pod
events showed "Pulling image 'alpine' ..." with no "Successfully pulled"
inside the 120s window.
No production code change — the operator default of 120s is unchanged.1 parent dae48ba commit 25f07dc
2 files changed
Lines changed: 13 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
| 26 | + | |
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
Lines changed: 12 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
54 | 60 | | |
55 | 61 | | |
56 | 62 | | |
| |||
709 | 715 | | |
710 | 716 | | |
711 | 717 | | |
| 718 | + | |
712 | 719 | | |
713 | 720 | | |
714 | 721 | | |
| |||
753 | 760 | | |
754 | 761 | | |
755 | 762 | | |
| 763 | + | |
756 | 764 | | |
757 | 765 | | |
758 | 766 | | |
| |||
775 | 783 | | |
776 | 784 | | |
777 | 785 | | |
| 786 | + | |
778 | 787 | | |
779 | 788 | | |
780 | 789 | | |
| |||
814 | 823 | | |
815 | 824 | | |
816 | 825 | | |
| 826 | + | |
817 | 827 | | |
818 | 828 | | |
819 | 829 | | |
| |||
842 | 852 | | |
843 | 853 | | |
844 | 854 | | |
845 | | - | |
| 855 | + | |
846 | 856 | | |
847 | 857 | | |
848 | 858 | | |
| |||
858 | 868 | | |
859 | 869 | | |
860 | 870 | | |
861 | | - | |
| 871 | + | |
862 | 872 | | |
863 | 873 | | |
864 | 874 | | |
| |||
0 commit comments