Skip to content

Dpdk: roll back broken installs and reuse downloaded assets - #4660

Merged
LiliDeng merged 6 commits into
mainfrom
mcgov/stack-7-dpdk-installer-rollback
Sep 1, 2026
Merged

Dpdk: roll back broken installs and reuse downloaded assets#4660
LiliDeng merged 6 commits into
mainfrom
mcgov/stack-7-dpdk-installer-rollback

TarDownloader: remove folder and tar file on remote upon failure

480c3c4
Select commit
Loading
Failed to load commit list.
Azure Pipelines / Github PR Validation failed Sep 1, 2026 in 12m 2s

Build #20260831.5 had test failures

1 errors / 4 warnings

Details

Tests

  • Failed: 35 (97.22%)
  • Passed: 0 (0.00%)
  • Other: 1 (2.78%)
  • Total: 36

Annotations

Check failure on line 1450 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Github PR Validation

Build log #L1450 

Bash exited with code '35'.

Check failure on line 1 in verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Github PR Validation

verify_dpdk_build_gb_hugepages_failsafe (lisa_0_4) 

deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e4' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e4' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Raw output 
Traceback (most recent call last):
  File "/home/vsts/work/1/s/lisa/runners/lisa_runner.py", line 360, in _deploy_environment_task
    self.platform.deploy_environment(environment)
  File "/home/vsts/work/1/s/lisa/platform_.py", line 189, in deploy_environment
    raise identifier
  File "/home/vsts/work/1/s/lisa/platform_.py", line 186, in deploy_environment
    self._deploy_environment(environment, log)
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 728, in _deploy_environment
    raise e
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 707, in _deploy_environment
    check_or_create_resource_group(
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/common.py", line 2063, in check_or_create_resource_group
    rm_client.resource_groups.create_or_update(
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/tracing/decorator.py", line 119, in wrapper_use_tracer
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/mgmt/resource/resources/v2021_04_01/operations/_resource_groups_operations.py", line 409, in create_or_update
    map_error(status_code=response.status_code, response=response, error_map=error_map)
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/exceptions.py", line 163, in map_error
    raise error
azure.core.exceptions.ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e4' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e4' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.

Check failure on line 1 in verify_dpdk_build_netvsc (lisa_0_0)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Github PR Validation

verify_dpdk_build_netvsc (lisa_0_0) 

deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e0' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e0' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Raw output 
Traceback (most recent call last):
  File "/home/vsts/work/1/s/lisa/runners/lisa_runner.py", line 360, in _deploy_environment_task
    self.platform.deploy_environment(environment)
  File "/home/vsts/work/1/s/lisa/platform_.py", line 189, in deploy_environment
    raise identifier
  File "/home/vsts/work/1/s/lisa/platform_.py", line 186, in deploy_environment
    self._deploy_environment(environment, log)
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 728, in _deploy_environment
    raise e
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 707, in _deploy_environment
    check_or_create_resource_group(
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/common.py", line 2063, in check_or_create_resource_group
    rm_client.resource_groups.create_or_update(
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/tracing/decorator.py", line 119, in wrapper_use_tracer
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/mgmt/resource/resources/v2021_04_01/operations/_resource_groups_operations.py", line 409, in create_or_update
    map_error(status_code=response.status_code, response=response, error_map=error_map)
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/exceptions.py", line 163, in map_error
    raise error
azure.core.exceptions.ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e0' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e0' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.

Check failure on line 1 in verify_dpdk_symmetric_mp (lisa_0_1)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Github PR Validation

verify_dpdk_symmetric_mp (lisa_0_1) 

deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e1' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e1' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Raw output 
Traceback (most recent call last):
  File "/home/vsts/work/1/s/lisa/runners/lisa_runner.py", line 360, in _deploy_environment_task
    self.platform.deploy_environment(environment)
  File "/home/vsts/work/1/s/lisa/platform_.py", line 189, in deploy_environment
    raise identifier
  File "/home/vsts/work/1/s/lisa/platform_.py", line 186, in deploy_environment
    self._deploy_environment(environment, log)
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 728, in _deploy_environment
    raise e
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 707, in _deploy_environment
    check_or_create_resource_group(
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/common.py", line 2063, in check_or_create_resource_group
    rm_client.resource_groups.create_or_update(
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/tracing/decorator.py", line 119, in wrapper_use_tracer
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/mgmt/resource/resources/v2021_04_01/operations/_resource_groups_operations.py", line 409, in create_or_update
    map_error(status_code=response.status_code, response=response, error_map=error_map)
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/exceptions.py", line 163, in map_error
    raise error
azure.core.exceptions.ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e1' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e1' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.

Check failure on line 1 in verify_dpdk_build_failsafe (lisa_0_3)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / Github PR Validation

verify_dpdk_build_failsafe (lisa_0_3) 

deployment failed. ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e3' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e3' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Raw output 
Traceback (most recent call last):
  File "/home/vsts/work/1/s/lisa/runners/lisa_runner.py", line 360, in _deploy_environment_task
    self.platform.deploy_environment(environment)
  File "/home/vsts/work/1/s/lisa/platform_.py", line 189, in deploy_environment
    raise identifier
  File "/home/vsts/work/1/s/lisa/platform_.py", line 186, in deploy_environment
    self._deploy_environment(environment, log)
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 728, in _deploy_environment
    raise e
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/platform_.py", line 707, in _deploy_environment
    check_or_create_resource_group(
  File "/home/vsts/work/1/s/lisa/sut_orchestrator/azure/common.py", line 2063, in check_or_create_resource_group
    rm_client.resource_groups.create_or_update(
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/tracing/decorator.py", line 119, in wrapper_use_tracer
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/mgmt/resource/resources/v2021_04_01/operations/_resource_groups_operations.py", line 409, in create_or_update
    map_error(status_code=response.status_code, response=response, error_map=error_map)
  File "/opt/hostedtoolcache/Python/3.12.14/x64/lib/python3.12/site-packages/azure/core/exceptions.py", line 163, in map_error
    raise error
azure.core.exceptions.ResourceExistsError: (ResourceGroupQuotaExceeded) Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e3' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
Code: ResourceGroupQuotaExceeded
Message: Creating the resource group 'lisa-AI-selected-test-cases-20260901-002944-210-e3' would exceed the quota of '980'. The current resource group count is '980', please delete some groups before creating a new one.
View more details on Azure Pipelines