Skip to content

Test failure: test_running_real_assessment_job #4717

@github-actions

Description

@github-actions
❌ test_running_real_assessment_job: TimeoutError: timed out after 0:20:00: Finding instances for new nodes, acquiring more instances if necessary (22m51.461s)
TimeoutError: timed out after 0:20:00: Finding instances for new nodes, acquiring more instances if necessary
[gw5] linux -- Python 3.10.19 /home/runner/work/ucx/ucx/.venv/bin/python
05:08 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.0hLu/config.yml) doesn't exist.
05:08 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:08 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
05:08 INFO [databricks.labs.ucx.install] Fetching installations...
05:08 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:08 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:28 ERROR [databricks.labs.blueprint.parallel] ensure clusters running('TEST_USER_ISOLATION_CLUSTER_ID') task failed: timed out after 0:20:00: Finding instances for new nodes, acquiring more instances if necessary
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/mixins/compute.py", line 269, in ensure_cluster_is_running
    self.wait_get_cluster_running(cluster_id)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/compute.py", line 10112, in wait_get_cluster_running
    raise TimeoutError(f"timed out after {timeout}: {status_message}")
TimeoutError: timed out after 0:20:00: Finding instances for new nodes, acquiring more instances if necessary
05:28 ERROR [databricks.labs.blueprint.parallel] More than half 'ensure clusters running' tasks failed: 0% results available (0/3). Took 0:20:00.731409
05:08 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.0hLu/config.yml) doesn't exist.
05:08 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:08 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
05:08 INFO [databricks.labs.ucx.install] Fetching installations...
05:08 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:08 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:28 ERROR [databricks.labs.blueprint.parallel] ensure clusters running('TEST_USER_ISOLATION_CLUSTER_ID') task failed: timed out after 0:20:00: Finding instances for new nodes, acquiring more instances if necessary
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/mixins/compute.py", line 269, in ensure_cluster_is_running
    self.wait_get_cluster_running(cluster_id)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/compute.py", line 10112, in wait_get_cluster_running
    raise TimeoutError(f"timed out after {timeout}: {status_message}")
TimeoutError: timed out after 0:20:00: Finding instances for new nodes, acquiring more instances if necessary
05:28 ERROR [databricks.labs.blueprint.parallel] More than half 'ensure clusters running' tasks failed: 0% results available (0/3). Took 0:20:00.731409
05:28 WARNING [databricks.labs.ucx.install] UCX workspace remote version not found: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.0hLu/version.json) doesn't exist.
05:28 WARNING [databricks.labs.ucx.install] Installed version is too old: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.0hLu/version.json) doesn't exist.
05:28 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:30 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:30 INFO [databricks.labs.ucx.install] Deleting UCX v0.60.2+320251209052856 from https://DATABRICKS_HOST
05:30 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_syflu6zi8
05:30 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:30 INFO [databricks.labs.ucx.install] Deleting secret scope
05:30 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw5] linux -- Python 3.10.19 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #717

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions