Add tests for thenables returned from async script #57160
Community-TC Integration / wpt-chrome-dev-stability
succeeded
Jan 25, 2026 in 4m 45s
Community-TC (pull_request)
Verify that all tests affected by a pull request are stable when executed in chrome.
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2026-01-25T02:44:45.534Z
Resolved: 2026-01-25T02:48:40.462Z
Task Execution Time: 3 minutes, 54 seconds, 928 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md
WPT Command: python3 ./wpt run --channel=dev --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --enable-swiftshader --install-browser --install-webdriver chrome
[taskcluster 2026-01-25 02:44:45.692Z] Task ID: CjaG37tFRc6PGHlLEkUOiQ
[taskcluster 2026-01-25 02:44:45.692Z] Worker ID: 6728236425987767710
[taskcluster 2026-01-25 02:44:45.692Z] Worker Group: us-east1-c
[taskcluster 2026-01-25 02:44:45.692Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-25 02:44:45.692Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-25 02:44:45.692Z] Worker Version: 46.1.0
[taskcluster 2026-01-25 02:44:45.692Z] Public IP: 34.138.168.108
[taskcluster 2026-01-25 02:44:45.692Z] Hostname: proj-wpt-ci-fjs3ztq8ssqy-xjml3ndqw
ac811f28856d - Started downloading
ac811f28856d - Downloaded in 0.031 seconds
8f84a9f2102e - Started downloading
40516d781e70 - Started downloading
44ebbf800033 - Started downloading
44ebbf800033 - Downloaded in 0.043 seconds
8f84a9f2102e - Downloaded in 0.222 seconds
a8884b21e40e - Started downloading
4f4fb700ef54 - Started downloading
4f4fb700ef54 - Downloaded in 0.001 seconds
79c347416ee8 - Started downloading
...(6614 lines hidden)...
"""
assert response.status == 200, str(response.error)
if value is not None:
> assert response.body["value"] == value
E AssertionError: assert 'callback' == 'promise'
E
E - promise
E + callback
response = <Response: status=200 body={"value": "callback"}>
value = 'promise'
webdriver/tests/support/asserts.py:76: AssertionError
FAIL test_returned_promise_fulfilled_over_callback - AssertionError: assert 'callback' == 'promise'
session = <Session 7043ead8fdbbd6208f4ccd1c23efd852>
def test_returned_promise_fulfilled_over_callback(session):
session.timeouts.script = 1
response = execute_async_script(session, """
let resolve = arguments[0];
setTimeout(() => resolve('callback'), 200);
return Promise.resolve('promise');
""")
> assert_success(response, "promise")
response = <Response: status=200 body={"value": "callback"}>
session = <Session 7043ead8fdbbd6208f4ccd1c23efd852>
webdriver/tests/classic/execute_async_script/promise.py:128:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
response = <Response: status=200 body={"value": "callback"}>, value = 'promise'
def assert_success(response, value=None):
"""
Verify that the provided webdriver.Response instance described
a valid success response as defined by `dfn-send-a-response` and
the provided response value.
:param response: ``webdriver.Response`` instance.
:param value: Expected value of the response body, if any.
"""
assert response.status == 200, str(response.error)
if value is not None:
> assert response.body["value"] == value
E AssertionError: assert 'callback' == 'promise'
E
E - promise
E + callback
response = <Response: status=200 body={"value": "callback"}>
value = 'promise'
webdriver/tests/support/asserts.py:76: AssertionError
FAIL test_returned_promise_fulfilled_over_callback - AssertionError: assert 'callback' == 'promise'
session = <Session 334daf17151a9d87fe28fb73da0d8ba7>
def test_returned_promise_fulfilled_over_callback(session):
session.timeouts.script = 1
response = execute_async_script(session, """
let resolve = arguments[0];
setTimeout(() => resolve('callback'), 200);
return Promise.resolve('promise');
""")
> assert_success(response, "promise")
response = <Response: status=200 body={"value": "callback"}>
session = <Session 334daf17151a9d87fe28fb73da0d8ba7>
webdriver/tests/classic/execute_async_script/promise.py:128:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
response = <Response: status=200 body={"value": "callback"}>, value = 'promise'
def assert_success(response, value=None):
"""
Verify that the provided webdriver.Response instance described
a valid success response as defined by `dfn-send-a-response` and
the provided response value.
:param response: ``webdriver.Response`` instance.
:param value: Expected value of the response body, if any.
"""
assert response.status == 200, str(response.error)
if value is not None:
> assert response.body["value"] == value
E AssertionError: assert 'callback' == 'promise'
E
E - promise
E + callback
response = <Response: status=200 body={"value": "callback"}>
value = 'promise'
webdriver/tests/support/asserts.py:76: AssertionError
FAIL test_returned_promise_fulfilled_over_callback - AssertionError: assert 'callback' == 'promise'
session = <Session 1f6721481242f7e0580492415e85b4e3>
def test_returned_promise_fulfilled_over_callback(session):
session.timeouts.script = 1
response = execute_async_script(session, """
let resolve = arguments[0];
setTimeout(() => resolve('callback'), 200);
return Promise.resolve('promise');
""")
> assert_success(response, "promise")
response = <Response: status=200 body={"value": "callback"}>
session = <Session 1f6721481242f7e0580492415e85b4e3>
webdriver/tests/classic/execute_async_script/promise.py:128:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
response = <Response: status=200 body={"value": "callback"}>, value = 'promise'
def assert_success(response, value=None):
"""
Verify that the provided webdriver.Response instance described
a valid success response as defined by `dfn-send-a-response` and
the provided response value.
:param response: ``webdriver.Response`` instance.
:param value: Expected value of the response body, if any.
"""
assert response.status == 200, str(response.error)
if value is not None:
> assert response.body["value"] == value
E AssertionError: assert 'callback' == 'promise'
E
E - promise
E + callback
response = <Response: status=200 body={"value": "callback"}>
value = 'promise'
webdriver/tests/support/asserts.py:76: AssertionError
0:55.45 INFO Got 10 unexpected results, with 0 unexpected passes
0:55.45 wptserve INFO Stopped http server on 127.0.0.1:8000
0:55.45 wptserve INFO Stopped http server on 127.0.0.1:8001
0:55.45 wptserve INFO Stopped http server on 127.0.0.1:8002
0:55.46 wptserve INFO Stopped http server on 127.0.0.1:8445
0:55.46 wptserve INFO Stopped http server on 127.0.0.1:8444
0:55.46 wptserve INFO Stopped http server on 127.0.0.1:8003
0:55.46 wptserve INFO Stopped http server on 127.0.0.1:8443
0:55.46 wptserve INFO Stopped http server on 127.0.0.1:8446
0:55.47 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
0:55.47 wptserve INFO Stopped http server on 127.0.0.1:9000
0:55.85 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
0:55.85 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
0:55.90 INFO Removed font: Ahem.ttf
0:55.92 INFO Closing logging queue
0:55.92 INFO queue closed
0:55.94 INFO ::: Ran 10 of expected 10 iterations.
0:55.94 INFO ## All results ##
0:55.94 INFO ### /webdriver/tests/classic/execute_async_script/promise.py ###
0:55.94 INFO | Subtest | Results | Messages |
0:55.94 INFO |-------------------------------------------------|---------|--------------------------------------------------|
0:55.94 INFO | | OK | |
0:55.94 INFO | `test_promise_resolve` | PASS | |
0:55.94 INFO | `test_promise_resolve_delayed` | PASS | |
0:55.94 INFO | `test_promise_all_resolve` | PASS | |
0:55.94 INFO | `test_await_promise_resolve` | PASS | |
0:55.94 INFO | `test_promise_resolve_timeout` | PASS | |
0:55.94 INFO | `test_promise_reject` | PASS | |
0:55.94 INFO | `test_promise_reject_delayed` | PASS | |
0:55.94 INFO | `test_promise_all_reject` | PASS | |
0:55.94 INFO | `test_await_promise_reject` | PASS | |
0:55.94 INFO | `test_promise_reject_timeout` | PASS | |
0:55.94 INFO | `test_returned_promise_fulfilled_over_callback` | FAIL | `AssertionError: assert 'callback' == 'promise'` |
0:55.94 INFO | `test_returned_promise_rejected_over_callback` | PASS | |
0:55.94 INFO | `test_returned_poisoned_thenable` | PASS | |
0:55.94 INFO
0:55.94 INFO ### /webdriver/tests/classic/execute_script/promise.py ###
0:55.94 INFO | Subtest | Results | Messages |
0:55.94 INFO |-----------------------------------|---------|----------|
0:55.94 INFO | | OK | |
0:55.94 INFO | `test_promise_resolve` | PASS | |
0:55.94 INFO | `test_promise_resolve_delayed` | PASS | |
0:55.94 INFO | `test_promise_all_resolve` | PASS | |
0:55.94 INFO | `test_await_promise_resolve` | PASS | |
0:55.94 INFO | `test_promise_resolve_timeout` | PASS | |
0:55.94 INFO | `test_promise_reject` | PASS | |
0:55.94 INFO | `test_promise_reject_delayed` | PASS | |
0:55.94 INFO | `test_promise_all_reject` | PASS | |
0:55.94 INFO | `test_await_promise_reject` | PASS | |
0:55.94 INFO | `test_promise_reject_timeout` | PASS | |
0:55.94 INFO | `test_returned_poisoned_thenable` | PASS | |
0:55.94 INFO
0:55.94 INFO ::: Running tests in a loop with restarts 10 times : PASS
0:55.94 INFO :::
0:55.94 INFO ::: Test verification PASS
0:55.94 INFO :::
[taskcluster 2026-01-25 02:48:39.188Z] === Task Finished ===
[taskcluster 2026-01-25 02:48:39.582Z] Successful task run with exit code: 0 completed in 233.894 seconds
Loading