============================= test session starts =============================
platform win32 -- Python 3.8.10, pytest-6.2.2, py-1.10.0, pluggy-0.13.1 -- C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
cachedir: .pytest_cache
rootdir: C:\b\s\w\ir\x\w\crossbench, configfile: pytest.ini
plugins: pyfakefs-5.5.0, xdist-3.3.1
created: 4/4 workers
4 workers [23 items]
scheduling tests via LoadGroupScheduling
crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_1_custom_chrome_download
crossbench\tests\end2end\desktop\test_cli.py::test_loading_page_config
crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_pre_115_canary
crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_0@end2end-benchmark
[gw1] [ 4%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_1_custom_chrome_download
[gw2] [ 8%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_loading_page_config
[gw0] [ 13%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_0@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_1@end2end-benchmark
[gw0] [ 17%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_1@end2end-benchmark
crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_major_version_milestone
crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_major_version_chrome_for_testing
crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_1_chrome_safari@end2end-benchmark
[gw0] [ 21%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_speedometer_2_1_chrome_safari@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_jetstream_2_0@end2end-benchmark
[gw0] [ 26%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_jetstream_2_0@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_jetstream_2_1@end2end-benchmark
[gw0] [ 30%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_jetstream_2_1@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_jetstream_2_2@end2end-benchmark
[gw0] [ 34%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_jetstream_2_2@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_loading@end2end-benchmark
[gw0] [ 39%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_loading@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_loading_playback_urls@end2end-benchmark
[gw0] [ 43%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_loading_playback_urls@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_loading_playback@end2end-benchmark
[gw0] [ 47%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_loading_playback@end2end-benchmark
crossbench\tests\end2end\desktop\test_cli.py::test_loading_playback_firefox@end2end-benchmark
[gw0] [ 52%] SKIPPED crossbench\tests\end2end\desktop\test_cli.py::test_loading_playback_firefox@end2end-benchmark
crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_speedometer_21
[gw3] [ 56%] ERROR crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_pre_115_canary
[gw1] [ 60%] ERROR crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_major_version_milestone
[gw2] [ 65%] ERROR crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_major_version_chrome_for_testing
crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_specific_version_pre_115_stable
crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_old_major_version
[gw0] [ 69%] ERROR crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_speedometer_21
crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_motionmark_12
crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_speedometer_20
[gw1] [ 73%] ERROR crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_old_major_version
crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_jetstream_20
[gw3] [ 78%] ERROR crossbench\tests\end2end\desktop\browser\chrome\test_downloader.py::test_download_specific_version_pre_115_stable
crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_jetstream_21
[gw0] [ 82%] ERROR crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_motionmark_12
crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_motionmark_13
[gw2] [ 86%] ERROR crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_speedometer_20
[gw1] [ 91%] ERROR crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_jetstream_20
[gw3] [ 95%] ERROR crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_jetstream_21
[gw0] [100%] ERROR crossbench\tests\end2end\desktop\cbb\test_cbb.py::test_motionmark_13
=================================== ERRORS ====================================
_______________ ERROR at setup of test_download_pre_115_canary ________________
[gw3] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_pre_115_canary>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
----------------------------- Captured log setup ------------------------------
[32mINFO [0m root:conftest.py:158 No custom adb path.
[32mINFO [0m root:conftest.py:71 browser path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chrome\chrome-win\chrome.exe
[32mINFO [0m root:conftest.py:143 No Android device detected.
[32mINFO [0m root:conftest.py:61 driver path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chromedriver\chromedriver_win32\chromedriver.exe
[32mINFO [0m root:conftest.py:88 gsutil path: C:\b\s\w\ir\kitchen-checkout\depot_tools\gsutil.py.exe
___________ ERROR at setup of test_download_major_version_milestone ___________
[gw1] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_major_version_milestone>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
----------------------------- Captured log setup ------------------------------
[32mINFO [0m root:conftest.py:158 No custom adb path.
[32mINFO [0m root:conftest.py:71 browser path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chrome\chrome-win\chrome.exe
[32mINFO [0m root:conftest.py:143 No Android device detected.
[32mINFO [0m root:conftest.py:61 driver path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chromedriver\chromedriver_win32\chromedriver.exe
[32mINFO [0m root:conftest.py:88 gsutil path: C:\b\s\w\ir\kitchen-checkout\depot_tools\gsutil.py.exe
______ ERROR at setup of test_download_major_version_chrome_for_testing _______
[gw2] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_major_version_chrome_for_testing>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
----------------------------- Captured log setup ------------------------------
[32mINFO [0m root:conftest.py:158 No custom adb path.
[32mINFO [0m root:conftest.py:71 browser path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chrome\chrome-win\chrome.exe
[32mINFO [0m root:conftest.py:143 No Android device detected.
[32mINFO [0m root:conftest.py:61 driver path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chromedriver\chromedriver_win32\chromedriver.exe
[32mINFO [0m root:conftest.py:88 gsutil path: C:\b\s\w\ir\kitchen-checkout\depot_tools\gsutil.py.exe
____________________ ERROR at setup of test_speedometer_21 ____________________
[gw0] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_speedometer_21>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
----------------------------- Captured log setup ------------------------------
[32mINFO [0m root:conftest.py:158 No custom adb path.
[32mINFO [0m root:conftest.py:71 browser path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chrome\chrome-win\chrome.exe
[32mINFO [0m root:conftest.py:143 No Android device detected.
[32mINFO [0m root:conftest.py:61 driver path: C:\b\s\w\ir\x\w\rc\chromefk30js4m\zip\chromedriver\chromedriver_win32\chromedriver.exe
[32mINFO [0m root:conftest.py:88 gsutil path: C:\b\s\w\ir\kitchen-checkout\depot_tools\gsutil.py.exe
______________ ERROR at setup of test_download_old_major_version ______________
[gw1] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_major_version_milestone>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
_______ ERROR at setup of test_download_specific_version_pre_115_stable _______
[gw3] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_pre_115_canary>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
____________________ ERROR at setup of test_motionmark_12 _____________________
[gw0] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_speedometer_21>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
____________________ ERROR at setup of test_speedometer_20 ____________________
[gw2] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_major_version_chrome_for_testing>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
_____________________ ERROR at setup of test_jetstream_20 _____________________
[gw1] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_major_version_milestone>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
_____________________ ERROR at setup of test_jetstream_21 _____________________
[gw3] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_download_pre_115_canary>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
____________________ ERROR at setup of test_motionmark_13 _____________________
[gw0] win32 -- Python 3.8.10 C:\Users\chrome-bot\AppData\Local\vpython-root.0\store\python_venv-6dmjt37o8g855c1tre3oab6kmk\contents\Scripts\python3.exe
request = <SubRequest 'gsutil_path' for <Function test_speedometer_21>>
@pytest.fixture(scope="session", autouse=True)
def gsutil_path(request) -> pathlib.Path:
maybe_gsutil_path: Optional[pathlib.Path] = _get_app_path(
request, "--test-gsutil-path")
if maybe_gsutil_path:
logging.info("gsutil path: %s", maybe_gsutil_path)
> assert maybe_gsutil_path.exists()
E AssertionError: assert False
E + where False = <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')>()
E + where <bound method Path.exists of WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe')> = WindowsPath('C:/b/s/w/ir/kitchen-checkout/depot_tools/gsutil.py.exe').exists
crossbench\tests\end2end\conftest.py:89: AssertionError
=========================== short test summary info ===========================
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:125: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:304: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:62: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:86: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:148: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:182: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:212: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:245: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:278: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:322: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:342: Tests temporarily skipped on windows
SKIPPED [1] crossbench\tests\end2end\desktop\test_cli.py:362: Tests temporarily skipped on windows
======================= 12 skipped, 11 errors in 8.30s ========================