CASE LogListenerTests [STARTED]
TestLog [RUNNING] [PASSED] (5 ms)
TestLogMany [RUNNING] [PASSED] (1 ms)
TestDroppedLogs [RUNNING] [PASSED] (2 ms)
CASE LogListenerTests [PASSED]
CASE PublishDataTests [STARTED]
RunTestDontPublishData [RUNNING]
CASE publish_data_helper_tests [STARTED]
publish_data [RUNNING] [PASSED] (1 ms)
CASE publish_data_helper_tests [PASSED]
====================================================
Results for test binary "/test-memfs/0/publish-data-helper":
SUCCESS! All test cases passed!
CASES: 1 SUCCESS: 1 FAILED: 0
====================================================
PASSED: /test-memfs/0/publish-data-helper passed
[PASSED] (94 ms)
RunTestsPublishData [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/1/publish-data-helper
CASE publish_data_helper_tests [STARTED]
publish_data [RUNNING] [PASSED] (1 ms)
CASE publish_data_helper_tests [PASSED]
====================================================
Results for test binary "/test-memfs/1/publish-data-helper":
SUCCESS! All test cases passed!
CASES: 1 SUCCESS: 1 FAILED: 0
====================================================
PASSED: /test-memfs/1/publish-data-helper passed
[PASSED] (122 ms)
RunAllTestsPublishData [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/2/publish-data-helper
CASE publish_data_helper_tests [STARTED]
publish_data [RUNNING] [PASSED] (0 ms)
CASE publish_data_helper_tests [PASSED]
====================================================
Results for test binary "/test-memfs/2/publish-data-helper":
SUCCESS! All test cases passed!
CASES: 1 SUCCESS: 1 FAILED: 0
====================================================
PASSED: /test-memfs/2/publish-data-helper passed
SUMMARY: Ran 1 tests: 0 failed (0.001 sec)
[PASSED] (145 ms)
CASE PublishDataTests [PASSED]
CASE FuchsiaComponentInfo [STARTED]
TestFileComponentInfoTest [RUNNING] [PASSED] (3 ms)
CASE FuchsiaComponentInfo [PASSED]
CASE DiscoverAndRunTests [STARTED]
DiscoverAndRunTestsBasicPass [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/3/succeed1.sh
Success!
PASSED: /test-memfs/3/succeed1.sh passed
------------------------------------------------
RUNNING TEST: /test-memfs/3/succeed2.sh
Success!
PASSED: /test-memfs/3/succeed2.sh passed
SUMMARY: Ran 2 tests: 0 failed (0.001 sec)
[PASSED] (138 ms)
DiscoverAndRunTestsBasicFail [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/4/succeed.sh
Success!
PASSED: /test-memfs/4/succeed.sh passed
------------------------------------------------
RUNNING TEST: /test-memfs/4/fail.sh
Failure!
FAILURE: /test-memfs/4/fail.sh exited with nonzero status: 77
The following tests failed:
/test-memfs/4/fail.sh: returned nonzero: 77
SUMMARY: Ran 2 tests: 1 failed (0.001 sec)
[PASSED] (140 ms)
DiscoverAndRunTestsFallsBackToDefaultDirs [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/5/succeed.sh
Success!
PASSED: /test-memfs/5/succeed.sh passed
SUMMARY: Ran 1 tests: 0 failed (0.001 sec)
[PASSED] (73 ms)
DiscoverAndRunTestsFailsWithNoTestGlobsOrDefaultDirs [RUNNING]Test list path, test directory globs or default test directories must be specified. [PASSED] (9 ms)
DiscoverAndRunTestsFailsWithBadArgs [RUNNING]Usage: ./runtests [-q|-v] [-S|-s] [-M|-m] [-L|-l] [-P|-p] [-a]
[-w timeout] [-t test names] [-o directory]
[directory globs ...]
[-- [-args -to -the -test -bin]]
The required [directory globs...] is a list of
globs which match directories containing tests to run,
non-recursively. Note that non-directories captured by
a glob will be silently ignored.
After directory globs, `--` can be followed by any
number of arguments to pass to the binaries under
test.
options:
-h: See this message
-d: Dry run, just print test file names and exit
-v: Verbose output [1]
-q: Quiet output
-S: Turn ON Small tests (on by default) [2]
-s: Turn OFF Small tests [2]
-M: Turn ON Medium tests (on by default) [2]
-m: Turn OFF Medium tests [2]
-L: Turn ON Large tests (off by default) [2]
-l: Turn OFF Large tests [2]
-P: Turn ON Performance tests (off by default) [2]
-p: Turn OFF Performance tests [2]
-a: Turn on All tests
-t: Filter tests by name
(accepts a comma-separated list)
-f: Run tests specified in this file [3]
-r: Repeat the test suite this many times
-o: Write test output to a directory [4]
-w: Watchdog timeout [5]
(accepts the timeout value in seconds)
The default is up to each test.
[1] -v will pass "v=1" argument to the test binary.
Not all test frameworks will honor this argument,
and some, like Rust, may interpret it as a filter.
Use "-- --nocapture" for a similar behaviour
when running Rust tests.
[2] The test selection options -[sSmMlLpP] only work
for tests that support the RUNTESTS_TEST_CLASS
environment variable.
[3] -f and [directory globs ...] are mutually
exclusive.
[4] If -o is enabled, then a JSON summary of the test
results will be written to a file named
"summary.json" under the desired directory, in
addition to each test's standard output and error.
The summary contains a listing of the tests
executed by full path (e.g.,
/boot/test/core/futex_test), as well as whether
the test passed or failed. For details, see
//system/ulib/runtests-utils/summary-schema.json
[5] The watchdog timeout option -w only works for
tests that support the RUNTESTS_WATCHDOG_TIMEOUT
environment variable.
[PASSED] (24 ms)
DiscoverAndRunTestsWithGlobs [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/8/succeed.sh
Success!
PASSED: /test-memfs/8/succeed.sh passed
------------------------------------------------
RUNNING TEST: /test-memfs/8/A/B/C/succeed.sh
Success!
PASSED: /test-memfs/8/A/B/C/succeed.sh passed
------------------------------------------------
RUNNING TEST: /test-memfs/8/A/D/C/succeed.sh
Success!
PASSED: /test-memfs/8/A/D/C/succeed.sh passed
SUMMARY: Ran 3 tests: 0 failed (0.001 sec)
[PASSED] (253 ms)
DiscoverAndRunTestsWithOutput [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/9/succeed.sh
Success!
PASSED: /test-memfs/9/succeed.sh passed
------------------------------------------------
RUNNING TEST: /test-memfs/9/fail.sh
Failure!
FAILURE: /test-memfs/9/fail.sh exited with nonzero status: 77
The following tests failed:
/test-memfs/9/fail.sh: returned nonzero: 77
SUMMARY: Ran 2 tests: 1 failed (0.001 sec)
[PASSED] (193 ms)
DiscoverAndRunTestsWithSyslogOutput [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/10/succeed.sh
Success!
PASSED: /test-memfs/10/succeed.sh passed
------------------------------------------------
RUNNING TEST: /test-memfs/10/fail.sh
Failure!
FAILURE: /test-memfs/10/fail.sh exited with nonzero status: 77
The following tests failed:
/test-memfs/10/fail.sh: returned nonzero: 77
SUMMARY: Ran 2 tests: 1 failed (0.001 sec)
[PASSED] (198 ms)
CASE DiscoverAndRunTests [PASSED]
CASE RunTests [STARTED]
RunTestsWithVerbosity [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/11/succeed.sh
Success! v=77
PASSED: /test-memfs/11/succeed.sh passed
[PASSED] (97 ms)
RunTestsWithArguments [RUNNING]
------------------------------------------------
RUNNING TEST: /test-memfs/12/succeed.sh
Success! first second third -4 -- - seventh
PASSED: /test-memfs/12/succeed.sh passed
[PASSED] (97 ms)
CASE RunTests [PASSED]
CASE DiscoverTestsInListFile [STARTED]
DiscoverTestsInListFileWithTrailingWhitespace [RUNNING] [PASSED] (0 ms)
CASE DiscoverTestsInListFile [PASSED]
CASE DiscoverTestsInDirGlobs [STARTED]
DiscoverTestsInDirGlobsBasic [RUNNING] [PASSED] (23 ms)
DiscoverTestsInDirGlobsFilter [RUNNING] [PASSED] (19 ms)
DiscoverTestsInDirGlobsIgnore [RUNNING] [PASSED] (31 ms)
CASE DiscoverTestsInDirGlobs [PASSED]
CASE RunTest [STARTED]
RunTestSuccess [RUNNING]PASSED: /test-memfs/17/succeed.sh passed
[PASSED] (57 ms)
RunTestSuccessWithStdout [RUNNING]Expect this!
PASSED: /test-memfs/18/succeed.sh passed
[PASSED] (67 ms)
RunTestFailureWithStderr [RUNNING]Expect this!
FAILURE: /test-memfs/19/fail.sh exited with nonzero status: 77
[PASSED] (73 ms)
RunTestFailureToLoadFile [RUNNING]FAILURE: Failed to launch i/do/not/exist/: -25 (ZX_ERR_NOT_FOUND): failed to load executable from i/do/not/exist/
[PASSED] (0 ms)
CASE RunTest [PASSED]
CASE ResolveGlobs [STARTED]
ResolveGlobsNoMatches [RUNNING] [PASSED] (10 ms)
ResolveGlobsMultipleMatches [RUNNING] [PASSED] (32 ms)
CASE ResolveGlobs [PASSED]
CASE WriteSummaryJSON [STARTED]
WriteSummaryJSONSucceeds [RUNNING] [PASSED] (1 ms)
WriteSummaryJSONSucceedsWithoutSyslogPath [RUNNING] [PASSED] (0 ms)
WriteSummaryJSONBadTestName [RUNNING]Error: output_file was empty or all slashes: /////
[PASSED] (0 ms)
CASE WriteSummaryJSON [PASSED]
CASE MkDirAll [STARTED]
MkDirAllTooLong [RUNNING] [PASSED] (0 ms)
MkDirAllAlreadyExists [RUNNING] [PASSED] (20 ms)
MkDirAllParentAlreadyExists [RUNNING] [PASSED] (17 ms)
MkDirAllParentDoesNotExist [RUNNING] [PASSED] (17 ms)
CASE MkDirAll [PASSED]
CASE JoinPath [STARTED]
JoinPathNoTrailingSlash [RUNNING] [PASSED] (0 ms)
JoinPathTrailingSlash [RUNNING] [PASSED] (0 ms)
JoinPathAbsoluteChild [RUNNING] [PASSED] (0 ms)
CASE JoinPath [PASSED]
CASE IsInWhitelist [STARTED]
EmptyWhitelist [RUNNING] [PASSED] (0 ms)
NonemptyWhitelist [RUNNING] [PASSED] (0 ms)
CASE IsInWhitelist [PASSED]
CASE ParseTestNames [STARTED]
ParseTestNamesEmptyStr [RUNNING] [PASSED] (0 ms)
ParseTestNamesEmptyStrInMiddle [RUNNING] [PASSED] (1 ms)
ParseTestNamesNormal [RUNNING] [PASSED] (0 ms)
ParseTestNamesTrailingComma [RUNNING] [PASSED] (0 ms)
CASE ParseTestNames [PASSED]
CASE TestHelpers [STARTED]
ScopedDirsAndFilesAreIndeedScoped [RUNNING] [PASSED] (61 ms)
CASE TestHelpers [PASSED]
====================================================
Results for test binary "/boot/test/sys/runtests-utils-test":
SUCCESS! All test cases passed!
CASES: 15 SUCCESS: 15 FAILED: 0
====================================================