u-boot/test/py
Tom Rini 8162f35a10 Merge patch series "test: Improvements to ut command and test-suite running"
Simon Glass <sjg@chromium.org> says:

The current method of running unit tests relies on subcommands of the
ut command. Only the code in each subcommand knows how to find the tests
related to that subcomand.

This is not ideal and we now have quite a few subcommands which do
nothing but locate the relevant tests in a linker list, then call a
common function to run them.

This series adds a list of test suites, so that these subcommands can be
removed.

An issue with 'ut all' is that it doesn't record how many tests failed
overall, so it is necessary to examine copious amounts of output to look
for failures. This series adds a new 'total' feature allow recording the
total number of failed tests.

To help with 'ut all' a new pytest is created which runs it (as well as
'ut info') and makes sure that all is well. Due to the 'ut all' failures
this does not pass, so the test is disabled for now. It is here because
it provides security against misnaming a test suite and causing it not
to run.

Future work may:
- get 'ut all' passing
- enable test_suite() in CL, to ensure that 'ut all' keeps passing
- record duration of each suite
- allow running the tests in random order to tease out dependencies
- tweak the output to remove common prefixes
- getting rid of bootstd, optee and seame 'ut' subcommands

Link: https://lore.kernel.org/r/20250120212613.516664-1-sjg@chromium.org
2025-01-24 14:35:37 -06:00
..
tests Merge patch series "test: Improvements to ut command and test-suite running" 2025-01-24 14:35:37 -06:00
.gitignore test/py: Implement pytest infrastructure 2016-01-20 19:06:23 -07:00
conftest.py test: Drop the _test suffix on linker lists 2025-01-24 14:34:40 -06:00
multiplexed_log.css SPDX: Convert all of our single license tags to Linux Kernel style 2018-05-07 09:34:12 -04:00
multiplexed_log.py test: Add a way to set the environment for a pytest 2023-02-14 09:43:27 -07:00
pytest.ini test/py: Allow tests to be marked single-threaded only 2022-09-12 18:06:36 -04:00
requirements.txt pytest: requirements.txt: Resync with the rest of the project 2024-08-21 08:25:23 -06:00
test.py test: remove unused import from pkg_resources 2024-04-12 08:53:31 -06:00
u_boot_console_base.py test: add command to 'Boot fail' message 2024-11-29 14:41:47 -06:00
u_boot_console_exec_attach.py test: Allow connecting to a running board 2024-11-13 12:01:35 -06:00
u_boot_console_sandbox.py test: Decode exceptions only with sandbox 2024-07-04 09:25:21 -06:00
u_boot_spawn.py test: Try to shut down the lab console gracefully 2024-11-13 12:01:35 -06:00
u_boot_utils.py test: Add a way to set the environment for a pytest 2023-02-14 09:43:27 -07:00