u-boot/test
Tom Rini 8162f35a10 Merge patch series "test: Improvements to ut command and test-suite running"
Simon Glass <sjg@chromium.org> says:

The current method of running unit tests relies on subcommands of the
ut command. Only the code in each subcommand knows how to find the tests
related to that subcomand.

This is not ideal and we now have quite a few subcommands which do
nothing but locate the relevant tests in a linker list, then call a
common function to run them.

This series adds a list of test suites, so that these subcommands can be
removed.

An issue with 'ut all' is that it doesn't record how many tests failed
overall, so it is necessary to examine copious amounts of output to look
for failures. This series adds a new 'total' feature allow recording the
total number of failed tests.

To help with 'ut all' a new pytest is created which runs it (as well as
'ut info') and makes sure that all is well. Due to the 'ut all' failures
this does not pass, so the test is disabled for now. It is here because
it provides security against misnaming a test suite and causing it not
to run.

Future work may:
- get 'ut all' passing
- enable test_suite() in CL, to ensure that 'ut all' keeps passing
- record duration of each suite
- allow running the tests in random order to tease out dependencies
- tweak the output to remove common prefixes
- getting rid of bootstd, optee and seame 'ut' subcommands

Link: https://lore.kernel.org/r/20250120212613.516664-1-sjg@chromium.org
2025-01-24 14:35:37 -06:00
..
boot test: Pass the test state to cmd_ut_category() 2025-01-24 14:34:41 -06:00
cmd test: Drop the function for running seama tests 2025-01-24 14:34:40 -06:00
common Merge patch series "test: Improvements to ut command and test-suite running" 2025-01-24 14:35:37 -06:00
dm Merge patch series "test: Improvements to ut command and test-suite running" 2025-01-24 14:35:37 -06:00
env test: Drop the function for running env tests 2025-01-24 14:34:40 -06:00
fs test: fs: fs-test: Move the tests to use sha256sum 2024-01-11 21:19:25 -05:00
fuzz global: Rename SPL_ to XPL_ 2024-10-11 11:44:48 -06:00
hush test: Drop the function for running hush tests 2025-01-24 14:34:40 -06:00
image spl: Create a function to init spl_load_info 2024-08-23 15:58:42 -06:00
lib Merge patch series "test: Improvements to ut command and test-suite running" 2025-01-24 14:35:37 -06:00
log test: Drop the function for running log tests 2025-01-24 14:34:40 -06:00
optee test: Drop the _test suffix on linker lists 2025-01-24 14:34:40 -06:00
overlay test: Pass the test state to cmd_ut_category() 2025-01-24 14:34:41 -06:00
py Merge patch series "test: Improvements to ut command and test-suite running" 2025-01-24 14:35:37 -06:00
stdint Revert "Merge patch series "arm: dts: am62-beagleplay: Fix Beagleplay Ethernet"" 2024-05-19 08:16:36 -06:00
cmd_ut.c test: Move help into the suite declaration 2025-01-24 14:34:41 -06:00
Kconfig test: Remove ASN1 library test 2024-10-14 17:58:52 -06:00
Makefile test: Move time_ut test into lib 2024-11-13 11:56:02 -06:00
run
test-main.c test: Record and show the totals for all test runs 2025-01-24 14:34:41 -06:00
ut.c test: Move stats into a struct 2025-01-24 14:34:41 -06:00