KUnit not running on most kernels

[broonie]

Eric Biggers reports that we're not running KUnit on most trees:

https://lore.kernel.org/kernelci/20260419005019.GA18115@quark/T/#mb07cde13918989619b1c923674a480c47a9dc5fek

only stable-6.1.y for some reason. I've had an initial look at the config for the pipeline but can't see anything that should cause this.

[nuclearcat]

As amount of tests submitted from kunit exceed nginx default upload limit (in Azure k8s), they were silently discarded. I bumped up limit: kernelci/kernelci-api#681

[nuclearcat]

I guess issue resolved and i can close it?

[ebiggers]

Thanks! They're not yet on the dashboard, but I assume it will take a little time for the new code to be deployed and for a new test run to be triggered.

Do you know if KernelCI is passing the --alltests option to kunit.py yet (or doing something equivalent that uses the all_tests.config)? That's the other thing that I think will need to be done at some point, if it hasn't already. KUnit tests always depend on other kconfig options, and those options are being enabled in a centralized place in all_tests.config for testing systems to use to run "all" the tests.

[nuclearcat]

Yes, we supply --alltests to kunit-x86_64 job. (and --arch=x86_64)
About enabling kernel config options from all_tests.config - i will work on that, i guess it will make this tests more useful. I will open new issue about that.

[nuclearcat]

After digging a bit, seems --alltests already does apply this fragment internally after kernel 6.1

[ebiggers]

Yes, it does.

I see the kunit test job on the dashboard for mainline now. Is there a way to filter by test name? There are just 9000 tests in one list. There's a search box, but it doesn't seem to do anything.

[ebiggers]

The CRC and crypto tests are indeed in the list, but the only way to find them seems to be scrolling through the list.

[ebiggers]

Another thing I notice is that when I click on an individual test suite, for example kunit.exec.sha3, the "Log excerpt" that's shown doesn't actually include the portion of the log that has the test's output.

[broonie]

Another thing I notice is that when I click on an individual test suite, for example kunit.exec.sha3, the "Log excerpt" that's shown doesn't actually include the portion of the log that has the test's output.

We're running KUnit via the KUnit runner, it looks like we'd want some improvements there to get the logs - looking at the JSON it generates:

https://builds.sirena.org.uk/6596a02b207886e9e00bb0161c7fd59fea53c081/x86_64/kunit/kunit.json

there's no log excerpts or references to the log and I'm not finding an option to generate them.

[broonie]

The CRC and crypto tests are indeed in the list, but the only way to find them seems to be scrolling through the list.

You're quite right, that seems to be an issue here. I filed kernelci/dashboard#1871 about that, and also kernelci/dashboard#1872 for the other thing I expected to work.