test.yml: update lava-test-plans and testkit pins by qcom-anilyada · Pull Request #3058 · qualcomm-linux/meta-qcom

Anil (qcom-anilyada) · 2026-09-02T06:46:01Z

The lava-test-plans and testkit pins are several weeks behind upstream.
Bump both to pick up the accumulated improvements.

Update LAVA_TEST_PLANS_REF from 72813c6 to 63cf5b1. Highlights:

disable audio tests on iq-x7181-evk (hamoa) temporarily
group test cases by functional area (testkit-2026.08.30 layout)
validate a whole batch of jobs with one container
re-enable fastrpc test on meta-qcom devices
rename meta-qcom-3rdparty project to meta-qcom-arduino
add qcom-deb-images project for Debian image testing
add EXTRA_METADATA support for custom job metadata keys
raise QDL deploy timeout and enable ramdumps by default

Update TESTKIT_REF from testkit-2026.08.14 to testkit-2026.09.20
(seven intermediate tags). Highlights:

new suites: UART, SPI, I3C, CAN, I2C capability, QPS615
runtime, USB DT capability, DeviceTree HW capability,
platform runtime foundation, P0 runtime coverage
add storage, PKCS11, PIL/SMP2P, KVM and interconnect/EDAC
validations
Ethernet validation enhancements
module reload plan updates
fixes across audio, camera, graphics and Bluetooth suites

Signed-off-by: Anil Yadav anilyada@qti.qualcomm.com

Dmitry Baryshkov (lumag)

disable fastrpc_test due to kernel regression

Does it mean that we would no longer execute fastrpc_test as a part of the CI? In such a case, definite NAK.

Ricardo Salveti (ricardosalveti) · 2026-09-02T22:52:05Z

disable fastrpc_test due to kernel regression
Disable fastrpc_test for iq-x7181-evk, rb1-core-kit, and
shikra-evk due to kernel regression from reverting the fastrpc
UAF/panic fix patch. Test will remain disabled until the kernel
fix is merged.

This would be a good example of known issues instead.

Dmitry Baryshkov (lumag) · 2026-09-03T12:26:47Z

disable fastrpc_test due to kernel regression
Disable fastrpc_test for iq-x7181-evk, rb1-core-kit, and
shikra-evk due to kernel regression from reverting the fastrpc
UAF/panic fix patch. Test will remain disabled until the kernel
fix is merged.

This would be a good example of known issues instead.

Well, not really. It means that the kernel needs to be fixed, maybe by dropping all the extra fastrpc patches.

Anil (qcom-anilyada) · 2026-09-17T05:52:07Z

Here's the run on fastrpc testcase on latest nightly build:

Target	Job ID	Test Suite	Test Result
glymur-crd	https://lava.infra.foundries.io/scheduler/job/425775	fastrpc_test	skip
iq-8275-evk	https://lava.infra.foundries.io/scheduler/job/425785	fastrpc_test	pass
iq-9075-evk	https://lava.infra.foundries.io/scheduler/job/425778	fastrpc_test	pass
iq-x7181-evk	https://lava.infra.foundries.io/scheduler/job/425783	fastrpc_test	pass
kaanapali-mtp	https://lava.infra.foundries.io/scheduler/job/425777	fastrpc_test	pass
qcs615-ride	https://lava.infra.foundries.io/scheduler/job/425784	fastrpc_test	pass
qcs8300-ride-sx	https://lava.infra.foundries.io/scheduler/job/425786	fastrpc_test	pass
qcs9100-ride-sx	https://lava.infra.foundries.io/scheduler/job/425780	fastrpc_test	fail
rb1-core-kit	https://lava.infra.foundries.io/scheduler/job/425776	fastrpc_test	skip
rb3gen2-core-kit	https://lava.infra.foundries.io/scheduler/job/425779	fastrpc_test	pass
shikra-iqs-evk	https://lava.infra.foundries.io/scheduler/job/425787	fastrpc_test	fail
sm8750-mtp	https://lava.infra.foundries.io/scheduler/job/425782	fastrpc_test	pass

The skips on rb1 and glymur will be addressed in this PR#532

anankulk Ekansh Gupta (@ekanshibu) , please investigate and comment on the failures, so that we can get this PR merged and update the ref
Error from logs:

qcs9100-ride-sx [FAIL]

ERROR 0x80000416: Unable to create FastRPC session on domain 4

shikra-iqs-evk [FAIL]

ERROR 0x80000406: Unable to create FastRPC session on domain 3

Anil (qcom-anilyada) · 2026-09-23T07:45:50Z

fastrpc is working on the latest meta-qcom tip, I've enabled the fastrpc testcases again, shared the results on the PR below. Please review. It will unblock the current PR.

qualcomm-linux/lava-test-plans#101

Milosz Wasilewski (mwasilew) · 2026-09-24T19:40:18Z

Anil (@qcom-anilyada) maybe you can squash #3057 and #3058 into one PR? All changes in lava-test-plans were merged.

Dmitry Baryshkov (@lumag) Ricardo Salveti de Araujo (@rsalveti) I added support for "known issues" in #3137. The list still needs to be populated after it's merged.

github-actions · 2026-09-25T09:30:44Z

Test run workflow

Test jobs for commit `9c7e3b4`

qcom-distro_linux-qcom-6.18
Pass: 227 | Fail: 9 | Total: 259

nodistro
Pass: 9 | Fail: 1 | Total: 10

qcom-distro
Pass: 305 | Fail: 24 | Total: 357

test-reporting-app · 2026-09-25T09:31:13Z

Test Results

119 files ±0 715 suites ±0 6h 48m 52s ⏱️ - 2h 33m 46s
177 tests ±0 141 ✅ +10 1 💤 ±0 35 ❌ - 10
4 576 runs - 5 4 478 ✅ - 1 51 💤 +4 47 ❌ - 8

For more details on these failures, see this check.

Results for commit 9c7e3b4. ± Comparison against base commit 754bfbf.

This pull request removes 2 and adds 2 tests. Note that renamed tests count towards both.

lava ‑ lava-test-retry
lava ‑ lava-test-shell

lava ‑ qdl-deploy
lava ‑ qdl-extract

♻️ This comment has been updated with latest results.

Milosz Wasilewski (mwasilew) · 2026-09-25T13:11:40Z

Anil (@qcom-anilyada) I merged PR 105 in lava-test-plans. Could you update the ref so it's picked here?

The lava-test-plans and testkit pins are several weeks behind upstream. Bump both to pick up the accumulated improvements. Update LAVA_TEST_PLANS_REF from 72813c6 to 63cf5b1. Highlights: - disable audio tests on iq-x7181-evk (hamoa) temporarily - group test cases by functional area (testkit-2026.08.30 layout) - validate a whole batch of jobs with one container - re-enable fastrpc test on meta-qcom devices - rename meta-qcom-3rdparty project to meta-qcom-arduino - add qcom-deb-images project for Debian image testing - add EXTRA_METADATA support for custom job metadata keys - raise QDL deploy timeout and enable ramdumps by default Update TESTKIT_REF from testkit-2026.08.14 to testkit-2026.09.20 (seven intermediate tags). Highlights: - new suites: UART, SPI, I3C, CAN, I2C capability, QPS615 runtime, USB DT capability, DeviceTree HW capability, platform runtime foundation, P0 runtime coverage - add storage, PKCS11, PIL/SMP2P, KVM and interconnect/EDAC validations - Ethernet validation enhancements - module reload plan updates - fixes across audio, camera, graphics and Bluetooth suites Signed-off-by: Anil Yadav <anilyada@qti.qualcomm.com>

Anil (qcom-anilyada) · 2026-09-25T13:17:50Z

Anil (Anil (@qcom-anilyada)) I merged PR 105 in lava-test-plans. Could you update the ref so it's picked here?

updated

Milosz Wasilewski (mwasilew) · 2026-09-25T13:51:13Z

Pushed to next: https://github.com/qualcomm-linux/meta-qcom/actions/runs/36143522796

qcomlnxci · 2026-09-25T16:30:03Z

Test Coral run workflow

Test jobs for commit `fa72c69`

qcomdistro: multimedia image-prop
Pass: 34 | Fail: 1 | Total: 35
qcomdistro: multimedia image
Pass: 10 | Fail: 0 | Total: 10

Milosz Wasilewski (mwasilew) · 2026-09-25T18:24:31Z

Workflow for next completed. Nothing exploded. Good to go from my pov.

qcomlnxci · 2026-09-25T19:06:37Z

Test Coral run workflow

Test jobs for commit `9c7e3b4`

qcomdistro: multimedia image
Pass: 10 | Fail: 0 | Total: 10
qcomdistro: multimedia image-prop
Pass: 35 | Fail: 0 | Total: 35

Anil (qcom-anilyada) requested review from Anuj Mittal (anujm1), Koen Kooi (koenkooi), Dmitry Baryshkov (lumag), Nicolas Dechesne (ndechesne), Ricardo Salveti (ricardosalveti) and Viswanath Kraleti (vkraleti) as code owners September 2, 2026 06:46

Anil (qcom-anilyada) mentioned this pull request Sep 2, 2026

ci: bump LAVA_TEST_PLANS_REF to include fastrpc #2913

Closed

Dmitry Baryshkov (lumag) requested changes Sep 2, 2026

View reviewed changes

Anil (qcom-anilyada) force-pushed the update-lava-ref-2-latest branch from 8411df9 to fa72c69 Compare September 25, 2026 07:26

Anil (qcom-anilyada) changed the title ~~ci: update lava-test-plans reference to 72813c68~~ test.yml: update lava-test-plans and testkit pins Sep 25, 2026

Anil (qcom-anilyada) force-pushed the update-lava-ref-2-latest branch from fa72c69 to 9c7e3b4 Compare September 25, 2026 13:16

Milosz Wasilewski (mwasilew) approved these changes Sep 25, 2026

View reviewed changes

Ricardo Salveti (ricardosalveti) approved these changes Sep 25, 2026

View reviewed changes

Ricardo Salveti (ricardosalveti) added the backport wrynose label Sep 25, 2026

Conversation

Anil (qcom-anilyada) commented Sep 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Dmitry Baryshkov (lumag) left a comment

Choose a reason for hiding this comment

Uh oh!

Ricardo Salveti (ricardosalveti) commented Sep 2, 2026

Uh oh!

Dmitry Baryshkov (lumag) commented Sep 3, 2026

Uh oh!

Anil (qcom-anilyada) commented Sep 17, 2026

Uh oh!

Anil (qcom-anilyada) commented Sep 23, 2026

Uh oh!

Milosz Wasilewski (mwasilew) commented Sep 24, 2026

Uh oh!

github-actions Bot commented Sep 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test run workflow

Test jobs for commit 9c7e3b4

Uh oh!

test-reporting-app Bot commented Sep 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Results

Uh oh!

Milosz Wasilewski (mwasilew) commented Sep 25, 2026

Uh oh!

Anil (qcom-anilyada) commented Sep 25, 2026

Uh oh!

Milosz Wasilewski (mwasilew) commented Sep 25, 2026

Uh oh!

qcomlnxci commented Sep 25, 2026

Test Coral run workflow

Test jobs for commit fa72c69

Uh oh!

Milosz Wasilewski (mwasilew) commented Sep 25, 2026

Uh oh!

qcomlnxci commented Sep 25, 2026

Test Coral run workflow

Test jobs for commit 9c7e3b4

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Anil (qcom-anilyada) commented Sep 2, 2026 •

edited

Loading

github-actions Bot commented Sep 25, 2026 •

edited

Loading

Test jobs for commit `9c7e3b4`

test-reporting-app Bot commented Sep 25, 2026 •

edited

Loading

Test jobs for commit `fa72c69`

Test jobs for commit `9c7e3b4`