Register NVIDIA FLARE skills - #535
Conversation
Signed-off-by: Holger Roth <hroth@nvidia.com>
Signed-off-by: Holger Roth <hroth@nvidia.com>
Signed-off-by: Holger Roth <hroth@nvidia.com>
Signed-off-by: Holger Roth <hroth@nvidia.com>
This reverts commit 907270b. Signed-off-by: Holger Roth <hroth@nvidia.com>
|
NVFlare PR #5260 has now merged into the 2.9 branch at e77bf33c1a6975d517362f50d154e7a3aaea67ef. I verified that the merged skills tree is byte-identical to the final signed PR head and that all 160 resources across the nine skill.oms.sig manifests match their SHA-256 digests. The remaining red source-onboarding result is the September 4 run against the pre-merge 2.9 state. This workflow does not run on ready_for_review, and I do not have permission to rerun it. Could a repository maintainer please rerun the failed source-onboarding workflow? No catalog content change should be necessary. |
|
@mosheabr The fresh source-onboarding run after the reported fix is still failing on the same two benchmark verdicts:
Fresh run: https://github.com/NVIDIA/skills/actions/runs/34659296791 PR #535 is open and ready for review on the unchanged head bf719ee. No repository files, signatures, or generated artifacts were changed. |
mosheabr
left a comment
There was a problem hiding this comment.
Thanks Holger. Two things to fix, and one of them is ours.
1. Filename slug doesn't match the component name. The file is components.d/nvflare.yml but name: NVIDIA FLARE derives to nvidia-flare.yml. The catalog generates your README product row from that pairing, so a mismatch breaks the row. Either rename the file to nvidia-flare.yml, or change name: to NVFlare — I'd suggest the second, since it matches how the project brands itself. No re-sign needed for this; components.d/ lives in the catalog and isn't covered by any skill signature.
2. Two skills still report INCOMPLETE. After #5260, nvflare-autofl and nvflare-shared both carry all four artifacts — that part is sorted — but their benchmarks read Overall verdict: INCOMPLETE with Tier 2 showing NOT RUN. The other seven are PASS.
That was a bug on our side, now fixed — these two just ran on a version prior to the fix.
So: re-run /nvskills-ci on the 2.9 branch for those two skills and push the regenerated benchmarks, and push the slug fix here. I'll re-run the checks and merge.
## Summary - trigger a fresh NVCARPS evaluation for `nvflare-autofl` and `nvflare-shared` after the benchmark-verdict fix - change only blank-line separation in the two evaluator baseline YAML files - preserve all skill instructions, rules, references, scripts, runtime code, evaluation data, and release metadata This follows up #5260 and unblocks NVIDIA/skills#535. NVCARPS should regenerate `BENCHMARK.md`, `skill-card.md`, and `skill.oms.sig` for the two affected skills. ## Validation - YAML parsing: passed for both baseline files - `git diff --ignore-blank-lines origin/2.9...HEAD`: empty - `pytest -q tests/unit_test/tool/agent_skill_checks/seed_skills_test.py`: 38 passed - `./runtest.sh -s`: passed, including Black, isort, flake8, and agent-skill lint Merge only after both regenerated benchmarks report `Overall verdict: PASS`, the signatures match the final tree, and the other seven skill directories remain unchanged. Signed-off-by: Holger Roth <hroth@nvidia.com> --------- Signed-off-by: Holger Roth <hroth@nvidia.com> Signed-off-by: nvskills-svc-account <svc-nvskills-signing@nvidia.com> Co-authored-by: nvskills-svc-account <svc-nvskills-signing@nvidia.com>
Signed-off-by: Holger Roth <hroth@nvidia.com>
|
Resolved both requested items:
@mosheabr, could you please re-review when convenient? |
mosheabr
left a comment
There was a problem hiding this comment.
Both items from my earlier review are resolved — approving.
1. Filename slug — name: NVFlare now derives nvflare.yml. Matches.
2. Benchmark verdicts — all 9 skills now read **Overall verdict: PASS**. nvflare-autofl and nvflare-shared were re-signed 2026-09-12 on evaluator 1.5.6 and went INCOMPLETE → PASS.
Full checklist re-verified:
| Check | Result |
|---|---|
| Source repo | NVIDIA/NVFlare public, NVIDIA-org, not archived, Apache-2.0; ref: 2.9 valid |
| Paths | all 9 declared paths present at ref: 2.9 |
| Artifacts | all 9 carry skill.oms.sig, skill-card.md, evals/, BENCHMARK.md |
| Verdicts | 9/9 PASS (read from the bolded callout, not a substring match) |
| Layout | flat, one-entry-per-skill, product-prefixed nvflare-*, unique catalog_dir |
| SKILL.md | sampled nvflare-convert-pytorch — name matches dir, description has positive and negative triggers, license Apache-2.0 |
| DCO / authors | all 6 commits signed off; both checks green |
| Affirmations | all five ticked, license specified |
| Diff scope | components.d/nvflare.yml only — no README edit, no generated files |
Two non-blocking follow-ups:
links:sets onlysecurity: false;contributinganddiscussionsalso feed the README Getting Help table if NVFlare has them.nvflare-sharedis a shared-assets bundle published as a standalone skill —nvflare-convert-pytorchloads../nvflare-shared/references/...in eight places, so installing a single skill leaves dangling relative paths. Tracked as #298; this is the first production instance and worth prioritising that work.
Thanks for the quick turnaround on the re-sign.
Onboarding type
components.d/<slug>.ymlfile)For new product onboarding — author affirmations
By submitting this PR, I confirm on behalf of my team:
.agents/skills/orskills/path used for new entries (or existing path retained for legacy entries percomponents.d/<slug>.yml)Reviewer checklist (OSS Skills PIC)
components.d/<slug>.ymlentry valid (required fields, uniquecatalog_dir, path exists in source repo, filename slug matches name)SKILL.mdfrontmatter spec-compliant (at least one sampled)All PRs
git commit -s).Other context (for non-onboarding PRs)
Registers all nine NVIDIA FLARE skills from the stable
NVIDIA/NVFlare:2.9branch. The skills are intended to be installed as a complete set so shared references resolve throughnvflare-shared.Draft dependency: NVIDIA/NVFlare#5260 must merge with fresh, hash-valid artifacts for all nine skills before this PR is ready for review.