Skip to content

fix(metrics): add actionable BERTScore baseline guidance - #1373

Open
LarryHu0217 wants to merge 1 commit into
huggingface:mainfrom
LarryHu0217:codex/bertscore-baseline-guidance-995
Open

fix(metrics): add actionable BERTScore baseline guidance#1373
LarryHu0217 wants to merge 1 commit into
huggingface:mainfrom
LarryHu0217:codex/bertscore-baseline-guidance-995

Conversation

@LarryHu0217

Copy link
Copy Markdown

Fixes #995

Summary

Make a missing BERTScore rescaling baseline actionable. The error and warning now include the missing local path, the official upstream baseline URL for the selected language and model, and guidance to either save the downloaded file at that path or provide baseline_path explicitly.

This deliberately keeps baseline acquisition explicit rather than introducing an unexpected network request inside scoring.

Validation

  • focused regression for the warning and error guidance;
  • verified the generated official baseline URL returns HTTP 200;
  • Ruff lint and format checks;
  • broader metrics run reached 284 passing tests; four unrelated optional-data/hash expectation failures were recorded separately;
  • git diff --check.

AI assistance disclosure: Codex was used to help prepare and validate this change.

@LarryHu0217
LarryHu0217 marked this pull request as ready for review September 4, 2026 01:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Handle BERTScore baseline files

1 participant