Skip to content

chore(models): sync intellect scores from Artificial Analysis - #2578

Merged
jonathanKingston merged 2 commits into
mainfrom
chore/sync-intellect
Sep 9, 2026
Merged

jonathanKingston merged 2 commits into
mainfrom
chore/sync-intellect

Conversation

@copse-release-bot

@copse-release-bot copse-release-bot Bot commented Sep 8, 2026 •

Copy link
Copy Markdown
Contributor

New Artificial Analysis v4.3 measurements were disconnected from Copse’s canonical v4.1 intellect scale. Link them with a frozen affine map fitted to 611 models measured on both versions, so new models appear without changing existing canonical measurements.

Translated scores retain estimate and extrapolation provenance. The top-band representative and affected advisor/frontier fixtures now follow the updated data. The fit has R² 0.9933 and RMSE 1.31 on shared anchors; those are fit diagnostics, not guarantees for extrapolated models.

Validation: canonical-preservation and provenance regression tests; focused advisor/model/frontier tests; translated-score picker visual eval; five advisor-pair Electron cases with reviewed screenshots. Full pnpm run check passed: 8,745 tests passed, 7 skipped, none failed. Fresh CI is pending on the updated head.

github-actions Bot added a commit that referenced this pull request Sep 8, 2026
@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

🖥️ PR preview

github-actions Bot added a commit that referenced this pull request Sep 9, 2026
@jonathanKingston
jonathanKingston merged commit 58735f6 into main Sep 9, 2026
23 checks passed
@jonathanKingston
jonathanKingston deleted the chore/sync-intellect branch September 9, 2026 02:40
github-actions Bot added a commit that referenced this pull request Sep 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant