Skip to content

Integration - #577

Open
xmyleader wants to merge 21 commits into
OpenBMB:mainfrom
xmyleader:integration
Open

xmyleader wants to merge 21 commits into
OpenBMB:mainfrom
xmyleader:integration

Conversation

@xmyleader

@xmyleader xmyleader commented Sep 12, 2026

Copy link
Copy Markdown

Summary
This PR integrates four complementary router improvements into main: quality-aware context routing, cache-aware model switching, HALO health-aware fallback recovery, and a reliable evaluation attempt ledger.
Key Changes

  • Adds bounded, context-aware token-saver classification with continuation detection, confidence guards, and routing diagnostics.
  • Introduces cache-aware stay-versus-switch cost estimation, pricing provenance, and prompt-cache plan rebuilding.
  • Adds HALO recovery with provider health tracking, circuit-breaker behavior, chain-wide retry budgets, deadlines, and safe stream continuation.
  • Records judge, primary, retry, fallback, and compaction attempts in an append-only evaluation ledger with usage and cost provenance.
  • Adds evaluation scripts, schemas, benchmark reports, and focused regression coverage.
  • Preserves correct retry/fallback relationships and prevents duplicate attempt accounting.
    Validation
  • npm run build passes.
  • 157 focused router, evaluation, streaming, and compaction tests pass.
  • All four feature branch histories are included in integration.

asifnaseer8644-ui and others added 21 commits September 11, 2026 15:56
…' into integration

# Conflicts:
#	src/router/RouterRuntime.ts
…nto integration

# Conflicts:
#	src/router/RouterRuntime.ts
#	src/router/config/parseRouterConfig.ts
#	src/router/config/schema.ts
#	tests/router/config-parser.spec.ts
…into integration

# Conflicts:
#	package.json
#	src/model/streaming/streamModel.ts
#	src/router/RouterRuntime.ts
#	src/router/tokenSaver/classifyAndRoute.ts
#	src/router/utils/modelPricing.ts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants