Refine prospective GHCP evaluation recovery, applicability and ambiguity case - #3077

Merged

George Ng (GeorgeNgMsft) merged 29 commits into

mainfrom

georgengmsft-ghcp-eval-followup-fixes

Oct 1, 2026

Commits on Sep 24, 2026

Add credit-guarded GHCP evaluation harness and isolated workload

George Ng (GeorgeNgMsft)
and
Copilot
committed
cc3b1bb
Separate eval setup and grading and satisfy repository ratchets

George Ng (GeorgeNgMsft)
and
Copilot
committed
bb7c863
Correct frozen run metadata placement

George Ng (GeorgeNgMsft)
and
Copilot
committed
f1c332b
Explicitly pin mixed routing in isolated evaluation profiles

George Ng (GeorgeNgMsft)
and
Copilot
committed
73fc67f
Document measured GHCP evaluation blockers

George Ng (GeorgeNgMsft)
and
Copilot
committed
fc604fa
Repair scoped eval artifacts and scripted clarification continuation

George Ng (GeorgeNgMsft)
and
Copilot
committed
e847c7a
Close native no-replay gap for future GHCP eval runs

George Ng (GeorgeNgMsft)
and
Copilot
committed
4275a7c

Commits on Sep 25, 2026

Fix cross-platform GHCP evaluation artifact and fixture paths

George Ng (GeorgeNgMsft)
and
Copilot
committed
b47f8ba
Refine prospective GHCP eval recovery and applicability

George Ng (GeorgeNgMsft)
and
Copilot
committed
9f31688
Separate read recovery classification for complexity gate

George Ng (GeorgeNgMsft)
and
Copilot
committed
9fff94b
Freeze applicability counts and preserve terminal denial precedence

George Ng (GeorgeNgMsft)
and
Copilot
committed
5411499
Clarify independent handoff PR after evaluation restack

George Ng (GeorgeNgMsft)
and
Copilot
committed
46a9267
Move Copilot evaluation harness into a dedicated package

George Ng (GeorgeNgMsft)
and
Copilot
committed
bb09c79
style: apply prettier formatting and policy fixes
typeagent-bot[bot]
committed
0b4c91b
Integrate evaluation package migration while preserving protocol four

George Ng (GeorgeNgMsft)
and
Copilot
committed
66d562d
Align evaluation README with normalized package metadata

George Ng (GeorgeNgMsft)
and
Copilot
committed
ba6a8b8
Integrate parent package policy metadata

George Ng (GeorgeNgMsft)
and
Copilot
committed
86c9b35
Sync final parent evaluation package documentation

George Ng (GeorgeNgMsft)
and
Copilot
committed
c4262a4
docs: regenerate README.AUTOGEN.md, command reference, and action browser
typeagent-bot[bot]
committed
0236149
docs: regenerate README.AUTOGEN.md, command reference, and action browser
typeagent-bot[bot]
committed
0863377
Replace list-dependent eval cases with comparable file tasks

George Ng (GeorgeNgMsft)
and
Copilot
committed
45d45f0
Require file clarification before directory-backed native reads

George Ng (GeorgeNgMsft)
and
Copilot
committed
f2f045c
Integrate common-file evaluation corpus and preserve safe recovery

George Ng (GeorgeNgMsft)
and
Copilot
committed
79fad5b

Commits on Sep 26, 2026

Handle scoped file-handler consent in evaluation harness

George Ng (GeorgeNgMsft)
and
Copilot
committed
9e002dd
Validate current tool context for fixture consent

George Ng (GeorgeNgMsft)
and
Copilot
committed
d9a7817
Compare continuation response fields independent of JSON key order

George Ng (GeorgeNgMsft)
and
Copilot
committed
96e9045

Commits on Sep 28, 2026

Add isolated NL versus structured list evaluation category

George Ng (GeorgeNgMsft)
and
Copilot
committed
23fc672
Harden evaluation tool boundaries and pending interaction evidence

George Ng (GeorgeNgMsft)
and
Copilot
committed
a9b6826

Commits on Oct 1, 2026

Merge main into evaluation follow-up fixes

George Ng (GeorgeNgMsft)
and
Copilot
committed
477e0d8