Skip to content

docs(research): record zero-resident diagnostic - #307

Open
seekskyworld wants to merge 1 commit into
openpi-dev:mainfrom
seekskyworld:docs/issue-20-diagnostic-retrospective
Open

docs(research): record zero-resident diagnostic#307
seekskyworld wants to merge 1 commit into
openpi-dev:mainfrom
seekskyworld:docs/issue-20-diagnostic-retrospective

Conversation

@seekskyworld

Copy link
Copy Markdown

Problem

Issues #19 and #20 contain important zero-resident tool-surface and DeepSeek three-arm diagnostic evidence, but the reusable conclusion is not indexed as a repository research record.

Value

This preserves the static-tax versus dynamic-trajectory distinction, the isolation/accounting requirements, and the conservative limits of the historical diagnostic without turning a small ARM64 run into a product or benchmark claim.

Approach

Validation

  • git diff --check — passed.
  • npx --yes bun@1.3.14 run lint — passed.
  • npx --yes bun@1.3.14 run typecheck — passed.
  • Markdown reviewed against docs/README.md and docs/research/README.md.

Impact

  • User-visible behavior: None.
  • Model-visible context/tools: None.
  • Runtime/lifecycle: None.
  • Persisted config/data: None.
  • Compatibility/risk: Documentation-only; no new score, ranking, or runtime decision is claimed.

Related to #20

Signed-off-by: seekskyworld <djh1813553759@gmail.com>
@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Aug 30, 2026

@tt-a1i tt-a1i left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review:Changes Requested

固定版本 244b3eb7480b728584245e127fceec6bdb1e3f74

问题 / 价值 / 方法

把零常驻工具面与三臂诊断的结论从 Issue 整理成研究记录,方便复用静态税/动态轨迹的区别和隔离、账本经验。仅改两份 Markdown;没有新增 runtime、工具或配置,保守解释方向合理。

Standards

1 项 P2:2026-08-30 新建文档误放入早于 Decision 0001 的 Legacy records,见索引行内意见。

Spec

1 项独立 P2:新增 profile 对照替换了来源中的实验安排,未注明为新建议,见正文行内意见。Spec 也发现了上述 Legacy 归类问题。

非阻塞:补 PR Approach 承诺的 Issue 回链,并说明本次 validated 核验的是来源转述,不是重新复核原始 trace。

不要求在这份研究复盘中补做正式 Benchmark,也不要求上传原始日志或改变默认 runtime。

验证

该 exact head 的隔离工作树中:frozen-lockfile 安装后 bun run check 通过;git diff --check 和5个本地 Markdown 链接检查通过。两路规范/Spec 审查已完成。没有重跑全量 tests 或模型实验,仓库检查不能证明研究结论。现有 CI 绿色,分支落后 main。

本次仅提交 review,未改文件、未合并。

Comment thread docs/research/README.md

- [`CLAUDE_CODE_WORKFLOW_FANOUT_POLICY_2026-08-23.md`](CLAUDE_CODE_WORKFLOW_FANOUT_POLICY_2026-08-23.md) — official-source research on dynamic fan-out and bounded execution.
- [`CLAUDE_CODE_WORKFLOW_RUNTIME_CONTRACT_2026-08-23.md`](CLAUDE_CODE_WORKFLOW_RUNTIME_CONTRACT_2026-08-23.md) — version-scoped Workflow contract interview and evidence boundary.
- [`OPENPI_ZERO_RESIDENT_SURFACE_DIAGNOSTIC_2026-08-30.md`](OPENPI_ZERO_RESIDENT_SURFACE_DIAGNOSTIC_2026-08-30.md) — Issue #19/#20 的零常驻工具面与三臂诊断复盘。

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ [P2] 新建记录不应列为 Legacy

本列表声明文档早于 Decision 0001、尚未迁移到新 metadata 契约。但新增记录创建日期为 2026-08-30,Decision 0001 已于 2026-08-29 生效。这个位置会错误表达其历史豁免身份。

请移到当前研究小节,按现有 docs/README.md 约定补适用来源边界、相关 PR 和替代关系;无需新增格式框架或批量迁移旧文档。


## 后续实验门槛

先完成干净 workspace、网络和 verifier 隔离,再使用 AB/BA 顺序反转与多次重复比较 Bare Pi、OpenPI Explicit、指定 capability profile 和固定版本 OMP。至少同时报告质量、首请求静态税、总 usage、轨迹长度、机制采用率和失败分类。

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ [P2] 将新的实验组合与历史后续方案区分开

此记录定位为 validated 历史复盘,但这里换成了 Bare Pi / Explicit / capability profile / OMP。来源 #20 §13 的后续是优先做 SQLite/Cancel 固定身份匹配重复,满足稳定阈值后再做 runtime 单变量;关联 #45 §7 的四 Harness 则是 Bare Pi / OpenPI Explicit / OMP / Maka,不包含替代 Maka 的 profile 臂。

新组合可以作为建议,但不能不加说明地代替来源的后续路径。请保留或链接原方案,把新增 profile 方案明确标成新建议并说明理由即可;不要求在本 PR 新跑实验或另造框架。

@tt-a1i

tt-a1i commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator

Code Review Summary

Changes Requested:2 项 P2。 完整 review,审查版本 244b3eb

  • 新建记录误归 Legacy,需移至当前研究区。
  • profile 对照组合替换了来源中的实验安排,需保留原方案或明确标为新建议。
  • 研究方向合理,只需文档修正;不新增 runtime、框架或模型实验。

隔离 checkout 的 bun run check、diff 与本地链接检查通过;未重跑全量测试或 Benchmark。只提交审查,未改文件、未合并。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants