Improve browser agent prompt efficiency - #822
Open
thomwebb wants to merge 1 commit into
Open
Conversation
Owner
|
This looks less efficient. Did you meant to replace? |
thomwebb
marked this pull request as draft
August 21, 2026 02:20
mpfaffenberger
marked this pull request as ready for review
August 21, 2026 10:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
qa-kittenweb-retrieverBenchmark provenance
These policies come from a staged browser-agent prompt campaign that explored 300 generations across deterministic local fixtures and read-only live tasks.
The source finalists were:
This PR intentionally ports the winning execution policies onto current OSS
mainrather than copying the finalist prompts byte-for-byte. The benchmark base contained organization-specific guidance and predated the newer OSS confirmation-before-persisting policy. This adaptation removes organization/model-specific wording and retains the newer OSS safeguard.Validation
ruff check --fixandruff format .Prompt hashes used for the PR-specific breadth run:
qa-kitten:3ec8955b4275e7a0c74dff1913991d5f17064540e384fafab910e71a3bc82cbbweb-retriever:398f66406e435a7328dd49300b19e36547d602452219f74f3e21c26c4f0ae698Review notes
The prompt additions explicitly take priority over older generic workflow narration where the policies conflict. This avoids requiring routine plan narration, repeated snapshots, workflow writes, or discovery revisits while retaining extra checks when evidence conflicts or an action changes state.