Skip to content

 Persist environment IDs and add MinimalBot evaluation YAML sync  - #265

Open
nehaoss wants to merge 4 commits into
mainfrom
nbethapudi/minimalbot-evaluation-setup
Open

nehaoss wants to merge 4 commits into
mainfrom
nbethapudi/minimalbot-evaluation-setup

Conversation

@nehaoss

@nehaoss nehaoss commented Sep 7, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Persist the selected Power Platform environmentId during setup and refresh.
  • Read environmentId and agent.botId from .local/config.json.
  • Convert workspace evaluation YAML into MinimalBot payloads.
  • Pull MinimalBot evaluation sets and cases back into .mcs.yml files.
  • Generate .component-map.json with component IDs and parent relationships.
  • Keep the MinimalBot POC isolated to this PR branch.

Validation

  • 82 affected tests passed.
  • Ruff checks passed.
  • Live TEST pull produced 2 evaluation sets and 12 evaluation cases.

Notes

The MinimalBot POC uses app 417.... Existing ADK authentication continues using app 51f... because replacing it globally would break Dataverse, BAP, and PowerApps API authentication.

nehacopilot and others added 4 commits September 7, 2026 06:07
Carry the selected Power Platform environment ID through onboarding, refresh, and config writes so evaluation runs do not need to re-derive it from Dataverse.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Add workspace YAML conversion for MinimalBot pushes, pull evaluation components back to YAML with component metadata, and resolve environment and bot IDs from local config.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Retain the YAML-capable MinimalBot POC only on the dedicated pull request branch after removing the earlier direct addition from the base branch.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Expose connected Copilot Studio profiles for explicit selection when signed-in account matching cannot safely choose one, and document the two-turn retry flow.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Base automatically changed from nbethapudi/evaluation-lifecycle to main September 11, 2026 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants