[EX-2698] Document experiment protocols - #39064
Conversation
Add a page covering how to create, configure, publish, and apply experiment protocols, plus duplicate, archive, and delete. Add the page to the Experiments menu and the Experiments overview quick links.
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Thanks for the thorough new page — it reads clearly and the alt text is excellent. A few minor style and clarity nits below; no blockers.
Reviewed 796d1b58a9869a85e979cbc263275aa9418b4bbf — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
|
/review |
Preview links (active after the
|
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Clarity nit on the Randomization step's Environment field. The rest of the page reads well and follows the Datadog style guide.
Reviewed 4a6747c0b806af2b9030b24a5afe51405da37180 — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Nice, thorough walk-through of protocols. A few small suggestions inline — mostly copy polish and one capitalization to double-check against the UI.
Reviewed e91945e5963939a5435669d8fdd77666e7138689 — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Overall well-structured page with clear steps and good use of alt text. A few small findings on link style and clarity of a couple of sentences. No blockers.
Reviewed 604d2d90093a4e24a0dc855f7a7a7729869c62ec — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Well-written new page. Structure and menu integration look good. Just a couple of minor nits — no blockers.
Reviewed c19f7406d3eedf928568c225c6d6f0d2b5c49e0d — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
New page and menu entry for Experiment Protocols. Content is well-structured with clear steps, prerequisites, and role/permissions notes. One style blocker (raw HTML) and a couple of minor phrasing nits below.
Reviewed b4eeea3db127672b434a99ffcb9fa50567b31794 — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Solid, thorough new page. A couple of small clarity nits around fields marked (Optional) that are effectively required for a downstream step in the same numbered list — noted inline.
Reviewed f822e3908f86a1a6ce893067087098d26393af52 — workflow run
Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Thorough new page for a substantial feature. Content is well-structured with clear step-by-step guidance, good use of the {{< ui >}} shortcode for UI labels, and thorough alt text on images. The menu weights are correctly renumbered to accommodate the new page and to resolve a pre-existing duplicate weight. A few minor style and clarity nits — nothing blocking.
Reviewed b7296cb3853d012d6c42886ab3a8dd814a942c86 — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Overall a well-structured page. Two things worth fixing: a duplicated image shortcode in Step 4, and a use of "will" that trips the style guide's temporal-words rule. A few minor nits inline.
Reviewed badc70287f740c13e74af9ceaa81d2b88bd2b6b9 — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Emiel Verkade <emiel.verkade@datadoghq.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Overall this is a clear, well-structured new page. One nit: the [11] link reference to the permissions page is defined at the bottom of the file but never used inline in the Prerequisites section.
Reviewed b0a72a1f22276e4fb9c0934133e7f76504af190e — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
|
/review |
There was a problem hiding this comment.
🤖 Automated review by Claude. AI-generated; verify before acting.
Well-written new page. Content is clear, structured logically, and follows the style guide (no forbidden words detected). Menu entry, frontmatter, description, and reference-style links all look correct. Weight renumbering in main.en.yaml also cleans up a pre-existing duplicate (pa_experiments_statistics and pa_experiments_metric_property_breakouts were both weight 6). One minor style nit inline.
Reviewed 0c0561032c87decb56b847d3bde1fe8f38f52fcd — workflow run
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
|
Created DOCS-15373 for Docs Team review. |
drichards-87
left a comment
There was a problem hiding this comment.
@emielver Looks good overall. I just left one piece of feedback on a change we need to make before we merge the PR.
What does this PR do? What is the motivation?
Fixes EX-2698
Adds a page documenting experiment protocols, the reusable templates that set defaults for decision metrics, randomization, duration, notifications, and the statistical analysis plan.
The page covers:
Also adds the page to the Experiments left navigation and a quick link on the Experiments overview page.
Merge readiness
For Datadog employees:
<name>/<description>convention and include the forward slash (/). If you've already created your PR with an incorrect branch name, please rename your branch and open a fresh PR./reviewto run an automated check that catches common issues before a Documentation team member reviews your PR.AI assistance
Drafted with Claude, then verified against the feature implementation and revised.
Additional notes
Opened as a draft while two screenshots are re-taken.