Skip to content

test: deflake crypto benchmark and http2 debug - #66151

Open
panva wants to merge 2 commits into
nodejs:mainfrom
panva:deflake-crypto-http2
Open

panva wants to merge 2 commits into
nodejs:mainfrom
panva:deflake-crypto-http2

Conversation

@panva

@panva panva commented Sep 20, 2026

Copy link
Copy Markdown
Member

Ensure the timingSafeEqual benchmark's random buffers differ and use 256-byte buffers in test mode. The default one-byte buffers could match and fail the comparison count assertion.

Capture HTTP/2 debug output in a temporary file. Native log messages can be lost when the non-blocking stderr pipe fills, causing assertions to fail even when the child exits successfully.

Remove both flaky designations.

Fixes: #52690
Fixes: #58353

Test mode reduces bufferSize to one, giving the random buffers a 1/256
chance of matching and failing the comparison count assertion. Use 256
bytes in test mode and force the first bytes to differ before timing.
Remove the flaky designation.

Fixes: nodejs#52690
Signed-off-by: Filip Skokan <panva.ip@gmail.com>
Assisted-by: Codex
Native debug writes can be lost when the non-blocking stderr pipe fills,
leaving expected log lines missing even when the child exits
successfully. Capture stderr in a temporary file and apply the existing
assertions to its contents. Remove the flaky designation on Linux s390x.

Fixes: nodejs#58353
Signed-off-by: Filip Skokan <panva.ip@gmail.com>
Assisted-by: Codex
@panva panva added flaky-test Issues and PRs involving tests that fail intermittently in CI. commit-queue-rebase PRs the Commit Queue should land as multiple self-contained commits. labels Sep 20, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/performance

@nodejs-github-bot nodejs-github-bot added benchmark Issues and PRs related to Node.js benchmarks and benchmarking infrastructure. crypto Issues and PRs related to the crypto subsystem. needs-ci PRs that need a full CI run. test Issues and PRs related to Node.js core tests and test infrastructure. labels Sep 20, 2026
@panva
panva force-pushed the deflake-crypto-http2 branch from 0f0994a to 83f9059 Compare September 20, 2026 07:23
@panva

panva commented Sep 20, 2026

Copy link
Copy Markdown
Member Author

main: https://ci.nodejs.org/job/node-stress-single-test/897/ 🔴
PR: https://ci.nodejs.org/job/node-stress-single-test/896/ 🟢

(i think i set these up right, ...)

@mcollina mcollina left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@panva panva added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. Only starts once the PR has an approving review. labels Sep 20, 2026
@github-actions github-actions Bot removed the request-ci Add this label to start a Jenkins CI on a PR. Only starts once the PR has an approving review. label Sep 20, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@codecov

codecov Bot commented Sep 20, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.27%. Comparing base (97af3d7) to head (83f9059).
⚠️ Report is 5 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #66151      +/-   ##
==========================================
- Coverage   90.29%   90.27%   -0.02%     
==========================================
  Files         790      790              
  Lines      272021   272021              
  Branches    51917    51921       +4     
==========================================
- Hits       245611   245572      -39     
- Misses      16903    16943      +40     
+ Partials     9507     9506       -1     

see 26 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@panva panva added the commit-queue PRs queued for automated landing through the Commit Queue. label Sep 20, 2026

@gurgunday gurgunday left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@panva panva added the fast-track PRs proposed for a shorter-than-standard waiting period before landing. label Sep 20, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Fast-track has been requested by @panva. Please 👍 to approve.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author ready PRs with CI started, the required approvals, and no outstanding review comments. benchmark Issues and PRs related to Node.js benchmarks and benchmarking infrastructure. commit-queue PRs queued for automated landing through the Commit Queue. commit-queue-rebase PRs the Commit Queue should land as multiple self-contained commits. crypto Issues and PRs related to the crypto subsystem. fast-track PRs proposed for a shorter-than-standard waiting period before landing. flaky-test Issues and PRs involving tests that fail intermittently in CI. needs-ci PRs that need a full CI run. test Issues and PRs related to Node.js core tests and test infrastructure.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

flaky: test_http2_debug flaky: benchmark/test-benchmark-crypto

6 participants