GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — test: deflake test-buffer-large-size by jakecastelli · Pull Request #57789 · nodejs/node

Conversation

@jakecastelli

@jakecastelli jakecastelli commented Apr 8, 2025 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

The test has failed 25+ times on 7th of April and 24 times 8th of April in our CI.

This PR attempts to spread the tests into multiple file to reduce the flakiness.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@nodejs-github-bot nodejs-github-bot added needs-ci PRs that need a full CI run. test Issues and PRs related to Node.js core tests and test infrastructure. labels Apr 8, 2025
@jakecastelli

jakecastelli commented Apr 8, 2025

Copy link
Copy Markdown
Member Author

queued a stress test - https://ci.nodejs.org/job/node-stress-single-test/557/

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

lpinca
lpinca reviewed Apr 8, 2025
View reviewed changes
Comment thread test/pummel/test-buffer-large-size.js Resolved

Uh oh!

There was an error while loading. Please reload this page.

@lpinca

lpinca commented Apr 8, 2025

Copy link
Copy Markdown
Member

I'm not sure I understand the difference. Why using a for loop reduces the flakiness?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli

jakecastelli commented Apr 8, 2025

Copy link
Copy Markdown
Member Author

Currently it is only one test that attempts to allocate 8GB of memory, the purpose of the for loop is to make them into 4 separate tests. I think it could have 2 benefits:

  1. we could be able to to know which one timed out
  2. potentially give more chances to gc
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli

jakecastelli commented Apr 8, 2025 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member Author

Actually - now I see my stress tests start to fail on ubuntu2204-arm64 with the same timeout, I think you might be right @lpinca 🤔 it wouldn't do anything useful, do you think this also relates to the deadlock? Maybe run a major gc is a better way to deflake the test 😅 wdyt?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@lpinca

lpinca commented Apr 8, 2025

Copy link
Copy Markdown
Member

Do you think this also relates to the deadlock?

Yes, probably.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli
jakecastelli force-pushed the deflake-test-buffer-large-size branch from 58ebe5a to 5fae384 Compare April 8, 2025 13:43
@jakecastelli

jakecastelli commented Apr 8, 2025

Copy link
Copy Markdown
Member Author

I've attempted to add major gc after each allocation and queued another stress test - https://ci.nodejs.org/job/node-stress-single-test/558/. This test seems having a way too high failure rate.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@RaisinTen

RaisinTen commented Apr 8, 2025

Copy link
Copy Markdown
Member

Might be worth checking if distributing each of these into separate test files improves things

jakecastelli and lpinca reacted with thumbs up emoji
All reactions
  • 👍 2 reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@nodejs-github-bot

nodejs-github-bot commented Apr 8, 2025

Copy link
Copy Markdown
Collaborator

CI: https://ci.nodejs.org/job/node-test-pull-request/66133/

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli

jakecastelli commented Apr 9, 2025

Copy link
Copy Markdown
Member Author

The stress tests seem ok, the CI failures relate to other flaky tests. Are we happy to do major gc or better off separate them into different files?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli
jakecastelli force-pushed the deflake-test-buffer-large-size branch from 5fae384 to 4e19317 Compare April 9, 2025 12:12
@jakecastelli

jakecastelli commented Apr 9, 2025

Copy link
Copy Markdown
Member Author

Any further actionable item should I take?

  • Continue with landing this PR
  • Separate the tests into multiple files

Happy to take either path 👍

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@lpinca

lpinca commented Apr 9, 2025

Copy link
Copy Markdown
Member

I would try to separate into multiple files without manually triggering GC and see what happens. Manually calling the GC is not a fix.

jakecastelli reacted with thumbs up emoji
All reactions
  • 👍 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli
jakecastelli force-pushed the deflake-test-buffer-large-size branch from 4e19317 to 920046f Compare April 9, 2025 12:34
@jakecastelli
test: deflake test-buffer-large-size
e6b2341
@jakecastelli
jakecastelli force-pushed the deflake-test-buffer-large-size branch from 920046f to e6b2341 Compare April 9, 2025 12:38
@jakecastelli
jakecastelli marked this pull request as ready for review April 9, 2025 12:46
@jakecastelli

jakecastelli commented Apr 9, 2025

Copy link
Copy Markdown
Member Author

what are the practical ways to verify if things've improved?

  • have a few CI runs
  • 1000 stress tests

Any other suggestions?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

RaisinTen
RaisinTen approved these changes Apr 9, 2025
View reviewed changes

@RaisinTen RaisinTen left a comment

Copy link
Copy Markdown
Member

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
Added some optional suggestions to simplify the tests

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
Comment thread test/pummel/test-buffer-large-size-buffer-alloc-unsafe-slow.js Resolved

Uh oh!

There was an error while loading. Please reload this page.

Comment thread test/pummel/test-buffer-large-size-buffer-alloc-unsafe-slow.js Resolved

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli
fixup! test only error code & simplify tests
c76d93b
@codecov

codecov Bot commented Apr 9, 2025 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.22%. Comparing base (1540fc6) to head (c76d93b).
Report is 242 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #57789      +/-   ##
==========================================
- Coverage   90.23%   90.22%   -0.02%     
==========================================
  Files         630      630              
  Lines      185288   185518     +230     
  Branches    36344    36380      +36     
==========================================
+ Hits       167203   167387     +184     
- Misses      11006    11027      +21     
- Partials     7079     7104      +25     

see 27 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

lpinca
lpinca approved these changes Apr 9, 2025
View reviewed changes
@lpinca lpinca added the request-ci Add this label to start a Jenkins CI on a PR. Only starts once the PR has an approving review. label Apr 9, 2025
@github-actions github-actions Bot removed the request-ci Add this label to start a Jenkins CI on a PR. Only starts once the PR has an approving review. label Apr 9, 2025
@nodejs-github-bot

nodejs-github-bot commented Apr 9, 2025

Copy link
Copy Markdown
Collaborator

CI: https://ci.nodejs.org/job/node-test-pull-request/66169/

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

RaisinTen
RaisinTen approved these changes Apr 10, 2025
View reviewed changes

@RaisinTen RaisinTen left a comment

Copy link
Copy Markdown
Member

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@jakecastelli jakecastelli added the author ready PRs with CI started, the required approvals, and no outstanding review comments. label Apr 10, 2025
@jakecastelli jakecastelli added the commit-queue-squash PRs the Commit Queue should land as one squashed commit. label Apr 10, 2025
jasnell
jasnell approved these changes Apr 10, 2025
View reviewed changes
@jakecastelli jakecastelli added the commit-queue PRs queued for automated landing through the Commit Queue. label Apr 11, 2025
@nodejs-github-bot nodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Apr 11, 2025
@nodejs-github-bot
nodejs-github-bot merged commit 795dd8e into nodejs:main Apr 11, 2025
@nodejs-github-bot

nodejs-github-bot commented Apr 11, 2025

Copy link
Copy Markdown
Collaborator

Landed in 795dd8e

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@sapphi-red sapphi-red mentioned this pull request Apr 15, 2025
module: add module.customConditions #57688
Open
@RaisinTen RaisinTen mentioned this pull request Apr 25, 2025
buffer: move SlowBuffer to EOL #58008
Closed
RafaelGSS pushed a commit that referenced this pull request May 1, 2025
@jakecastelli @RafaelGSS
test: deflake test-buffer-large-size
bbb50e1
PR-URL: #57789
Reviewed-By: Darshan Sen <[email protected]>
Reviewed-By: Luigi Pinca <[email protected]>
Reviewed-By: James M Snell <[email protected]>
@RafaelGSS RafaelGSS mentioned this pull request May 1, 2025
2025-05-06, Version 24.0.0 (Current) #57609
Merged
RafaelGSS pushed a commit that referenced this pull request May 2, 2025
@jakecastelli @RafaelGSS
test: deflake test-buffer-large-size
660d238
PR-URL: #57789
Reviewed-By: Darshan Sen <[email protected]>
Reviewed-By: Luigi Pinca <[email protected]>
Reviewed-By: James M Snell <[email protected]>
aduh95 pushed a commit that referenced this pull request May 6, 2025
@jakecastelli @aduh95
test: deflake test-buffer-large-size
bc1e7f0
PR-URL: #57789
Reviewed-By: Darshan Sen <[email protected]>
Reviewed-By: Luigi Pinca <[email protected]>
Reviewed-By: James M Snell <[email protected]>
@aduh95 aduh95 added the backport-requested-v22.x PRs awaiting manual backport to the v22.x-staging branch. label May 6, 2025
@aduh95

aduh95 commented May 6, 2025

Copy link
Copy Markdown
Contributor

Tests are failing on GHA with this change (https://github.com/nodejs/node/actions/runs/14865929007/job/41742567775), we'd need a manual backport PR if we want to port this change.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli

jakecastelli commented May 7, 2025

Copy link
Copy Markdown
Member Author

I will look into the backport

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli

jakecastelli commented May 8, 2025

Copy link
Copy Markdown
Member Author

Hi @aduh95 I took a look and realised this PR was fixing the flaky test introduced in #51821 which 51821 is a semver-major PRs that contain breaking changes and should be released in the next major version. so, I think I should've added don't land on labels

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@jakecastelli jakecastelli added dont-land-on-v20.x dont-land-on-v22.x PRs that should not land on the v22.x-staging branch and should not be released in v22.x. and removed backport-requested-v22.x PRs awaiting manual backport to the v22.x-staging branch. labels May 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jasnell jasnell jasnell approved these changes
@lpinca lpinca lpinca approved these changes
@RaisinTen RaisinTen RaisinTen approved these changes

Uh oh!

There was an error while loading. Please reload this page.

Assignees

No one assigned

Labels

author ready PRs with CI started, the required approvals, and no outstanding review comments. commit-queue-squash PRs the Commit Queue should land as one squashed commit. dont-land-on-v22.x PRs that should not land on the v22.x-staging branch and should not be released in v22.x. needs-ci PRs that need a full CI run. test Issues and PRs related to Node.js core tests and test infrastructure.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

6 participants

@jakecastelli @lpinca @RaisinTen @nodejs-github-bot @aduh95 @jasnell
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.