-
Notifications
You must be signed in to change notification settings - Fork 31.3k
test: deflake test-buffer-large-size #57789
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
test: deflake test-buffer-large-size #57789
Conversation
queued a stress test - https://ci.nodejs.org/job/node-stress-single-test/557/ |
I'm not sure I understand the difference. Why using a |
Currently it is only one test that attempts to allocate 8GB of memory, the purpose of the for loop is to make them into 4 separate tests. I think it could have 2 benefits:
|
Actually - now I see my stress tests start to fail on |
Yes, probably. |
58ebe5a
to
5fae384
Compare
I've attempted to add major gc after each allocation and queued another stress test - https://ci.nodejs.org/job/node-stress-single-test/558/. This test seems having a way too high failure rate. |
Might be worth checking if distributing each of these into separate test files improves things |
The stress tests seem ok, the CI failures relate to other flaky tests. Are we happy to do major gc or better off separate them into different files? |
5fae384
to
4e19317
Compare
Any further actionable item should I take?
Happy to take either path 👍 |
I would try to separate into multiple files without manually triggering GC and see what happens. Manually calling the GC is not a fix. |
4e19317
to
920046f
Compare
920046f
to
e6b2341
Compare
what are the practical ways to verify if things've improved?
Any other suggestions? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Added some optional suggestions to simplify the tests
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #57789 +/- ##
==========================================
- Coverage 90.23% 90.22% -0.02%
==========================================
Files 630 630
Lines 185288 185518 +230
Branches 36344 36380 +36
==========================================
+ Hits 167203 167387 +184
- Misses 11006 11027 +21
- Partials 7079 7104 +25 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks
Landed in 795dd8e |
PR-URL: nodejs#57789 Reviewed-By: Darshan Sen <[email protected]> Reviewed-By: Luigi Pinca <[email protected]> Reviewed-By: James M Snell <[email protected]>
The test has failed 25+ times on 7th of April and 24 times 8th of April in our CI.
This PR attempts to spread the tests into multiple file to reduce the flakiness.