Description

flakey5

opened on Oct 21, 2025

Issue body actions

Enter your suggestions in details:

Tests should include tests of actual content re #8248 and https://openjs-foundation.slack.com/archives/CVAMEJ4UV/p1761008932326439?thread_ts=1761008123.880979&cid=CVAMEJ4UV

Reacted by Brian Muenzenmeyer, Aviv Keller and Claudio Wunder

Activity

1. github-project-automation

   added this to Node.js Websiteon Oct 21, 2025
2. github-project-automation

   moved this to 📋 Backlog in Node.js Websiteon Oct 21, 2025
3. avivkeller

   added the

   Task

   issue type on Oct 21, 2025
4. avivkeller commented on Oct 21, 2025

   

   avivkeller

   on Oct 21, 2025

   Member

   More actions

   FWIW E2E currently covers:

   • That translations are working
   • That the theme is interchangeable
   • That search functionality works

   ---

   Even so, I don't think E2E would have caught this, since a PR didn't introduce a regression, rather, data we didn't expect did. Tests will all sorts of malformed and unexpected data may help, though.
5. bmuenzenmeyer commented on Oct 21, 2025

   

   bmuenzenmeyer

   on Oct 21, 2025

   Contributor

   More actions

   Yeah the only way to detect would have been timed testing of the site on some cron, like every couple minutes. Not impossible, but a lot of work. I suspect there are tools and services that could do this.

   At the time this issue was suggested, we didn't yet know the root cause (data and timing)

Issue actions