Description

vstinner

opened on Sep 11, 2023

Issue body actions

In issue gh-109162, I refactored deeply libregrtest code to easy its maintenance. While refactoring libregrtest, I saw many things that I would like to enhance. So I create this meta ticket to track enhancements :-)

Linked PRs

• gh-109276: libregrtest: use separated file for JSON #109277
• gh-109276: libregrtest only checks saved_test_environment() once #109278
• gh-109276: libregrtest calls random.seed() before each test #109279
• gh-109276: libregrtest: limit number workers #109288
• gh-109276: libregrtest: add RunTests.work_dir #109290
• gh-109276: Complete test.pythoninfo #109312
• gh-109276: libregrtest: fix worker working dir #109313
• gh-109276: libregrtest: WASM use filename for JSON #109326
• gh-109276: test.pythoninfo gets more test.support data #109337
• gh-109276: libregrtest: WASM use filename for JSON #109340
• gh-109276: libregrtest: WASM use stdout for JSON #109355
• gh-109276: libregrtest: fix work dir on WASI #109356
• gh-109276: Enhance libregrtest results #109828
• gh-109276: regrtest re-runs "env changed" tests #109831
• gh-109276, gh-109508: Fix libregrtest stdout #109903
• gh-109276: regrtest: add WORKER_FAILED state #110148
• gh-109276: regrtest: shorter list of resources #110326

Activity

1. vstinner

   added 3 commits that reference this issue on Sep 11, 2023

   pythongh-109276: libregrtest: use a separated file for JSON

   44f7909

   pythongh-109276: libregrtest: use separated file for JSON

   fcdd93f

   pythongh-109276: libregrtest: use separated file for JSON

   477d7ce
2. vstinner commented on Sep 11, 2023

   

   vstinner

   on Sep 11, 2023

   MemberAuthor

   More actions

   Recent libregrtest enhancements:

   • Worker processes no longer import test.libregrtest.main: the python -m test.libregrtest.worker command is used instead. Change: commit a939b65.
   • Worker processes are now run in a different working directory: in the temporary directory created by the main test process. Change: commit a939b65.
   • --failfast now fails faster (!): RegressionTestResult.addFailure() now calls self.stop is support.failfast is true. Change: commit 31c2945.
3. vstinner

   added 11 commits that reference this issue on Sep 11, 2023

   pythongh-109276: libregrtest only checks saved_test_environment() once

   2ac5bd7

   pythongh-109276: libregrtest only checks saved_test_environment() once

   c1e9e8f

   pythongh-109276: libregrtest only checks saved_test_environment() once

   a0da31a

   pythongh-109276: libregrtest: use separated file for JSON

   4715098

   pythongh-109276: libregrtest calls random.seed() before each test

   3c37f4b

   pythongh-109276: libregrtest calls random.seed() before each test

   11de79d

   pythongh-109276: libregrtest calls random.seed() before each test

   75651e2

   pythongh-109276: libregrtest calls random.seed() before each test

   138b87a

   pythongh-109276: libregrtest calls random.seed() before each test

   b29982d

   gh-109276: libregrtest: use separated file for JSON (#109277)

   de5f8f7

   pythongh-109276: libregrtest calls random.seed() before each test

   4506d1c
4. 69 remaining items
5. csm10495

   added a commit that references this issue on Sep 28, 2023

   pythongh-109276, pythongh-109508: Fix libregrtest stdout (python#109903)

   5c99caf
6. vstinner

   added 9 commits that reference this issue on Sep 30, 2023

   pythongh-109276: regrtest: add WORKER_FAILED state

   a9c4660

   pythongh-109276: regrtest: add WORKER_FAILED state

   be9510a

   pythongh-109276: regrtest: add WORKER_FAILED state

   8328f37

   pythongh-109276: regrtest: add WORKER_FAILED state

   2a3e1a2

   gh-109276: regrtest: add WORKER_FAILED state (#110148)

   2c23419

   pythongh-109276: regrtest: shorter list of resources

   1376d46

   pythongh-109276: regrtest: shorter list of resources

   73ad79e

   pythongh-109276: regrtest: shorter list of resources

   68f2ade

   gh-109276: regrtest: shorter list of resources (#110326)

   efd8c7a
7. Glyphack

   added 5 commits that reference this issue on Sep 2, 2024

   pythongh-109276: Enhance libregrtest results (python#109828)

   4f78dff

   pythongh-109276: regrtest re-runs "env changed" tests (python#109831)

   0e8f38d

   pythongh-109276, pythongh-109508: Fix libregrtest stdout (python#109903)

   35a5968

   pythongh-109276: regrtest: add WORKER_FAILED state (python#110148)

   11ec62f

   pythongh-109276: regrtest: shorter list of resources (python#110326)

   5a3e395

Issue actions