Description

vstinner

opened on Sep 22, 2023

Issue body actions

cp874.cpython-313.pyc.281473310212544 looks like a temporary PYC filename used by importlib to create PYC files in atomic way.

The problem seems to be that tests are run in parallel and that files can appear or disappear while test_venv is running (since other tests are running at the same time).

I'm not sure why test_zippath_from_non_installed_posix() wants to eagerly copies __pycache__/ directories. Is it important to copy PYC files for a "zipapp"?

aarch64 RHEL8 Refleaks 3.x:

0:00:14 load avg: 8.78 [ 68/463/1] test_venv failed (1 error)
beginning 6 repetitions
123456
Could not find platform dependent libraries <exec_prefix>
.Could not find platform dependent libraries <exec_prefix>
.test test_venv failed -- Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.x.cstratak-RHEL8-aarch64.refleak/build/Lib/test/test_venv.py", line 578, in test_zippath_from_non_installed_posix
    shutil.copytree(fn, os.path.join(libdir, name))
  File "/home/buildbot/buildarea/3.x.cstratak-RHEL8-aarch64.refleak/build/Lib/shutil.py", line 588, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/buildbot/buildarea/3.x.cstratak-RHEL8-aarch64.refleak/build/Lib/shutil.py", line 542, in _copytree
    raise Error(errors)
shutil.Error: [('/home/buildbot/buildarea/3.x.cstratak-RHEL8-aarch64.refleak/build/Lib/encodings/__pycache__/cp874.cpython-313.pyc.281473310212544', '/tmp/test_python_fw_naiq7/tmpfycz07rf/lib/python3.13/encodings/__pycache__/cp874.cpython-313.pyc.281473310212544', "[Errno 2] No such file or directory: '/home/buildbot/buildarea/3.x.cstratak-RHEL8-aarch64.refleak/build/Lib/encodings/__pycache__/cp874.cpython-313.pyc.281473310212544'")]

build: https://buildbot.python.org/all/#/builders/551/builds/865

By the way, Could not find platform dependent libraries <exec_prefix> message is surprising.

Linked PRs

• gh-109748: Fix venv test_zippath_from_non_installed_posix() #109872
• [3.12] gh-109748: Fix venv test_zippath_from_non_installed_posix() (GH-109872) #109873
• [3.11] gh-109748: Fix venv test_zippath_from_non_installed_posix() (GH-109872) #109874
• gh-109748: Fix again venv test_zippath_from_non_installed_posix() #110149
• [3.11] gh-109748: Fix again venv test_zippath_from_non_installed_posix() (GH-110149) #110153

Activity

1. vstinner

   added

   testsTests in the Lib/test dirTests in the Lib/test dir

   on Sep 22, 2023
2. vstinner commented on Sep 25, 2023

   

   vstinner

   on Sep 25, 2023

   MemberAuthor

   More actions

   aarch64 Fedora Stable Refleaks 3.x: https://buildbot.python.org/all/#/builders/123/builds/857
3. vstinner

   added 5 commits that reference this issue on Sep 25, 2023

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix()

   8120c89

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix()

   26c30da

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix()

   338ea4e

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix()

   374e0fe

   gh-109748: Fix venv test_zippath_from_non_installed_posix() (#109872)

   25bb266
4. miss-islington

   added 2 commits that reference this issue on Sep 25, 2023

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix() (py…

   fab06b4

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix() (py…

   80f594c
5. vstinner

   added a commit that references this issue on Sep 25, 2023

   [3.11] gh-109748: Fix venv test_zippath_from_non_installed_posix() (G…

   358282e
6. vstinner

   closed this as completedon Sep 25, 2023
7. csm10495

   added a commit that references this issue on Sep 28, 2023

   pythongh-109748: Fix venv test_zippath_from_non_installed_posix() (py…

   fe9f2a8
8. vstinner

   added 2 commits that reference this issue on Sep 30, 2023

   pythongh-109748: Fix again venv test_zippath_from_non_installed_posix()

   52fc8c4

   gh-109748: Fix again venv test_zippath_from_non_installed_posix() (#1…

   0def8c7
9. miss-islington

   added a commit that references this issue on Sep 30, 2023

   pythongh-109748: Fix again venv test_zippath_from_non_installed_posix…

   c9c567f
10. vstinner

    added 3 commits that reference this issue on Sep 30, 2023

    [3.11] gh-109748: Fix again venv test_zippath_from_non_installed_posi…

    080f5b9

    pythongh-109748: Fix again venv test_zippath_from_non_installed_posix…

    a334057

    [3.12] gh-109615: Fix support test_copy_python_src_ignore() (#109958) (…

    8939221
11. Glyphack

    added 2 commits that reference this issue on Sep 2, 2024

    pythongh-109748: Fix venv test_zippath_from_non_installed_posix() (py…

    9043128

    pythongh-109748: Fix again venv test_zippath_from_non_installed_posix…

    3df4cb9

Issue actions