GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — gh-137242: Add a --no-randomize option, and use it in Android CI by vstinner · Pull Request #138649 · python/cpython

Conversation

@vstinner

@vstinner vstinner commented Sep 8, 2025 •
edited by mhsmith
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member
  • Based on gh-137242: Add a --no-randomize option, and use it in Android CI #138303
  • Issue: Android CI and binary releases #137242

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
All reactions
mhsmith and others added 4 commits August 31, 2025 18:56
@mhsmith
Change CI arguments: remove --randomize, add --fail-rerun
e96c92a
@mhsmith
Remove outdated comment
f69095c
@mhsmith
Revert changes to default args; add a --no-randomize option instead
b64cace
@vstinner
Don't use None for randomize
754a8c4
@bedevere-app bedevere-app Bot mentioned this pull request Sep 8, 2025
Android CI and binary releases #137242
Closed
@vstinner vstinner mentioned this pull request Sep 8, 2025
gh-137242: Add a --no-randomize option, and use it in Android CI #138303
Closed
@vstinner

vstinner commented Sep 8, 2025

Copy link
Copy Markdown
Member Author

cc @mhsmith
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@mhsmith mhsmith added the skip news label Sep 8, 2025
mhsmith
mhsmith approved these changes Sep 8, 2025
View reviewed changes

@mhsmith mhsmith left a comment

Copy link
Copy Markdown
Member

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, this way is fine too.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
All reactions
@bedevere-app bedevere-app Bot added the awaiting core review label Sep 8, 2025
@mhsmith
mhsmith marked this pull request as ready for review September 8, 2025 12:48
@mhsmith
mhsmith requested a review from freakboy3742 as a code owner September 8, 2025 12:48
@mhsmith mhsmith added needs backport to 3.13 only security fixes infra CI, GitHub Actions, buildbots, Dependabot, etc. needs backport to 3.14 bugs and security fixes labels Sep 8, 2025
@mhsmith
mhsmith removed the request for review from freakboy3742 September 8, 2025 12:52
@vstinner

vstinner commented Sep 8, 2025

Copy link
Copy Markdown
Member Author

!buildbot Android
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@bedevere-bot

bedevere-bot commented Sep 8, 2025

Copy link
Copy Markdown

🤖 New build scheduled with the buildbot fleet by @vstinner for commit 754a8c4 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F138649%2Fmerge

The command will test the builders whose names match following regular expression: Android

The builders matched are:

  • aarch64 Android PR
  • AMD64 Android PR
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
freakboy3742
freakboy3742 approved these changes Sep 8, 2025
View reviewed changes

@freakboy3742 freakboy3742 left a comment

Copy link
Copy Markdown
Contributor

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Makes sense to me!

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
All reactions
@bedevere-app bedevere-app Bot added awaiting merge and removed awaiting core review labels Sep 8, 2025
@freakboy3742
freakboy3742 merged commit 01895d2 into python:main Sep 8, 2025
@miss-islington-app

miss-islington-app Bot commented Sep 8, 2025

Copy link
Copy Markdown

Thanks @vstinner for the PR, and @freakboy3742 for merging it 🌮🎉.. I'm working now to backport this PR to: 3.13, 3.14.
🐍🍒⛏🤖
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@bedevere-app bedevere-app Bot removed the awaiting merge label Sep 8, 2025
miss-islington pushed a commit to miss-islington/cpython that referenced this pull request Sep 8, 2025
@vstinner @mhsmith @miss-islington
pythongh-137242: Add a --no-randomize option, and use it in Android CI (
01a512d 
pythonGH-138649)

Adds a --no-randomize option to the CI runner, so that randomisation can be easily
disabled for --fast-ci and --slow-ci configurations on single-threaded testing platforms
like Android, iOS, and Emscripten.

---------
(cherry picked from commit 01895d2)

Co-authored-by: Victor Stinner <[email protected]>
Co-authored-by: Malcolm Smith <[email protected]>
@miss-islington-app

miss-islington-app Bot commented Sep 8, 2025

Copy link
Copy Markdown

Sorry, @vstinner and @freakboy3742, I could not cleanly backport this to 3.13 due to a conflict.
Please backport using cherry_picker on command line.

cherry_picker 01895d233b4370e0c99f16c01a57cfd73c434b28 3.13
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@miss-islington-app miss-islington-app Bot assigned freakboy3742 Sep 8, 2025
@bedevere-app

bedevere-app Bot commented Sep 8, 2025

Copy link
Copy Markdown

GH-138684 is a backport of this pull request to the 3.14 branch.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@bedevere-app bedevere-app Bot removed the needs backport to 3.14 bugs and security fixes label Sep 8, 2025
freakboy3742 pushed a commit to freakboy3742/cpython that referenced this pull request Sep 8, 2025
@vstinner @mhsmith @freakboy3742
[3.13] pythongh-137242: Add a --no-randomize option, and use it in An…
6f17532 
…droid CI (pythonGH-138649)

Adds a --no-randomize option to the CI runner, so that randomisation can be easily
disabled for --fast-ci and --slow-ci configurations on single-threaded testing platforms
like Android, iOS, and Emscripten.

---------
(cherry picked from commit 01895d2)

Co-authored-by: Victor Stinner <[email protected]>
Co-authored-by: Malcolm Smith <[email protected]>
@bedevere-app

bedevere-app Bot commented Sep 8, 2025

Copy link
Copy Markdown

GH-138685 is a backport of this pull request to the 3.13 branch.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@bedevere-app bedevere-app Bot removed the needs backport to 3.13 only security fixes label Sep 8, 2025
hugovk pushed a commit that referenced this pull request Sep 9, 2025
@miss-islington @vstinner @mhsmith
[3.14] gh-137242: Add a --no-randomize option, and use it in Android …
6f66590 
…CI (GH-138649) (#138684)

Co-authored-by: Victor Stinner <[email protected]>
Co-authored-by: Malcolm Smith <[email protected]>
vstinner added a commit that referenced this pull request Sep 9, 2025
@freakboy3742 @vstinner @mhsmith
[3.13] gh-137242: Add a --no-randomize option, and use it in Android …
85649b7 
…CI (GH-138649) (#138685)

Adds a --no-randomize option to the CI runner, so that randomisation can be easily
disabled for --fast-ci and --slow-ci configurations on single-threaded testing platforms
like Android, iOS, and Emscripten.

---------
(cherry picked from commit 01895d2)

Co-authored-by: Victor Stinner <[email protected]>
Co-authored-by: Malcolm Smith <[email protected]>
@vstinner
vstinner deleted the regrtest_no_randomize branch September 9, 2025 08:53
@bedevere-bot

bedevere-bot commented Sep 9, 2025

Copy link
Copy Markdown

⚠️⚠️⚠️ Buildbot failure ⚠️⚠️⚠️

Hi! The buildbot aarch64 Android 3.13 (tier-3) has failed when building commit 85649b7.

What do you need to do:

  1. Don't panic.
  2. Check the buildbot page in the devguide if you don't know what the buildbots are or how they work.
  3. Go to the page of the buildbot that failed (https://buildbot.python.org/#/builders/1590/builds/972) and take a look at the build logs.
  4. Check if the failure is related to this commit (85649b7) or if it is a false positive.
  5. If the failure is related to this commit, please, reflect that on the issue and make a new Pull Request with a fix.

You can take a look at the buildbot page here:

https://buildbot.python.org/#/builders/1590/builds/972

Summary of the results of the build (if available):

Click to see traceback logs 
remote: Enumerating objects: 9, done.        
remote: Counting objects:  20% (1/5)        
remote: Counting objects:  40% (2/5)        
remote: Counting objects:  60% (3/5)        
remote: Counting objects:  80% (4/5)        
remote: Counting objects: 100% (5/5)        
remote: Counting objects: 100% (5/5), done.        
remote: Compressing objects:  20% (1/5)        
remote: Compressing objects:  40% (2/5)        
remote: Compressing objects:  60% (3/5)        
remote: Compressing objects:  80% (4/5)        
remote: Compressing objects: 100% (5/5)        
remote: Compressing objects: 100% (5/5), done.        
remote: Total 9 (delta 0), reused 0 (delta 0), pack-reused 4 (from 1)        
From https://github.com/python/cpython
 * branch                    3.13       -> FETCH_HEAD
Note: switching to '85649b769f0db4992c061c8d17155c07553dda46'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 85649b769f0 [3.13] gh-137242: Add a --no-randomize option, and use it in Android CI (GH-138649) (#138685)
Switched to and reset branch '3.13'

configure: WARNING: no system libmpdec found; falling back to bundled libmpdec (deprecated and scheduled for removal in Python 3.16)
configure: WARNING: pkg-config is missing. Some dependencies may not be detected correctly.

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

100  192k  100  192k    0     0  2196k      0 --:--:-- --:--:-- --:--:-- 2196k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

100 42455  100 42455    0     0   468k      0 --:--:-- --:--:-- --:--:--  468k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

100 5041k  100 5041k    0     0  26.0M      0 --:--:-- --:--:-- --:--:-- 26.0M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

100 1257k  100 1257k    0     0  10.6M      0 --:--:-- --:--:-- --:--:-- 10.6M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0

100  635k  100  635k    0     0  4814k      0 --:--:-- --:--:-- --:--:-- 4814k
../../configure: line 4013: pkg-config: command not found
configure: WARNING: no system libmpdec found; falling back to bundled libmpdec (deprecated and scheduled for removal in Python 3.16)
configure: WARNING: pkg-config is missing. Some dependencies may not be detected correctly.

../../Python/fileutils.c:455:1: warning: unused function 'decode_current_locale' [-Wunused-function]
  455 | decode_current_locale(const char* arg, wchar_t **wstr, size_t *wlen,
      | ^~~~~~~~~~~~~~~~~~~~~
../../Python/fileutils.c:674:1: warning: unused function 'encode_current_locale' [-Wunused-function]
  674 | encode_current_locale(const wchar_t *text, char **str,
      | ^~~~~~~~~~~~~~~~~~~~~
2 warnings generated.
../../Modules/_testexternalinspection.c:538:5: warning: code will never be executed [-Wunreachable-code]
  538 |     int pid;
      |     ^~~~~~~~
1 warning generated.

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  8784  100  8784    0     0   242k      0 --:--:-- --:--:-- --:--:--  245k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2894  100  2894    0     0  73375      0 --:--:-- --:--:-- --:--:-- 74205
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 43504  100 43504    0     0  1133k      0 --:--:-- --:--:-- --:--:-- 1148k
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@vstinner

vstinner commented Sep 9, 2025

Copy link
Copy Markdown
Member Author

@freakboy3742: I'm not sure what's going on, aarch64 Android 3.13 buildbot failed with:

C/C++: ld.lld: error: /Users/android/buildarea/3.13.mhsmith-android-aarch64/build/cross-build/aarch64-linux-android/prefix/lib/libpython3.13.so: unknown file type
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@mhsmith

mhsmith commented Sep 9, 2025

Copy link
Copy Markdown
Member

This happened before in #137186 (comment), but I wasn't sure of the cause. I'll look into it.
vstinner reacted with thumbs up emoji
All reactions
  • 👍 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@mhsmith

mhsmith commented Sep 9, 2025 •
edited
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

@freakboy3742: Like the last time this problem occurred, the buildbot server had about 12 GB of free space. The biggest offender was /Users/buildbot/Library/Logs/CoreSimulator:

-rw-r--r--   1 buildbot  staff  30042226464 Jun 17 13:32 CoreSimulator.prev.log
-rw-r--r--   1 buildbot  staff  14734765773 Sep  9 13:20 CoreSimulator.log
-rw-r--r--   1 buildbot  staff      1100845 Feb 10  2025 Simulator.log

I deleted CoreSimulator.prev.log (30 GB), but I didn't restart the Android worker as I did last time, so this should be a better test of whether disk space is indeed the cause.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@mhsmith mhsmith mentioned this pull request Sep 9, 2025
Use --slow-ci on Android python/buildmaster-config#628
Merged
lkollar pushed a commit to lkollar/cpython that referenced this pull request Sep 9, 2025
@vstinner @mhsmith @lkollar
pythongh-137242: Add a --no-randomize option, and use it in Android CI (
ade643b 
python#138649)

Adds a --no-randomize option to the CI runner, so that randomisation can be easily
disabled for --fast-ci and --slow-ci configurations on single-threaded testing platforms
like Android, iOS, and Emscripten.

---------

Co-authored-by: Malcolm Smith <[email protected]>
@freakboy3742

freakboy3742 commented Sep 9, 2025

Copy link
Copy Markdown
Contributor

I deleted CoreSimulator.prev.log (30 GB), but I didn't restart the Android worker as I did last time, so this should be a better test of whether disk space is indeed the cause.

Sounds like a cron job to rotate/clean up those logs (or better still, direct them to the build directory) might be called for. I'll investigate what can be done.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
This was referenced Sep 11, 2025
gh-137242: Allow Android testbed to take all Python command-line options #138805
Merged
gh-138171: Migrate iOS testbed location and add Apple build script #138176
Merged
@mhsmith

mhsmith commented Sep 29, 2025

Copy link
Copy Markdown
Member

I deleted CoreSimulator.prev.log (30 GB), but I didn't restart the Android worker as I did last time, so this should be a better test of whether disk space is indeed the cause.

For future reference: this apparently did resolve the problem. It's plausible that problems could start happening with 12 GB still available, because the iOS tests use a large amount of temporary space while running. But I still don't know why it would lead to this "unknown file type" error.
All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.
@mhsmith mhsmith mentioned this pull request Oct 30, 2025
gh-135801: Improve filtering by module in warn_explicit() without module argument #140151
Merged
@mhsmith mhsmith mentioned this pull request Jan 25, 2026
Android buildbot failures after updating to API level 35 #142387
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@freakboy3742 freakboy3742 freakboy3742 approved these changes
@mhsmith mhsmith mhsmith approved these changes

Uh oh!

There was an error while loading. Please reload this page.

Assignees

@freakboy3742 freakboy3742

Labels

infra CI, GitHub Actions, buildbots, Dependabot, etc. skip news

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

4 participants

@vstinner @bedevere-bot @mhsmith @freakboy3742
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.