GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — gh-84559: improve What's New entry for `multiprocessing` start method changes by picnixz · Pull Request #128173 · python/cpython

Conversation

@picnixz

@picnixz picnixz commented Dec 22, 2024 •
edited by github-actions Bot
Loading

Uh oh!

There was an error while loading. Please reload this page.

Copy link
Copy Markdown
Member

This is a proposal for an improved changelog. I am tempted to add it at the very top of the file in the "Summary -- release highlights" but I don't know if @hugovk is ok or not with it.

  • Issue: multiprocessing's default posix start method of 'fork' is broken: change to `'forkserver' || 'spawn' #84559

📚 Documentation preview 📚: https://cpython-previews--128173.org.readthedocs.build/

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@picnixz
improve changelog
139443b
@picnixz
picnixz requested a review from gpshead as a code owner December 22, 2024 11:39
@bedevere-app bedevere-app Bot added docs Documentation in the Doc dir skip news labels Dec 22, 2024
@bedevere-app bedevere-app Bot mentioned this pull request Dec 22, 2024
multiprocessing's default posix start method of 'fork' is broken: change to `'forkserver' || 'spawn' #84559
Closed
@bedevere-app bedevere-app Bot added the awaiting review label Dec 22, 2024
@picnixz
fix CI
64c636e
@picnixz
picnixz marked this pull request as draft December 22, 2024 11:50
@bedevere-app bedevere-app Bot removed the awaiting review label Dec 22, 2024
@picnixz
fix labels
50e482c
@picnixz
picnixz marked this pull request as ready for review December 22, 2024 11:54
@bedevere-app bedevere-app Bot added the awaiting review label Dec 22, 2024
@hugovk

hugovk commented Dec 22, 2024

Copy link
Copy Markdown
Member

I am tempted to add it at the very top of the file in the "Summary -- release highlights" but I don't know if @hugovk is ok or not with it.

Yeah, this sounds like a big change we want people to know about, let's add a summary up there and link down to multiprocessing part.

I expect we'll expand the summary closer to the release, compare 3.13:

https://docs.python.org/3/whatsnew/3.13.html#summary-release-highlights

cc @AA-Turner

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

hugovk
hugovk reviewed Dec 22, 2024
View reviewed changes
Comment thread Doc/whatsnew/3.14.rst Resolved

Uh oh!

There was an error while loading. Please reload this page.

@picnixz
highlight changes
5127698
@jakirkham

jakirkham commented Dec 22, 2024

Copy link
Copy Markdown

Just a note, on macOS the default is spawn (as it has been for a while). However the docs also note that POSIX uses forkserver by default. Though macOS also is a POSIX platform. Should this be disambiguated somehow?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@picnixz

picnixz commented Dec 22, 2024

Copy link
Copy Markdown
Member Author

Though macOS also is a POSIX platform. Should this be disambiguated somehow

Ah yes, sorry. it should have been "On POSIX platforms, except macOS, [...]" or "On platforms other than macOS and Windows". Which one would be the clearer?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@picnixz
improve wording
81ca0d1
@gpshead gpshead self-assigned this Dec 24, 2024
gpshead
gpshead reviewed Dec 24, 2024
View reviewed changes

@gpshead gpshead left a comment

Copy link
Copy Markdown
Member

There was a problem hiding this comment.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm glad we have a full section in the multiprocessing docs to link to (hooray past us!). But to help people from a What's New standpoint given the issues people are raising about this being confusing, I think we should pick a couple different short example error messages users might see coming out of an application that needs modification to work with the new start method when using multiprocessing or concurrent.futures.

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

All reactions
@picnixz

picnixz commented Dec 24, 2024

Copy link
Copy Markdown
Member Author

I think we should pick a couple different short example error messages users might see coming out of an application that needs modification to work with the new start method when using multiprocessing or concurrent.futures.

What about improving the section in multiprocessing about the differences between fork and spawn/forkserver by adding some "common issues" examples (and we can add a link to that section in the What's New entries) and/or possible examples of how to upgrade from 'fork' to 'spawn/forkserver'?

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

StanFromIreland
StanFromIreland approved these changes Dec 24, 2024
View reviewed changes
@bedevere-app bedevere-app Bot added awaiting core review and removed awaiting review labels Dec 24, 2024
StanFromIreland
StanFromIreland reviewed Dec 24, 2024
View reviewed changes
Comment thread Doc/whatsnew/3.14.rst Resolved

Uh oh!

There was an error while loading. Please reload this page.

@gpshead

gpshead commented Dec 25, 2024

Copy link
Copy Markdown
Member

I think we should pick a couple different short example error messages users might see coming out of an application that needs modification to work with the new start method when using multiprocessing or concurrent.futures.

What about improving the section in multiprocessing about the differences between fork and spawn/forkserver by adding some "common issues" examples (and we can add a link to that section in the What's New entries) and/or possible examples of how to upgrade from 'fork' to 'spawn/forkserver'?

Even just a sentence in What's New saying something along the lines of "if you are seeing name errors of pickling errors coming out of multiprocessing or concurrent.futures when you upgrade to 3.14, read ...link-to-section..." would help people understand. Expanding further upon that kind of thing in the multiprocessing docs as common issues would be good.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@gpshead @StanFromIreland
remove extra space
25b44e5
Co-authored-by: Stan Ulbrych <[email protected]>
@picnixz

picnixz commented Dec 25, 2024

Copy link
Copy Markdown
Member Author

Even just a sentence in What's New saying something along the lines of "if you are seeing name errors of pickling errors coming out of multiprocessing or concurrent.futures when you upgrade to 3.14, read ...link-to-section..."

I'll have a look at what to link tomorrow and if I have the motivation, I'll do something for the mp docs.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@ngoldbaum

ngoldbaum commented Feb 19, 2025

Copy link
Copy Markdown
Contributor

Small ping that I ended up here after a discussion about this behavior and getting this docs improvement merged would help a lot. No rush of course but just don’t want this forgotten.

dmoerner reacted with thumbs up emoji
All reactions
  • 👍 1 reaction

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@picnixz

picnixz commented Feb 21, 2025

Copy link
Copy Markdown
Member Author

Oh I forgot... I will try to make it by the end of the weekend. Let's make it as the next task. Thanks for the ping !

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

picnixz added 2 commits February 22, 2025 13:12
@picnixz
Merge remote-tracking branch 'upstream/main' into doc/multiprocessing…
0fab786
…/clarifications-84559
@picnixz
mention possible errors in incompatible changes
85767c5
@picnixz
picnixz requested review from gpshead and hugovk February 22, 2025 12:21
hugovk
hugovk reviewed Feb 22, 2025
View reviewed changes
Comment thread Doc/whatsnew/3.14.rst Resolved

Uh oh!

There was an error while loading. Please reload this page.

@picnixz
no need for plz
0342471
gpshead
gpshead approved these changes Feb 22, 2025
View reviewed changes
@bedevere-app bedevere-app Bot added awaiting merge and removed awaiting core review labels Feb 22, 2025
@picnixz
picnixz merged commit b8c313a into python:main Feb 23, 2025
@bedevere-app bedevere-app Bot removed the awaiting merge label Feb 23, 2025
@picnixz
picnixz deleted the doc/multiprocessing/clarifications-84559 branch February 23, 2025 09:35
brianschubert pushed a commit to brianschubert/cpython that referenced this pull request Jul 27, 2025
@picnixz @gpshead
@StanFromIreland @brianschubert
[3.13] pythongh-84559: improve What's New entry for multiprocessing…
ef1acf3
… start method changes (pythonGH-128173)

(cherry picked from commit b8c313a)

Co-authored-by: Bénédikt Tran <[email protected]>
Co-authored-by: Gregory P. Smith <[email protected]>
Co-authored-by: Stan Ulbrych <[email protected]>
@bedevere-app

bedevere-app Bot commented Jul 27, 2025

Copy link
Copy Markdown

GH-137156 is a backport of this pull request to the 3.13 branch.

All reactions

Sorry, something went wrong.

Uh oh!

There was an error while loading. Please reload this page.

@brianschubert brianschubert mentioned this pull request Jul 27, 2025
[3.13] gh-132898: Add a note in multiprocessing.Process docs about creating a process in a REPL (GH-137118) #137155
Merged
gpshead added a commit that referenced this pull request Jul 28, 2025
@brianschubert @picnixz
@gpshead @StanFromIreland
[3.13] gh-84559: improve What's New entry for multiprocessing start…
c2b8a89
…method changes (GH-128173) (#137156)

[3.13] gh-84559: improve What's New entry for `multiprocessing` start method changes (GH-128173)
(cherry picked from commit b8c313a)

Co-authored-by: Bénédikt Tran <[email protected]>
Co-authored-by: Gregory P. Smith <[email protected]>
Co-authored-by: Stan Ulbrych <[email protected]>
@hugovk hugovk mentioned this pull request Sep 30, 2025
GH-123299: Copyedit 3.14 What's New: Other Language Changes #139425
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@hugovk hugovk hugovk left review comments
@StanFromIreland StanFromIreland StanFromIreland approved these changes
@gpshead gpshead gpshead approved these changes

Uh oh!

There was an error while loading. Please reload this page.

Assignees

@gpshead gpshead

Labels

docs Documentation in the Doc dir skip news

Projects

Docs PRs
Status: Done

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Uh oh!

There was an error while loading. Please reload this page.

6 participants

@picnixz @hugovk @jakirkham @gpshead @ngoldbaum @StanFromIreland
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.