GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
GeezerVison is showing github.com — bpo-31861: Provide aiter and anext builtins by jab · Pull Request #23847 · python/cpython Conversation
|
|
Hello, and thanks for your contribution! I'm a bot set up to make sure that the project can legally accept this contribution by verifying everyone involved has signed the PSF contributor agreement (CLA). Recognized GitHub usernameWe couldn't find a bugs.python.org (b.p.o) account corresponding to the following GitHub usernames: This might be simply due to a missing "GitHub Name" entry in one's b.p.o account settings. This is necessary for legal reasons before we can look at this contribution. Please follow the steps outlined in the CPython devguide to rectify this issue. You can check yourself to see if the CLA has been received. Thanks again for the contribution, we look forward to reviewing it! |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
|
Shoot, noticed this PR now has conflicts. Will resolve and push a new revision ASAP. |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
Resolved the conflicts - hopefully we can get this reviewed before a new conflict pops up! |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
* master: (129 commits) bpo-43452: Micro-optimizations to PyType_Lookup (pythonGH-24804) bpo-43517: Fix false positive in detection of circular imports (python#24895) bpo-43494: Make some minor changes to lnotab notes (pythonGH-24861) Mention that code.co_lnotab is deprecated in what's new for 3.10. (python#24902) bpo-43244: Remove symtable.h header file (pythonGH-24910) bpo-43466: Add --with-openssl-rpath configure option (pythonGH-24820) Fix a typo in c-analyzer (pythonGH-24468) bpo-41561: Add workaround for Ubuntu's custom security level (pythonGH-24915) bpo-43521: Allow ast.unparse with empty sets and NaN (pythonGH-24897) bpo-43244: Remove the PyAST_Validate() function (pythonGH-24911) bpo-43541: Fix PyEval_EvalCodeEx() regression (pythonGH-24918) bpo-43244: Fix test_peg_generators on Windows (pythonGH-24913) bpo-39342: Expose X509_V_FLAG_ALLOW_PROXY_CERTS in ssl module (pythonGH-18011) bpo-43244: Fix test_peg_generator for PyAST_Validate() (pythonGH-24912) bpo-42128: Add 'missing :' syntax error message to match statements (pythonGH-24733) bpo-43244: Add pycore_ast.h header file (pythonGH-24908) bpo-43244: Rename pycore_ast.h to pycore_ast_state.h (pythonGH-24907) Remove unnecessary imports in the grammar parser (pythonGH-24904) bpo-35883: Py_DecodeLocale() escapes invalid Unicode characters (pythonGH-24843) Add PEP 626 to what's new in 3.10. (python#24892) ...
There was an error while loading. Please reload this page.
|
Merged in latest master and fixed some minor nits. All checks have passed against the latest revision. UPDATE (ICYMI): There is now ongoing discussion in this recent python-dev thread about whether to merge this PR (favored by @1st1, and perhaps others who've ❤️'d and participated in this PR), or whether to instead resurrect #8895, my PR from 2018 that added |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
The basic code is solid. Some questions and suggestions about how much needs to be public and documented.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
| Return an :term:`asynchronous iterator`. This is the async variant | ||
| of the :func:`iter` builtin, and behaves similarly. |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Frankly, this doesn't tell me much. The description doesn't even state that aiter(x) is equivalent to x.__aiter__(), which to me is the key point. Certainly it shouldn't start by stating the type of what it returns; it should describe how the return value relates to the input. (Compare the entry for abs(x) above, "Return the absolute value of a number." This clearly references the input and what the function does to that value.)
Also, state explicitly that aiter(aiter(x)) is the same as aiter(x) (IOW that aiter(x) itself has an __aiter__() method that returns self.)
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Incorporated in the latest revision, but please let me know if it needs further refinement. Thanks for the great feedback!
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
| /* Takes an AsyncIterable object and returns an AsyncIterator for it. | ||
| This is typically a new iterator but if the argument is an AsyncIterator, | ||
| this returns itself. */ | ||
| PyAPI_FUNC(PyObject *) PyObject_GetAiter(PyObject *); |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I don't mind adding this function -- while somewhat trivial, it's something that projects like Cython (and potentially our own modules like _asynciomodule.c) have to reimplement.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
|
||
| PyAPI_DATA(PyTypeObject) PySeqIter_Type; | ||
| PyAPI_DATA(PyTypeObject) PyCallIter_Type; | ||
| PyAPI_DATA(PyTypeObject) PyAsyncCallAwaitable_Type; |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Maybe these types and the function below should remain CPython implementation details? Just because they're returned by builtins doesn't mean all the implementation types need to be in the C-level API.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
+1. I'd make them internal.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Makes sense, thanks. Done in the latest revision. Another look?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Almost there!
Sorry, something went wrong.
There was an error while loading. Please reload this page.
| Equivalent to calling ``x.__aiter__()``. | ||
|
|
||
| *async_iterable* must be an :term:`asynchronous iterable`, | ||
| and :func:`aiter` returns an asynchronous iterator for it. | ||
| ``aiter(aiter(x))`` is the same as ``aiter(x)``. | ||
| (``aiter(x)`` itself has an ``__aiter__()`` method that returns ``self``.) | ||
|
|
||
| Unlike the :func:`iter` builtin, :func:`aiter` has no 2-argument variant. | ||
| Often, this variant can be replaced with assignment expressions:: | ||
| Formally, given an :term:`asynchronous iterable`, | ||
| return an :term:`asynchronous iterator`. |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Much better! Here is how I would rearrange this:
Return an :term:`asynchronous iterator`
for an :term:`asynchronous iterable`.
Equivalent to calling ``x.__aiter__()``.
``aiter(x)`` itself has an ``__aiter__()`` method that returns ``x``,
so ``aiter(aiter(x))`` is the same as ``aiter(x)``.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Incorporated in the latest revision, thanks!
(((
Come to think of it, iter also has the iter(iter(x)) == iter(x) property, which is not currently mentioned in the iter docs. The iter docs have a lot more work to do though, to cover the 1- and 2-arg variants (and they're already doing this very well).
And now that I'm looking at those again, I notice the only code example there is for the 2-arg variant:
from functools import partial with open('mydata.db', 'rb') as f: for block in iter(partial(f.read, 64), b''): process_block(block)
If this pattern is now obsoleted by assignment expressions[1], is it worth updating the iter docs to (1) mention the iter(iter(x)) == iter(x) property, and (2) remove the obsoleted example code? If so, happy to submit a separate PR for that.
[1] as in the following:
with open('mydata.db', 'rb') as f: while block := f.read(64): process_block(block)
)))
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I don't want to personally get into the weeds about the iter() docs, sorry. Something for the docs WG perhaps.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I don't think it's worth updating the docs to promise iter(iter(x)) == iter(x) as it isn't a specific benefit to the user beyond logically doing the right thing.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I can see that.
@gvanrossum, do you think @brettcannon's rationale applies equally to the aiter docs too? I did add a test_aiter_idempotent() for this in 6ee8824 to go along with the promise that the aiter docs are now making, but can remove that test along with that part of the docs if that's better.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I think there's a different bar for updating the iter() docs than for the initial version of the aiter() docs. And they don't have to match precisely.
FWIW the main reason the idempotency property is important is because of the implicit [a]iter() call in a for-loop, since in
for i in x: ...
the for-loop calls iter(x), so that in
for i in iter(x): ...
the for-loop ends up calling iter(iter(x)). It's the same for async for and aiter().
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Thanks for your patience. This all looks good to me now! I'll merge after applying my own suggestion.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
|
@gvanrossum: Please replace |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
Congrats! |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
Thanks so much, @gvanrossum! We’re honored to have been able to contribute! |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
I believe test_asyncio is unstable or broken on this platform.
|
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
I proposed to PR #25266 to rename PyAnextAwaitable_Type to _PyAnextAwaitable_Type, and to initialize the type at Python startup: can someone please have a look? |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
Successfully merging this pull request may close these issues.
There was an error while loading. Please reload this page.