GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | |||||||||||||||||||||||||||||||||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | |||||||||||||||||||||||||||||||||||||||||||||
GeezerVison is showing github.com — gh-131798: Narrow the return type of `_FORMAT_SIMPLE` and `_FORMAT_WITH_SPEC` to `str` by NekoAsakura · Pull Request #146639 · python/cpython Conversation
|
| res = sym_new_type(ctx, &PyUnicode_Type); | ||
| } | ||
|
|
||
| op(_FORMAT_WITH_SPEC, (value, fmt_spec -- res)) { |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
This can return a subclass, e.g.
class my(str):
def __format__(self, spec):
return self
m=my('aap')
type(f'{m}')
Does the sym_new_type(ctx, &PyUnicode_Type); not guarantee we have an exact type?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Good catch! I oversimplified this. Narrowing type for format isn't as straightforward as I thought.
That said, I'm curious why FORMAT_SIMPLE needs to preserve str subclasses. Had a look through the git history it's been this way since 2015, and seems not a deliberate type-preservation contract.
Current behaviour is already inconsistent:
class my(str):
def __format__(self, spec):
return self
m = my('aap')
type('{}'.format(m)) # <class 'my'>
type('x{}'.format(m)) # <class 'str'>
type(f'{m}') # <class 'my'>
type(f'x{m}') # <class 'str'>
Multi-piece concatenation already strips it (both _PyUnicodeWriter in str.format and BUILD_STRING in f-strings create exact str).
If FORMAT_SIMPLE normalised to exact str, this inconsistency goes away and type narrowing becomes unconditionally correct. Would that be a reasonable change, or is there a reason to preserve str subclass identity through formatting that I'm missing?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Huh that's kinda scary. The semantics look a little strange, so maybe we should leave this alone for now?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Fair enough. I just noticed the inconsistency and thought it was worth raising.
For the narrowing itself: we could do conditional narrowing for input types where we can prove __format__ returns exact str (e.g. int, float). But honestly it feels not pythonic to hardcode a list of "safe" types for a uop that's less then 0.1%. I'd prefer just closing this PR unless you think it's worth keeping with that approach?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Actually we already have something like that called sym_is_safe_type, you can use that
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I couldn't find sym_is_safe_type anywhere. The closest thing I can see is sym_is_safe_const, but that checks for known constant values rather than types. Have I overlooked something?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Oh yeah sorry that's the one! Just factor out the type checks in _Py_uop_sym_is_safe_const into another function and use that in this case, I think that's fine!
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Done. How does it look now?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
…MAT_WITH_SPEC` to str for built-in types
| return (typ == &PyLong_Type) || | ||
| (typ == &PyUnicode_Type) || | ||
| (typ == &PyFloat_Type) || | ||
| (typ == &_PyNone_Type) || | ||
| (typ == &PyBool_Type) || | ||
| (typ == &PyFrozenDict_Type); |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Oops, I meant to factor this out into a common function, sorry!
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
You mean factoring safe types into a static helper? No problem.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
…MAT_WITH_SPEC` to str for built-in types
|
Going to close and reopen this PR to re-trigger CI. Sorry! |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
# Conflicts: # Python/optimizer_symbols.c
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Looks good overall. The is_safe_builtin_type function needs fixing up though.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
| } | ||
|
|
||
| static bool | ||
| is_safe_builtin_type(PyTypeObject *typ) |
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
I don't like this name. "is safe" for what?
For how we are using this, I don't think frozendict and frozenset should be included as they can contain "unsafe" objects. You should be able to add bytes to the list.
Maybe is_atomic_builtin_type?
Also add a comment explaining that "atomic" means that its values can be evaluated without side effects as they aren't containers. Also that common functions on them are pure and return the expected type, like str(ob) returns a str, int(ob) returns an obj, etc.
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
The reason will be displayed to describe this comment to others. Learn more.
Looks like frozendict and frozenset aren't safe for const folding either. I've pushed a test that captures the behaviour. I am not sure if there is a better fix than just dropping them. Do you want that addressed here, or track in a separate issue?
Sorry, something went wrong.
There was an error while loading. Please reload this page.
Documentation build overview
40 files changed ·
|
Sorry, something went wrong.
There was an error while loading. Please reload this page.
|
This PR is stale because it has been open for 90 days with no activity. |
Sorry, something went wrong.
There was an error while loading. Please reload this page.
There was an error while loading. Please reload this page.
Successfully merging this pull request may close these issues.
There was an error while loading. Please reload this page.