GeezerVison

Copy link

Copy Markdown

Member

StanFromIreland reviewed Aug 27, 2026

View reviewed changes

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 5505010 to 68400fb Compare August 28, 2026 18:40

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch 3 times, most recently from 962c0c5 to eae3e33 Compare August 28, 2026 23:48

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 73741c4 to 3ce81ac Compare August 30, 2026 11:12

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch 2 times, most recently from 6e223e0 to 64893b4 Compare August 30, 2026 11:26

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 64893b4 to bdeeeb6 Compare August 30, 2026 13:16

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch 3 times, most recently from 9318772 to 056e86e Compare September 5, 2026 17:46

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch 3 times, most recently from da9dfb7 to 1a1a3c7 Compare September 6, 2026 20:24

pablogsal marked this pull request as ready for review September 6, 2026 20:31

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 1a1a3c7 to 3ef307f Compare September 6, 2026 20:57

pablogsal requested a review from ericsnowcurrently as a code owner September 6, 2026 20:57

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 3ef307f to 177eca5 Compare September 6, 2026 21:37

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 0c5a521 to 0b9a33b Compare September 6, 2026 23:35

pablogsal marked this pull request as draft September 6, 2026 23:37

pablogsal force-pushed the gh-153569-tokenizer-validation-tools-clean branch from 0b9a33b to c0ee295 Compare September 7, 2026 00:03

pablogsal marked this pull request as ready for review September 7, 2026 22:05

94 of 96 checks passed

pablogsal deleted the gh-153569-tokenizer-validation-tools-clean branch September 8, 2026 23:15

* main: (158 commits)
  pythongh-156924: Try reifying lazy imports in `ForwarRef.evaluate()` (python#156940)
  pythongh-156233: Fix typos and code snippet errors in the docs (python#156475)
  pythongh-156837: Refer to yield expressions in generator function definitions (pythonGH-156863)
  pythongh-155292: Skip updating unicodedata with mismatched interpreter (pythonGH-157066)
  pythongh-157170: Document the scope of global curses settings (pythonGH-157207)
  pythongh-155966: Correct handling of `math.tanpi` poles (python#155980)
  pythongh-157170: Restore use_env() after test_use_prescr_screen in test_curses (pythonGH-157171)
  pythongh-156910: fix deadlock in type_set_abstractmethods under free-threading (python#156948)
  pythongh-155648: Write the empty and placeholder IDLE tests (python#156260)
  pythongh-153569: centralize formatted-string state and source spans (python#156484)
  pythongh-157137: Mark the PEP 820 soft deprecations as 3.15, not `next` (python#157138)
  pythongh-152433: Use regular LoadLibrary in UWP for Windows system libs (pythonGH-156972)
  pythongh-121617: Fix Py_CLEAR() memcpy in C++: replace NULL with _Py_NULL (python#157188)
  pythongh-157135: Fix documentation errors in the `math.atan{2}pi` functions (python#157136)
  pythongh-121617: Fix Py_CLEAR() in C++: replace NULL with _Py_NULL (python#157067)
  pythongh-156774: Speed up pdb startup with asyncio guard (python#156775)
  pythongh-156109: Allow static, non-framework iOS builds (python#156110)
  pythongh-156780: Emscripten: add missing EM_JS_DEPS (python#156798)
  pythongh-152936: Make privileged functions available on Android (python#152977)
  pythongh-123018: Keep the libedit history file header when truncating (pythonGH-157165)
  ...

…ython#156484)

Formatted-string expressions and comments can outlive the buffer window where
scanning began. Pointer boundaries require buffer relocation to repair tokenizer
state. Record logical source ranges instead. Retain the active input window while a
formatted string is open, give each mode ownership of its comment spans, and
materialize text through shared span views.

…ython#156484)

Formatted-string expressions and comments can outlive the buffer window where
scanning began. Pointer boundaries require buffer relocation to repair tokenizer
state. Record logical source ranges instead. Retain the active input window while a
formatted string is open, give each mode ownership of its comment spans, and
materialize text through shared span views.