Description

pablogsal

opened on Nov 30, 2022

Issue body actions

Turns out that showing warnings in the tokenizer is quite tricky because in the process of showing the warning we need to fetch the encoding which needs to tokenize the first two lines and if the warning is there that leads to an infinite loop. Check for instance with a file contaning:

0b1and x

Notice that this only happens when tokenizing files.

Linked PRs

• gh-99891: Fix infinite recursion in the tokenizer when showing warnings #99893
• [3.11] gh-99891: Fix infinite recursion in the tokenizer when showing warnings (GH-99893) #99896

Reacted by Lysandros Nikolaou

Activity

1. pablogsal

   added 2 commits that reference this issue on Nov 30, 2022

   pythongh-99891: Fix infinite recursion in the tokenizer when showing …

   edeff24

   pythongh-99891: Fix infinite recursion in the tokenizer when showing …

   3e41198
2. miss-islington

   added a commit that references this issue on Nov 30, 2022

   gh-99891: Fix infinite recursion in the tokenizer when showing warnin…

   417206a
3. pablogsal

   added a commit that references this issue on Nov 30, 2022

   [3.11] pythongh-99891: Fix infinite recursion in the tokenizer when s…

   ac620e7
4. miss-islington

   added a commit that references this issue on Dec 1, 2022

   [3.11] gh-99891: Fix infinite recursion in the tokenizer when showing…

   6282ef6
5. lysnikolaou

   changed the title [-]Unfinite recursion in the tokeniser when showing warnings[/-] [+]Infinite recursion in the tokeniser when showing warnings[/+] on Dec 1, 2022
6. lysnikolaou

   closed this as completedon Dec 1, 2022
7. carljm

   added a commit that references this issue on Dec 1, 2022

   Merge branch 'main' into fixinspect

   12f7659

Issue actions