File tree Expand file tree Collapse file tree 1 file changed +5
-5
lines changed Expand file tree Collapse file tree 1 file changed +5
-5
lines changed Original file line number Diff line number Diff line change @@ -22,11 +22,11 @@ The lexical analyzer determines the program text's :ref:`encoding <encodings>`
2222:ref: `source characters <lexical-source-character >`.
2323If the text cannot be decoded, a :exc: `SyntaxError ` is raised.
2424
25- The lexical analyzer then generates a stream of tokens from the source
26- characters.
27- The type of each generated token, or other special behavior of the analyzer,
28- generally depends on the first source character that hasn't yet been processed.
29- The following table gives a quick summary of these characters,
25+ Next, the lexical analyzer uses the source characters to generate a stream of tokens.
26+ The type of a generated token generally depends on the next source character to
27+ be processed. Similarly, other special behavior of the analyzer depends on
28+ the first source character that hasn't yet been processed.
29+ The following table gives a quick summary of these source characters,
3030with links to sections that contain more information.
3131
3232.. list-table ::
You can’t perform that action at this time.
0 commit comments