Supports Python 3.13. Python 3.8 and 3.9 support has been dropped.
Note: There are incompatible changes. Use with Mathics-core 9.0.0 or greater.
Support for saving token position information was started. This is in module mathics_scanner.location. Additional location information is saved when mathics_scanner.location.TRACK_LOCATIONS is set to True.
Scanning was revised to handle more kinds of escape sequences and to be sensitive to their placement inside and outside a string. This is in module mathics_scanner.escape_sequences.
Tokenization support for Box Input operator \* was added.
Small YML changes were made to reflect a better understanding of boxing operators. In particular, \* is not a (prefix) operator.
Internals
Mathics3 scanner exceptions of class TranslateError are incompatible with previous versions, and now store error parameters, "name", "tag", and "args".