MacOS Sequoia, Python 3.13.0: Hard crash when working with legacy code

[MikeRobinson12345]

Crash report

What happened?

Exception in thread django-main-thread:
Traceback (most recent call last):
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/utils.py", line 69, in __getitem__
    return self._engines[alias]
           ~~~~~~~~~~~~~^^^^^^^
KeyError: 'django'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 174, in get_package_libraries
    module = import_module(entry[1])
  File "/Library/Frameworks/Python.framework/Versions/3.13/lib/python3.13/importlib/__init__.py", line 88, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 1022, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/Users/mike/projects/GGA/pinax/templatetags/templatetags/shorttimesince_tag.py", line 6, in <module>
    from django.utils.translation import ungettext, gettext
ImportError: cannot import name 'ungettext' from 'django.utils.translation' (/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/translation/__init__.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/mike/projects/GGA/./manage.py", line 15, in <module>
    execute_from_command_line(sys.argv)
    ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
    ~~~~~~~~~~~~~~~^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/__init__.py", line 436, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/base.py", line 413, in run_from_argv
    self.execute(*args, **cmd_options)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/commands/runserver.py", line 75, in execute
    super().execute(*args, **options)
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
Traceback (most recent call last):
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/base.py", line 459, in execute
    output = self.handle(*args, **options)
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/utils.py", line 69, in __getitem__
    return self._engines[alias]
           ~~~~~~~~~~~~~^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/commands/runserver.py", line 112, in handle
    self.run(**options)
    ~~~~~~~~^^^^^^^^^^^
KeyError: 'django'
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/commands/runserver.py", line 119, in run
    autoreload.run_with_reloader(self.inner_run, **options)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^

During handling of the above exception, another exception occurred:

  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/autoreload.py", line 671, in run_with_reloader
    start_django(reloader, main_func, *args, **kwargs)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Traceback (most recent call last):
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/autoreload.py", line 660, in start_django
    reloader.run(django_main_thread)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 174, in get_package_libraries
    module = import_module(entry[1])
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/autoreload.py", line 343, in run
    autoreload_started.send(sender=self)
    ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
  File "/Library/Frameworks/Python.framework/Versions/3.13/lib/python3.13/importlib/__init__.py", line 88, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/dispatch/dispatcher.py", line 189, in send
    response = receiver(signal=self, sender=sender, **named)
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 1022, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/Users/mike/projects/GGA/pinax/templatetags/templatetags/shorttimesince_tag.py", line 6, in <module>
    from django.utils.translation import ungettext, gettext
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/autoreload.py", line 50, in watch_for_template_changes
    for directory in get_template_directories():
                     ~~~~~~~~~~~~~~~~~~~~~~~~^^
ImportError: cannot import name 'ungettext' from 'django.utils.translation' (/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/translation/__init__.py)
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/autoreload.py", line 16, in get_template_directories
    for backend in engines.all():
                   ~~~~~~~~~~~^^

The above exception was the direct cause of the following exception:

  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/utils.py", line 94, in all
    return [self[alias] for alias in self]
            ~~~~^^^^^^^
Traceback (most recent call last):
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/utils.py", line 85, in __getitem__
    engine = engine_cls(params)
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 26, in __init__
    options["libraries"] = self.get_templatetag_libraries(libraries)
                           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 88, in get_templatetag_libraries
    libraries = get_installed_libraries()
  File "/Library/Frameworks/Python.framework/Versions/3.13/lib/python3.13/threading.py", line 1041, in _bootstrap_inner
    self.run()
    ~~~~~~~~^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 163, in get_installed_libraries
    module_name: full_name for module_name, full_name in get_template_tag_modules()
                                                         ~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/Library/Frameworks/Python.framework/Versions/3.13/lib/python3.13/threading.py", line 992, in run
    self._target(*self._args, **self._kwargs)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 151, in get_template_tag_modules
    for name in get_package_libraries(pkg):
                ~~~~~~~~~~~~~~~~~~~~~^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/autoreload.py", line 64, in wrapper
    fn(*args, **kwargs)
    ~~^^^^^^^^^^^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/backends/django.py", line 176, in get_package_libraries
    raise InvalidTemplateLibrary(
    ...<2 lines>...
    ) from e
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/commands/runserver.py", line 134, in inner_run
    self.check(display_num_errors=True)
    ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
django.template.library.InvalidTemplateLibrary: Invalid template library specified. ImportError raised when trying to load 'pinax.templatetags.templatetags.shorttimesince_tag': cannot import name 'ungettext' from 'django.utils.translation' (/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/utils/translation/__init__.py)
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/management/base.py", line 486, in check
    all_issues = checks.run_checks(
        app_configs=app_configs,
    ...<2 lines>...
        databases=databases,
    )
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/core/checks/registry.py", line 88, in run_checks
    new_errors = check(app_configs=app_configs, databases=databases)
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/contrib/admin/checks.py", line 79, in check_dependencies
    for engine in engines.all():
                  ~~~~~~~~~~~^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/utils.py", line 94, in all
    return [self[alias] for alias in self]
            ~~~~^^^^^^^
  File "/Users/mike/.virtualenvs/djangoprod/lib/python3.13/site-packages/django/template/utils.py", line 85, in __getitem__
    engine = engine_cls(params)
Fatal Python error: _enter_buffered_busy: could not acquire lock for <_io.BufferedWriter name='<stderr>'> at interpreter shutdown, possibly due to daemon threads
Python runtime state: finalizing (tstate=0x00000001056ec560)

Current thread 0x00000001f2b83840 (most recent call first):
  <no Python frame>

I'm trying to resurrect some old Python code that isn't maintained anymore. (Pinax.) But, what's significant is what happened at the very end – the entire Python interpreter CRASHED HARD. (This happened on the command line while invoking Django "runserver," hence a "web browser" context.)

CPython versions tested on:

CPython main branch

Operating systems tested on:

macOS

Output from running 'python -VV' on the command line:

No response

[MikeRobinson12345]

Important Update: When I changed the code to call "ngettext" instead of "ungettext" ... this being a change that was made in Django quite some time ago (didn't know it) ... the problem disappeared. The interpreter no longer crashed, and the "manage.py runserver" call succeeded. (!!! !!!)

Although this issue is now "closed for 'me,'" I am going to leave it open because there's obviously some underlying "interpreter issue" here. I'm guessing that it's that "engine_cls()" function somehow, but I don't want to dive too deeply into it because "this is not my wheelhouse."

Someone who knows better about such things ... "do with this problem report as you will."

[terryjreedy]

To do anything, an import expert would have to extract a 3rd-party-free crashing example.

[ZeroIntensity]

Please report this to django first.

[MikeRobinson12345]

I can only report to your teams “what happened.” When I corrected the coding error shown in the traceback, the problem vanished. But the event – a hard crash of Python itself – was so unusual that I wanted you to formally know.

…

On Dec 18, 2024, at 6:18 PM, Terry Jan Reedy ***@***.***> wrote: To do anything, an import expert would have to extract a 3rd-party-free crashing example. — Reply to this email directly, view it on GitHub <#128075 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BNZ3VG65ON5OADZQTZDFIGL2GH7ENAVCNFSM6AAAAABT3HSSD2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJSGQ2DQMBUGQ>. You are receiving this because you authored the thread.

[MikeRobinson12345]

I will do so. When I corrected the coding error shown in the traceback, the problem vanished! But the incident is so unusual – a hard crash of the Python interpreter itself – that I wanted your teams to also formally know that it had occurred.

…

On Dec 18, 2024, at 8:14 PM, Peter Bierma ***@***.***> wrote: Please report this to django first. — Reply to this email directly, view it on GitHub <#128075 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BNZ3VG7I2OZ53FKR7F27DDD2GIMV3AVCNFSM6AAAAABT3HSSD2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJSGU3TCMRRGU>. You are receiving this because you authored the thread.

[ZeroIntensity]

Yeah, but a hard crash isn't necessarily our fault. A buggy C extension could easily cause one. Report it to Django and see if they have any insight.

[MikeRobinson12345]

No problem. I’m just looking to “document,” to anyone and everyone who might be concerned. I have dutifully posted to Django – of course I have no idea if they use “C extensions” anywhere in their code. “This happened to me: now, you know."

…

On Dec 19, 2024, at 7:28 AM, Peter Bierma ***@***.***> wrote: Yeah, but a hard crash isn't necessarily our fault. A buggy C extension could easily cause one. Report it to Django and see if they have any insight. — Reply to this email directly, view it on GitHub <#128075 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BNZ3VGZOR5AQKSLV42JRYL32GK3XZAVCNFSM6AAAAABT3HSSD2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJTGY4DSMRXGM>. You are receiving this because you authored the thread.

[ZeroIntensity]

Given that Django hasn't reported this to us upstream by now, I'm going to assume that this isn't an issue on our end.

[MikeRobinson12345]

I agree with your assessment, and I have managed to work around the problem. “Case closed, although very peculiar."

…

On Jan 15, 2025, at 8:46 PM, Peter Bierma ***@***.***> wrote: Given that Django hasn't reported this to us upstream by now, I'm going to assume that this isn't an issue on our end. — Reply to this email directly, view it on GitHub <#128075 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BNZ3VG7TZKWEQWQT2VSTHET2K4FQNAVCNFSM6AAAAABT3HSSD2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKOJUGI4TGOBYGE>. You are receiving this because you authored the thread.