justMyCode: false ignored in python 3.12 and above when running tests

[falkben]

Note: I could not get the Issue Reporter to work in vscode, so I had to use the feature-request link to create this.

Behaviour

In Python 3.12 and above, when debugging tests, the "justMyCode": false setting is ignored.

Steps to reproduce:

1. install pytest and an external library in a virtual environment using python 3.12 or 3.13 (in my example below I used requests)
2. Create a file called test_external_library.py and create a simple function that calls the external library
3. Create a simple test that calls your function
4. Set a breakpoint in the external library
5. create a launch.json config for debug-test that includes justMyCode set to false.
6. Run the test using one of the interfaces in vscode.
7. Observe that in python 3.12 or 3.13 the breakpoint is ignored. In python 3.11 (and previous), the debugger stops at the breakpoint inside the external library.

Note: this occurs with python installations using uv, conda and homebrew.

Example test_external_library.py:

import requests

def get_example():
    r = requests.get("https://example.com")
    return r.text


def test_get_example():
    assert "Example Domain" in get_example()

In this situation, I set a breakpoint inside the requests get function (inside api.py)

launch.json config:

{
    "version": "0.2.0",
    "configurations": [
        {
            "name": "Debug Tests",
            "type": "debugpy",
            "request": "launch",
            "purpose": [
                "debug-test"
            ],
            "justMyCode": false,
            "console": "integratedTerminal"
        }
    ]
}

Diagnostic data

Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

2024-11-13 17:22:40.236 [warning] Dir "/Users/bfalk/repos/advent-of-code/.pixi/envs" is not watchable (directory does not exist)
2024-11-13 17:22:40.236 [info] Python interpreter path: ./.venv/bin/python
2024-11-13 17:22:40.249 [info] > pyenv which python
2024-11-13 17:22:40.249 [info] cwd: .
2024-11-13 17:22:41.360 [info] Starting Pylance language server.
2024-11-13 17:36:19.069 [info] Discover tests for workspace name: advent-of-code - uri: /Users/bfalk/repos/advent-of-code
2024-11-13 17:36:19.089 [info] > . ./.venv/bin/activate && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python ~/.vscode/extensions/ms-python.python-2024.20.0-darwin-arm64/python_files/printEnvVariables.py
2024-11-13 17:36:19.089 [info] shell: bash
2024-11-13 17:36:19.252 [info] > ./.venv/bin/python ~/.vscode/extensions/ms-python.python-2024.20.0-darwin-arm64/python_files/testing_tools/run_adapter.py discover pytest -- --rootdir . -s --cache-clear tests
2024-11-13 17:36:19.252 [info] cwd: .
2024-11-13 17:36:26.597 [info] > ./.venv/bin/python -m pytest --rootdir . --override-ini junit_family=xunit1 --junit-xml=/var/folders/d5/7lllrg_s1238gsx2j2ng9bqw0002h3/T/tmp-34581rKova1P4u5CN.xml ./tests/test_requests.py::test_get_example
2024-11-13 17:36:26.597 [info] cwd: .
2024-11-13 17:36:31.841 [info] Using configuration in launch.json
2024-11-13 17:36:32.054 [info] CreateEnv Trigger - Skipping for /Users/bfalk/repos/advent-of-code
2024-11-13 17:36:32.157 [info] Send text to terminal: source /Users/bfalk/repos/advent-of-code/.venv/bin/activate
2024-11-13 17:36:32.706 [info] Send text to terminal:  /usr/bin/env /Users/bfalk/repos/advent-of-code/.venv/bin/python /Users/bfalk/.vscode/extensions/ms-python.debugpy-2024.13.2024111101-darwin-arm64/bundled/libs/debugpy/adapter/../../debugpy/launcher 49669 -- /Users/bfalk/.vscode/extensions/ms-python.python-2024.20.0-darwin-arm64/python_files/testlauncher.py /Users/bfalk/repos/advent-of-code pytest --rootdir /Users/bfalk/repos/advent-of-code --override-ini junit_family=xunit1 --junit-xml=/var/folders/d5/7lllrg_s1238gsx2j2ng9bqw0002h3/T/tmp-34581xrpDKxB2YyK2.xml --capture no ./tests/test_requests.py::test_get_example 

[eleanorjboyd]

@justschen - tagging you since user reported issue with the issue reporter

[eleanorjboyd]

I will investigate- thank you for the report!

[jacobeatsspam]

I'm finding that justMyCode: false is affecting run behavior. When I set it, the debugger runner is not sourcing my python environment correctly, opting to search for python at ~/.local/lib/python<version>.

[alexwilson1]

Same issue here with justMyCode: false being ignored in 3.12. Reverted to 3.11 to debug something and it worked.

[lukaszkadlubowski]

Same here.

In Windows + python3.11 justMyCode: false it is working fine.

However, it is ignored when debugging tests for configurations such as WSL+python3.12 or Windows+python3.12. For what it's worth, there is a difference in popup messages when trying to step into the python standard library code, as it is shown below (the first one is for justMyCode: false and the second one is for justMyCode: true), but the incorrect debugging behavior is the same:

[EuleMitKeule]

Can confirm this happening in WSL with Python 3.12.

[Rubikoid]

Confirming problem with debugging tests on SSH-Remote to MacOS on python 3.12.

Debugging tests don't work and either magic config like

        {
            "name": "Python: Debug Tests",
            "type": "debugpy",
            "request": "launch",
            "program": "${file}",
            "purpose": [
                "debug-test",
                "debug-in-terminal",
            ],
            "console": "integratedTerminal",
            "justMyCode": false
        },

for launch.json don't work.

[eleanorjboyd]

@anthonykim1 is this included with the 3.12 work you are doing or is this separate?

[anthonykim1]

@eleanorjboyd Did you mean Python3.13 REPL in terminal related work? Then no, I think they are separate

[github-actions]

Because we have not heard back with the information we requested, we are closing this issue for now. If you are able to provide the info later on, then we will be happy to re-open this issue to pick up where we left off.

Happy Coding!