Test classes no longer work with pytest 6.2.5

[matthew-mcallister]

Behaviour

Expected vs. Actual

This bug occurs with pytest version 6.2.5. All tests should be visible in the Test Explorer, with classes (e.g. class TestWidget) appearing as nested levels in the hierarchy.

However, if a test class is present (or multiple test classes), all other tests are hidden except for the tests in that class.

Steps to reproduce:

1. Define a test file test_example.py with the following text:

   def test_one():
       pass
   
   class TestExample:
       def test_two():
           pass

2. Run test discovery in the Test Explorer.
3. Only test_two is visible.
4. If you delete TestExample, then test_one becomes visible again.

Diagnostic data

• Extension version: v2023.21.13131007
• Python version (& distribution if applicable, e.g. Anaconda): 3.9.12
• Type of virtual environment used (e.g. conda, venv, virtualenv, etc.): Venv
• Value of the python.languageServer setting: Pylance

Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

  <Module test_example.py>
    <Function test_outer>
2023-11-09 15:40:25.183 [info] 
    <Class TestClass>
        <Function test_inner>

User Settings

languageServer: "Pylance"

testing
• pytestArgs: "-vv"
• pytestEnabled: true

[TomeSq]

I had the same symptoms.
I reverted back to v2023.8.0 and now I can detect it correctly.

[karthiknadig]

You can opt out of the pytest adapter experiment, if that is causing this issue. You should be able to see which experiment you are in in Output > Python logs.

[karthiknadig]

This seems to be working for me, with the experimental test adapter:

Would it be possible for you to share both logs and settings?

[matthew-mcallister]

Sorry, I figured out the problem. The plugin no longer works with pytest 6.2.5. Updating to the latest version fixed. Updating the issue.

[eleanorjboyd]

Hi @matthew-mcallister, to clarify does it now work with the extension after updating or does this problem still exist? Thanks