Remove unnecessary installations for linux CPU test

[samanklesaria]

Tests should no longer have external dependencies beyond scipy, numpy, pytorch, and testing utilities like parameterized. This PR removes the installation of dependencies beyond these when running CI.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/audio/4037

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 9 New Failures, 5 Pending, 1 Unrelated Failure

As of commit 3245a23 with merge base bc3de07 ():

NEW FAILURES - The following jobs have failed:

• .github/workflows/bandit.yml (gh)
• .github/workflows/integration-test.yml (gh)
• .github/workflows/lint.yml (gh)
• .github/workflows/pr-labels.yml (gh)
• .github/workflows/unittest-macos-cpu.yml (gh)
• .github/workflows/unittest-windows-cpu.yml (gh)
• .github/workflows/unittest-windows-gpu.yml (gh)
• Build Aarch64 Linux Wheels / pytorch/audio / upload / upload-wheel-py3_9-cuda-aarch6412_9-aarch64 (gh)
  Unable to download artifact(s): Artifact not found for name: pytorch_audio__3.9_cu129_aarch64
• Build documentation / build / Build doc (gh)
  At least one of the pre-conditions you specified did not hold

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Aarch64 Linux Wheels / pytorch/audio / build-wheel-py3_9-cuda-aarch6412_9-aarch64 (gh) (trunk failure)
  ImportError: /lib64/libm.so.6: version GLIBC_2.29' not found (required by /usr/local/cuda/lib64/libnvshmem_host.so.3)`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[samanklesaria]

We have to merge #4031 first.

[samanklesaria]

It seems that CTC Decoder requires flashlight-text package, which it depends on pretty heavily. We could disable the tests for it.

test_librispeech_lightning and test_mustc_lightning and test_tedlium3_lightning require lightning. It seems these just test lightning integration (which we're deprecating anyway), so we should be able to delete these tests.

tacotron2/test_text_preprocessing.py requires unidecode. But we're only testing on ascii text. Would could give text_to_sequence a flag for whether or not to use unidecode? Or we could just add a warning to it saying that only ascii input is allowed?

I'm still not sure how much we're testing the use of inflect, which is also used in tacotron2/test_text_preprocessing.py. Perhaps we can restrict our testing to examples that don't require it, and not load the module until it is needed.

[NicolasHug]

OK, thanks. Let's just skip all of those by setting the appropriate env variable e.g. TORCHAUDIO_TEST_ALLOW_SKIP_IF_NO_CTC_DECODER=1.