`import scala.language.adhocExtensions` may break incremental compilation

[OlegYch]

Compiler version

3.x-3.7.1

Minimized code

couldn't minimize as it's intermittent
to (hopefully) reproduce:
https://github.com/OlegYch/sbt-8160

Output

sbt compile recompiles everything without any changes
in the debug log i see
[debug] Invalidating '${CSR_CACHE}/https/repo1.maven.org/maven2/org/scala-lang/scala-library/2.13.16/scala-library-2.13.16.jar' because could not find class scala.language$adhocExtensions$ on the classpath.

Expectation

no recompilation if source didn't change

Note: originally reported at sbt/sbt#8160 but it seems more like a compiler problem