Does pytorch-lightning work with Pytorch 2.0?

[eraoul]

I know Pytorch 2 was just announced and it's not an official release yet, but can we use it already with lightning?

[johnnynunez]

any news?

[akihironitta]

The PyTorch 2.0 feature torch.compile(lightning_model) should be available in master, which was tracked in #15894.

[SonodaKazuto]

You can check this link but actually I face some problems.

[akihironitta]

@AugustoPeres Thanks for trying it out :) By the way, what's the complete traceback that you've pasted above?

AssertionError: expected FunctionType found method

It would be fantastic if you could create a new GitHub issue with your script and env detail for repro!

[johnnynunez]

In my case is using hydra and lightning.

[akihironitta]

Hi @johnnynunez please create a GitHub issue with your script and env detail! Thank you

[johnnynunez]

Hi @johnnynunez please create a GitHub issue with your script and env detail! Thank you

opened #16395

[AugustoPeres]

Hi @johnnynunez please create a GitHub issue with your script and env detail! Thank you

opened #16395

@akihironitta and @johnnynunez this is exactly what was happening with me so I will refrain from opening another issue and will wait for an answer there.

[akihironitta]

hey @eraoul! PyTorch Lightning already supports PyTorch 2.0 as PyTorch 2.0 is fully backwards-compatible. The major PyTorch 2.0 feature torch.compile(model) should work in master, too, according to the tracking issue #15894 (comment). If you find any issues, please contribute by creating GitHub issues! ⚡