AssersionError Profiler #8696
Unanswered
tomlapp
asked this question in
Lightning Trainer API: Trainer, LightningModule, LightningDataModule
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I use the profiles ( AdavancedProfiler et SimpleProfile ) , it works.
But i use the profile : PytorchProfile , i have an error.
File "/home/anaconda3/envs/glearn_stage/bin/gammalearn", line 33, in
sys.exit(load_entry_point('Gammalearn', 'console_scripts', 'gammalearn')())
File "/home/Bureau/Stage/GammaLearn/gammalearn-lightning/gammalearn/experiment_runner.py", line 691, in main
trainer.fit(gl_lightning_module,
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 460, in fit
self._run(model)
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 758, in _run
self.dispatch()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 799, in dispatch
self.accelerator.start_training(self)
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/accelerators/accelerator.py", line 96, in start_training
self.training_type_plugin.start_training(trainer)
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 144, in start_training
self._results = trainer.run_stage()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 809, in run_stage
return self.run_train()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 894, in run_train
self.train_loop.on_train_end()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/trainer/training_loop.py", line 124, in on_train_end
self.trainer.profiler.describe()
File "/home/trivellato/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/profilers.py", line 156, in describe
summary = self.summary()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/pytorch.py", line 454, in summary
self._delete_profilers()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/pytorch.py", line 495, in _delete_profilers
self._cache_functions_events()
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/pytorch.py", line 490, in _cache_functions_events
self.function_events = self.profiler.events() if _KINETO_AVAILABLE else self.profiler.function_events
File "/home/anaconda3/envs/glearn_stage/lib/python3.8/site-packages/torch/profiler/profiler.py", line 333, in events
assert self.profiler
AssertionError
Exception ignored in: <function BaseProfiler.del at 0x7f1f5350aaf0>
Traceback (most recent call last):
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/profilers.py", line 198, in del
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/pytorch.py", line 510, in teardown
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/pytorch.py", line 495, in _delete_profilers
File "/home/.local/lib/python3.8/site-packages/pytorch_lightning/profiler/pytorch.py", line 490, in _cache_functions_events
File "/home/anaconda3/envs/glearn_stage/lib/python3.8/site-packages/torch/profiler/profiler.py", line 333, in events
AssertionError:
Beta Was this translation helpful? Give feedback.
All reactions