Discussions

• 1 You must be logged in to vote

  #️⃣

  Training multiple Lightning models directly from the local terminal to the AWS instance

  celsofranssa asked Aug 11, 2023 in Lightning App API: LightningApp, LightningFlow, LightningWork · Unanswered

  

  

  0
• 10 You must be logged in to vote

  🤖

  What is the proper way to load large pretrained HF model (e.g. bloom) for inference and finetuning?

  richarddwang asked Apr 20, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  Vote ModelCheckpoint and EarlyStopping don’t seem to work?

  Struggle-Forever started Aug 6, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  💬

  How to set lr scheduler from yaml for lightningcli?

  Galaxy-Husky started Aug 1, 2023 in General

  

  

  2
• 1 You must be logged in to vote

  ⚡

  Ignore submodule while loading onto the GPU.

  konrad-karanowski asked Aug 1, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Does Lightning disable PyTorch registered forward hooks when using trainer.validate?

  jonathanking asked Jul 31, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 4 You must be logged in to vote

  🤖

  DDP MultiGPU Training doesn't reduce training time

  AlejandroTL asked Jul 28, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 3 You must be logged in to vote

  😎

  How to use learning rate scheduler

  talhaanwarch asked Nov 20, 2022 in code help: CV · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🤖

  Why does the distributed training get stuck here and doesn't move.

  distributed Generic distributed-related topic

  Struggle-Forever asked Oct 24, 2022 in DDP / multi-GPU / multi-node · Answered

  

  

  

  

  9
• 1 You must be logged in to vote

  ⚡

  New error in Trainer started appearing recently in a previously running code.

  cwoolfo1 asked Mar 7, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  💭

  Num_of_step increase infinitely but num_of_epoch stuck 0 with dynamic batch size dataset

  Lingeng56 asked Jul 27, 2023 in code help: NLP / ASR / TTS · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Proper Iteration/Experimentation using LightningModule

  norbertmarko asked Jul 24, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 6 You must be logged in to vote

  ⚡

  run_training_epoch duration increases with more epochs

  nilsleh asked May 25, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  Question: save checkpoint at the end of every validation epoch, regardless of monitor

  pfeatherstone started Jul 19, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  ⚡

  Trainer Issue: Validation does not occur after initial validation

  PeterM18 asked Jun 22, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  Is torch.compile called under the head somewhere?

  RuABraun started Jul 13, 2023 in General

  

  

  0
• 3 You must be logged in to vote

  ⚡

  Gradient Clipping with mix precision in case of NaN loss

  talhaanwarch asked Jan 11, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  3
• 8 You must be logged in to vote

  ⚡

  Is trainer.test() supposed to call LightningDataModule.prepare_data() (again)

  hogru asked Sep 26, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  3
• 1 You must be logged in to vote

  ⚡

  tensor in validation_step cannot flow a gradient

  Nokimann asked Jun 23, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  VSCode and jsonargparse error

  nicoloesch asked Jul 8, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  3
• 1 You must be logged in to vote

  🤖

  How to add Deepspeed Activation Checkpointing to LLM for Fine-Tuning in PyTorch Lightning?

  rileyhun asked Jul 7, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💭

  multiple gpu training gives loss of nan

  bmt621 asked Jul 6, 2023 in code help: NLP / ASR / TTS · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  How can I use a weighted loss with LightningCLI?

  maxfreu asked Jun 30, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  2
• 3 You must be logged in to vote

  😎

  Runtime Error: broadcast backward in place modification of view

  lstrgar asked Aug 17, 2021 in code help: CV · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  Possible to change starting epoch?

  Lordmau5 asked Apr 16, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Closed · Answered

  

  

  2