Discussions

• 1 You must be logged in to vote

  ☺️

  Looking for feedback on an idea: Inheritance hierarchy of LightningDataModules

  lebrice started Jul 21, 2021 in Show off your work

  

  

  

  

  3
• 1 You must be logged in to vote

  🤖

  [DeepSpeed] Multi-GPU can't converge

  waiting on author Waiting on user action, correction, or update working as intended Working as intended

  thomas-happify asked Jun 17, 2021 in DDP / multi-GPU / multi-node · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🤖

  How to sync buffers in multi-gpu training

  MeteorsHub asked Jul 26, 2021 in DDP / multi-GPU / multi-node · Answered

  

  

  2
• 1 You must be logged in to vote

  ⚡

  T5 FineTuning freezes on 0% Validation Sanity Check

  accelerator: tpu Tensor Processing Unit

  prikmm asked Jul 25, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  2
• 1 You must be logged in to vote

  ⚡

  Train one optimizer/ model each batch

  sachinruk asked Jul 20, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  3
• ⚡

  What is the monitor of lr_scheduler?

  Co1lin asked Jul 24, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  💬

  What is the monitor of lr_scheduler?

  Co1lin started Jul 26, 2021 in General

  

  

  1
• 2 You must be logged in to vote

  ⚡

  How to know use learning rate finder?

  talhaanwarch asked Jul 24, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  😎

  Getting error after completion of 1st epoch

  Abhishek-Prajapat asked Jul 8, 2021 in code help: CV · Answered

  

  

  2
• ⚡

  how to put trainer.fit() in for loop?

  anik123 asked Jul 12, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  2
• 1 You must be logged in to vote

  🤖

  RuntimeError: unable to open shared memory object </torch_91130_1372465664> in read-write mode

  EvanZ asked Jul 22, 2021 in DDP / multi-GPU / multi-node · Answered

  

  

  1
• ⚡

  Does LearningRateMonitor work with deepspeed?

  yuvalkirstain asked May 31, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  ⚡

  Data augmentation and reload_dataloaders_every_epoch

  dianemarquette asked Jul 21, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  2
• 1 You must be logged in to vote

  ⚡

  moving to lightning makes my code slower :(

  glupol asked Jul 14, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  ⚡

  Only log the first test dataloader results.

  AristoYU asked Jul 20, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🤖

  DDP with shared file system

  YuShen1116 asked Jul 20, 2021 in DDP / multi-GPU / multi-node · Answered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  How to print learning rate

  talhaanwarch asked Jul 20, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  init_process_group not called when training on multiple-GPUs

  EricWiener asked Jul 21, 2021 in DDP / multi-GPU / multi-node · Answered

  

  

  2
• 1 You must be logged in to vote

  ⚡

  unexpected behavior in automatic optimization

  nik-sm asked Jul 21, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  When does loss.backward() get called when accumulating gradients?

  sachinruk asked Jul 19, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  3
• 1 You must be logged in to vote

  ⚡

  Multiple dataloaders in training

  YuShen1116 asked Jul 14, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  2
• 1 You must be logged in to vote

  💬

  Is it possible to change the output dimension of a checkpoint model?

  shrijan00 started Jul 15, 2021 in General

  

  

  3
• 1 You must be logged in to vote

  ⚡

  Loss Module with inner Network

  vasl12 asked Jul 16, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  4
• 1 You must be logged in to vote

  ⚡

  Interpret the output (logs) during training

  talhaanwarch asked Jul 13, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  1
• 1 You must be logged in to vote

  ⚡

  SimCLR train NX-Tent loss dips at regular intervals (related to batch size)

  elizastarr asked Jul 14, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1