Discussions

• 1 You must be logged in to vote

  ⚡

  Best way to copy training data to /tmp before training?

  kalekundert asked Dec 17, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  😎

  Overfit when num_workers > 1

  hoangvanphi2004 asked Dec 15, 2023 in code help: CV · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🤖

  Dropout across multiple GPU

  vanshilshah97 asked Dec 14, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 2 You must be logged in to vote

  ⚡

  Error occurs when setting accumulate_grad_batches > 1 while using DDPStrategy with static_graph=True

  iamlockelightning asked Jul 14, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  Global module variable re-initialized at training time

  mfoglio started Dec 12, 2023 in General

  

  

  1
• 3 You must be logged in to vote

  🤖

  Fabric - unwrap_model

  pfeatherstone asked Aug 22, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  3
• 3 You must be logged in to vote

  🤖

  How to do contrastive learning with accumulate_grad_batches?

  yipliu asked Dec 10, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ⚡

  How to change the schedule of the built-in PyTorch Profiler?

  profiler

  dpaleka asked Apr 4, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🤖

  DDP Sharded with lightning CLI set up does not work: lightning.fabric.utilities.exceptions.MisconfigurationException: Found invalid type for plugin ddp_sharded. Expected one of: Precision, CheckpointIO, ClusterEnviroment, or LayerSync.

  aaronwtr asked Dec 8, 2023 in DDP / multi-GPU / multi-node · Closed · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  ⚡

  Progress bar in training

  AzmiHaider92 asked Dec 6, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Mixed precision training + TransformerDecoder with a boolean mask

  alvaropp started Dec 5, 2023 in General

  

  

  1
• 2 You must be logged in to vote

  💬

  Pytorch Lightning Flash not working on Colab

  RafayF1 started Nov 1, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  ⚡

  Implementing a callback that loads a checkpoint instead of using ckpt_path="..." in Trainer's fit(), validate(), and test() methods

  ibro45 asked Dec 2, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🤖

  How can i pre-query all of indices that going to be used in DistributedSampler?

  XezXey asked Dec 1, 2023 in DDP / multi-GPU / multi-node · Unanswered

  

  

  0
• 2 You must be logged in to vote

  ⚡

  Validation skipped when using custom batch sampler

  6gsn asked May 7, 2022 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Lightning CLI ckpt_path not loading model weights or hyperparams

  mhbakalar asked Nov 30, 2023 in Lightning App API: LightningApp, LightningFlow, LightningWork · Unanswered

  

  

  1
• 2 You must be logged in to vote

  ⚡

  Memory leak when training on Sagemaker p4 instances with distributed training

  ririya asked Nov 30, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ⚡

  How to train with multiple GPU on Kaggle?

  lcoandrade asked Jul 17, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💬

  How to save the best checkpoint?

  xhuan8 started Nov 29, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  ⚡

  how to use the LightningModule.log to save the image

  FranticEr asked Nov 29, 2023 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Unanswered

  

  

  0
• 1 You must be logged in to vote

  😎

  Adversarial training with lightning

  trainer: validate

  sergedurand asked Sep 19, 2022 in code help: CV · Answered

  

  

  

  

  10
• 3 You must be logged in to vote

  🤖

  NCCL WARN Duplicate GPU detected

  PedroRASB asked May 16, 2022 in DDP / multi-GPU / multi-node · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ☺️

  Code + tutorial on using PyTorch-Lightning + QLoRA/peft to fine tune a LLM from Huggingface

  zjohn77 started Nov 8, 2023 in Show off your work

  

  

  1
• 1 You must be logged in to vote

  💬

  How to improve file reading efficiency？

  morestart started Nov 21, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  ⚡

  How to combine multiple lightning module and save hyperparameters

  kyleong asked Apr 28, 2021 in Lightning Trainer API: Trainer, LightningModule, LightningDataModule · Answered

  

  

  

  

  11