Skip to content

Kwargs from DDPShardedPlugin are not forwarded to the ShardedDataParallel wrapperΒ #9467

@SeanNaren

Description

@SeanNaren

πŸ› Bug

If I pass DDPShardedPlugin(reduce_fp16=True) as a plugin to the Trainer, I would expect reduce_fp16 to be sent to the ShardedDataParallel wrapper. This is inline with what happens in the DDPPlugin with the DistributedDataParallel.

Metadata

Metadata

Assignees

Labels

3rd partyRelated to a 3rd-partybugSomething isn't workingpriority: 1Medium priority task

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions