Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -166,6 +166,7 @@ docs/src
*.log
*.swp
.DS_Store
*~
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is this for?


# Translations
*.mo
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ async def conceptual_forge_rl_step(services, step):

**Key difference**: Same RL logic, but each component is now a distributed, fault-tolerant, auto-scaling service.

Did you realise-we are not worrying about any Infra code here! TorchForge Automagically handles the details behind the scenes and you can focus on writing your RL Algorthms!
Did you realise-we are not worrying about any Infra code here! TorchForge Automagically handles the details behind the scenes and you can focus on writing your RL Algorithms!


## Why This Matters: Traditional ML Infrastructure Fails
Expand Down
2 changes: 1 addition & 1 deletion src/forge/actors/generator.py
Original file line number Diff line number Diff line change
Expand Up @@ -667,7 +667,7 @@ async def update_weights(
loaded = model.load_weights([(name, param)])
del param
loaded_weights.update(loaded)
logger.info(f"[PolicyWorker] updated {len(loaded_weights)} paremeters")
logger.info(f"[PolicyWorker] updated {len(loaded_weights)} parameters")
t.stop()
return
# normal update_weights without shared memory prefetching
Expand Down
2 changes: 1 addition & 1 deletion tests/integration_tests/test_policy_update.py
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ async def _setup_and_teardown(request):

if use_dcp_override is not None:
trainer_cfg["use_dcp"] = use_dcp_override
logger.info(f"`trainer.use_dcp` is overriden to {use_dcp_override}")
logger.info(f"`trainer.use_dcp` is overridden to {use_dcp_override}")

if cfg.get("provisioner", None) is not None:
await init_provisioner(
Expand Down