Adds support for custom replicas, updates policy to spawn correctly within `spawn_service`#96

allenwang28 merged 9 commits intometa-pytorch:mainmeta-pytorch/torchforge:mainfrom

allenwang28:policy_replicaallenwang28/forge:policy_replicaCopy head branch name to clipboard