Load model from torchstore into vLLM#55

Merged

ankitageorge merged 37 commits intomainfrom

torchstore-testing

Aug 21, 2025

Commits on Aug 13, 2025

initial testing
ankitageorge
committed

Commits on Aug 14, 2025

more testing
ankitageorge
committed
init works
ankitageorge
committed
use instruct in path
ankitageorge
committed
somewhat working
ankitageorge
committed
kinda working, memory/timeout issue
ankitageorge
committed
store and load working!
ankitageorge
committed

Commits on Aug 15, 2025

clean up logging
ankitageorge
committed
sharded working
ankitageorge
committed
it's working? but _get_tensor_parallel_sharding_strategy is hacky:
ankitageorge
committed
it's working
ankitageorge
committed

Commits on Aug 18, 2025

some cleanups
ankitageorge
committed
more clean up
ankitageorge
committed
clean ups
ankitageorge
committed
get rid of if else logic
ankitageorge
committed
mapping
ankitageorge
committed

Commits on Aug 19, 2025

mostly working
ankitageorge
committed
mostly working 2
ankitageorge
committed
mostly working 3
ankitageorge
committed
single test passes
ankitageorge
committed

Commits on Aug 20, 2025

single and fsdp works with calculated sharding
ankitageorge
committed
convert from script to test
ankitageorge
committed
cleaning things up
ankitageorge
committed
more cleaning up
ankitageorge
committed
move sharding to helper
ankitageorge
committed
move sharding to helper 2
ankitageorge
committed
refactor
ankitageorge
committed
use sharding class in policy and test
ankitageorge
committed
renames
ankitageorge
committed
use test fixture
ankitageorge
committed
use helper in test
ankitageorge
committed
remove extra comments
ankitageorge
committed
remove extra load
ankitageorge
committed
clean up prints
ankitageorge
committed

Commits on Aug 21, 2025

requested changes
ankitageorge
committed
requested changes 2
ankitageorge
committed
use remote dir
ankitageorge
committed