Fy/sllm checkpoint#2

Open

future-xy wants to merge 11 commits intomainfrom

fy/sllm_checkpoint

Commits on Sep 10, 2024

add serverless-llm loader

xly
authored and
future-xy
committed
custom load api

xly
authored and
future-xy
committed
save load sllm

Leyang Xue
authored and
future-xy
committed
early load cpu & single gpu save

Leyang Xue
authored and
future-xy
committed
update loader

Leyang Xue
authored and
future-xy
committed
vllm loader new API

Leyang Xue
authored and
future-xy
committed
set empty tensor

Leyang Xue
authored and
future-xy
committed
clean up loader

Leyang Xue
authored and
future-xy
committed

Commits on Sep 11, 2024

feat: use save and load model api
future-xy
committed

Commits on Sep 15, 2024