[WIP][Full Dtensor] Work with full dtensor fully_shard#2616

fegin wants to merge 2 commits intogh/fegin/100/basepytorch/torchtitan:gh/fegin/100/basefrom

gh/fegin/100/headpytorch/torchtitan:gh/fegin/100/headCopy head branch name to clipboard