Hi team, thanks for the work on this repo it's quite fantastic. I have everything setup and working perfectly ( detectron2 inference), however I would now like to move to my next step which is animating a character in babylonjs using the joints data I get after running infer_video_d2. I have found a few articles but since the tech is still quite obscure not much info exists, I have found some info around using 3d pose baseline and tried applying that with the data output from this repo but that doesn't work correctly.
If possible could you provide some info/tips around how one would go about applying the output data to animate a character (through bone rotations since that makes the most sense) and additionally shed some light on structure of the output data (order of the joints, scaling factor required and other general info that would be helpful in translating the data to animation).