Support for speculative decoding

[BowenBao]

Hi team, is there plan to support speculative decoding?

cc @spandantiwari-amd

[natke]

Hi @BowenBao, yes we do have speculative decoding on our roadmap but do not have a definite schedule for that yet

[BowenBao]

Thank you @natke, we are happy to contribute an initial version :)