Introduce capture pool for cuda graph replay#3352

zackangelo wants to merge 2 commits intohuggingface:mainhuggingface/candle:mainfrom

mixlayer:cuda_graph_capturemixlayer/candle:cuda_graph_captureCopy head branch name to clipboard