[rolling batch] allow client timeouts to cancel engine requests#2732

siddvenk wants to merge 1 commit intodeepjavalibrary:masterdeepjavalibrary/djl-serving:masterfrom

siddvenk:rb-req-cancelsiddvenk/djl-serving:rb-req-cancelCopy head branch name to clipboard