reduce the prediction time. #2
Description
I am trying to use the x2-large model which is taking almost 40 mins for prediction is there any way I can reduce the time to a reasonable level. any suggestion would be appreciated.Thanks. any prefered hardware requirement would also be helpfull