add runtime inference for mt classifier#124

kanson1996 wants to merge 2 commits intoTencent:mainTencent/TencentPretrain:mainfrom

kanson1996:infer_speedkanson1996/TencentPretrain:infer_speedCopy head branch name to clipboard