feat: optimize cache, add checkConnection#739

yuluo-yx wants to merge 1 commit intovllm-project:mainvllm-project/semantic-router:mainfrom

yuluo-yx:1127-yuluo/featyuluo-yx/semantic-router:1127-yuluo/featCopy head branch name to clipboard