raise OSError(err, f'Connect call failed {address}') ConnectionRefusedError: [Errno 111] Connect call failed ('10.244.48.126', 8080)

[ALLISWELL8]

[zhuohaoyu]

Hi, from the error message you posted, I think you might need to take a quick look at the official quickstart guide of text-generation-inference (https://huggingface.co/docs/text-generation-inference/quicktour). This might help you resolve issues related to deploying models for evaluation.

[ALLISWELL8]

你好，打扰一下，我之前没有接触过这种方式部署模型，你能提供一个详细的解决该问题的方式吗