Skip to content

评测自己的服务发生报错AttributeError: 'ForkAwareLocal' object has no attribute 'connection' #278

@Ladazhx

Description

@Ladazhx

Describe the bug
当我使用本项目评测我本地启动的模型服务时,跑一会就会发生报错

Image

start command
python run.py benchmark --target "http://10.16.2.3:11092" --model Qwen2_5-VL-7B-Instruct --processor /Users/huizhang/Develop/ai/model/Qwen2.5-VL-7B-Instruct --rate-type sweep --max-seconds 60 --data "prompt_tokens=512,output_tokens=10"

Environment
Include all relevant environment information:

  1. OS: macOS 12.7.3
  2. Python version : 3.10.15

帮忙确定一下是什么环节的问题

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions