Skip to content

Argparse flag mismatch: --stop_new_line creates args.stop_new_line but model_utils.py reads args.stop_newline (crash) #38

@dlwh

Description

@dlwh

Hi! We’re running HELMET via eval.py and hit a crash before evaluation starts due to an argparse attribute mismatch.

Repro:

  1. Checkout commit a62ef7d (may also affect nearby commits).
  2. Run:
    • python eval.py --config configs/cite.yaml --model_name_or_path meta-llama/Llama-3.2-1B --use_vllm_serving --endpoint_url http://127.0.0.1:8000/v1/ --api_key EMPTY --overwrite --no_cuda

Observed:

eval.py parses stop_new_line (so the Namespace has stop_new_line), but model_utils.py calls load_LLM(args) and tries to access args.stop_newline, raising:

AttributeError: 'Namespace' object has no attribute 'stop_newline'. Did you mean: 'stop_new_line'?

Expected:

Evaluation should run without crashing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions